Mercurial > hg > cc > azure
diff workers/bin/count1.sh @ 11:36b5d379909a
a bit more info in logs
| author | Henry S. Thompson <ht@markup.co.uk> |
|---|---|
| date | Wed, 10 Oct 2018 11:27:06 +0000 |
| parents | 2fbefb8d1a9e |
| children |
line wrap: on
line diff
--- a/workers/bin/count1.sh Mon Oct 08 13:17:23 2018 +0000 +++ b/workers/bin/count1.sh Wed Oct 10 11:27:06 2018 +0000 @@ -1,6 +1,7 @@ #!/bin/bash -echo "# $ID" +echo "# $(date) > $ID.$1" jq '.Envelope|.["WARC-Header-Metadata"]["WARC-Target-URI"]'|cut -f 1 -d ':'|awk '{c[$1]+=1} END {for (k in c) {print k, c[k]}}' +echo "# $(date) < $ID.$1"