Mercurial > hg > cc > azure
view workers/bin/count1.sh @ 18:9631fca89cc6
F2-related stuff, and new experiment
| author | Henry S. Thompson <ht@markup.co.uk> |
|---|---|
| date | Fri, 19 Oct 2018 14:25:19 +0000 |
| parents | 36b5d379909a |
| children |
line wrap: on
line source
#!/bin/bash echo "# $(date) > $ID.$1" jq '.Envelope|.["WARC-Header-Metadata"]["WARC-Target-URI"]'|cut -f 1 -d ':'|awk '{c[$1]+=1} END {for (k in c) {print k, c[k]}}' echo "# $(date) < $ID.$1"