annotate workers/bin/count1.sh @ 43:c2b72d29a3ee

update to use _timedWhich.py
author Henry S. Thompson <ht@markup.co.uk>
date Fri, 30 Nov 2018 18:37:40 +0000
parents 36b5d379909a
children
Ignore whitespace changes - Everywhere: Within whitespace: At end of lines:
rev   line source
8
5db6015689a2 slightly updated, 4 W only, versions of old test4.sh and subcount.sh
Henry S. Thompson <ht@markup.co.uk>
parents:
diff changeset
1 #!/bin/bash
11
36b5d379909a a bit more info in logs
Henry S. Thompson <ht@markup.co.uk>
parents: 10
diff changeset
2 echo "# $(date) > $ID.$1"
10
2fbefb8d1a9e wrun.sh: usage catchup
Henry S. Thompson <ht@markup.co.uk>
parents: 8
diff changeset
3 jq '.Envelope|.["WARC-Header-Metadata"]["WARC-Target-URI"]'|cut -f 1 -d ':'|awk '{c[$1]+=1} END {for (k in c) {print k, c[k]}}'
11
36b5d379909a a bit more info in logs
Henry S. Thompson <ht@markup.co.uk>
parents: 10
diff changeset
4 echo "# $(date) < $ID.$1"
8
5db6015689a2 slightly updated, 4 W only, versions of old test4.sh and subcount.sh
Henry S. Thompson <ht@markup.co.uk>
parents:
diff changeset
5
5db6015689a2 slightly updated, 4 W only, versions of old test4.sh and subcount.sh
Henry S. Thompson <ht@markup.co.uk>
parents:
diff changeset
6
5db6015689a2 slightly updated, 4 W only, versions of old test4.sh and subcount.sh
Henry S. Thompson <ht@markup.co.uk>
parents:
diff changeset
7
5db6015689a2 slightly updated, 4 W only, versions of old test4.sh and subcount.sh
Henry S. Thompson <ht@markup.co.uk>
parents:
diff changeset
8