Mercurial > hg > cc > azure

comparison workers/bin/count1.sh @ 10:2fbefb8d1a9e

Find changesets by keywords (author, files, the commit message), revision number or hash, or revset expression.
wrun.sh: usage catchup invoke.sh: force terminal allocation on workers test1.sh: support control of number of worker processes are spawned, support -t to turn off random delay at startup count1.sh: actual do the counting in subprocs to avoid disk contention
author Henry S. Thompson <ht@markup.co.uk>
date Mon, 08 Oct 2018 13:17:23 +0000
parents 5db6015689a2
children 36b5d379909a
comparison
equal deleted inserted replaced
9:55e953e5c66f 10:2fbefb8d1a9e
1 #!/bin/bash 1 #!/bin/bash
2 echo "# $ID" 2 echo "# $ID"
3 jq '.Envelope|.["WARC-Header-Metadata"]["WARC-Target-URI"]'|cut -f 1 -d ':' 3 jq '.Envelope|.["WARC-Header-Metadata"]["WARC-Target-URI"]'|cut -f 1 -d ':'|awk '{c[$1]+=1} END {for (k in c) {print k, c[k]}}'
4 4
5 5
6 6
7 7