Mercurial > hg > cc > azure

view workers/bin/count1.sh @ 66:b04870ab3035

Find changesets by keywords (author, files, the commit message), revision number or hash, or revset expression.
don't over-count duplicate URIs in multiple properties, produce composite keys instead
author Henry S. Thompson <ht@markup.co.uk>
date Thu, 04 Jun 2020 16:10:55 +0000
parents 36b5d379909a
children
line wrap: on
line source

#!/bin/bash
echo "# $(date) > $ID.$1"
jq '.Envelope|.["WARC-Header-Metadata"]["WARC-Target-URI"]'|cut -f 1 -d ':'|awk '{c[$1]+=1} END {for (k in c) {print k, c[k]}}'
echo "# $(date) < $ID.$1"