Mercurial > hg > cc > work

comparison lurid3/notes.txt @ 78:45b45810aa12

Find changesets by keywords (author, files, the commit message), revision number or hash, or revset expression.
cleaned up/filled in after merge
author Henry Thompson <ht@markup.co.uk>
date Wed, 19 Mar 2025 14:42:41 -0400
parents e2e2865ed17d
children 0099d4269428
comparison
equal deleted inserted replaced
77:96c86b520214 78:45b45810aa12
1818 1818
1819 >: ls *.gz | parallel -j 10 "uz '{}' |fgrep .15/warc/CC-MAIN | cut -f 2,4 -d ' ' | sort > '/tmp/hst/15/orig_{#}.cdx'" 1819 >: ls *.gz | parallel -j 10 "uz '{}' |fgrep .15/warc/CC-MAIN | cut -f 2,4 -d ' ' | sort > '/tmp/hst/15/orig_{#}.cdx'"
1820 >: sort -m *.cdx | sponge all.cdx 1820 >: sort -m *.cdx | sponge all.cdx
1821 >: wc -l all.cdx 1821 >: wc -l all.cdx
1822 34742533 1822 34742533
1823 >: sed -E 's/^\+[0-9,]*:(.{14,14})/\1 "/;s/->[0-9]{10,10}$/",/' /tmp/hst/15/lmh.cdb_in | sort -k1,1 > test.cdb_in
1824
1823 Diff looks plausible, and a few known cases are correct now: 1825 Diff looks plausible, and a few known cases are correct now:
1824 >: fgrep -n '20230922034234 "https://www.hansaton.com/zh-hk/' test.cdb_in 1826 >: fgrep -n '20230922034234 "https://www.hansaton.com/zh-hk/' test.cdb_in
1825 4361:20230922034234 "https://www.hansaton.com/zh-hk/%E6%B6%88%E8%B2%BB%E8%80%85.html", 1827 4361:20230922034234 "https://www.hansaton.com/zh-hk/%E6%B6%88%E8%B2%BB%E8%80%85.html",
1826 >: fgrep -n '20230922034234 "https://www.hansaton.com/zh-hk/' all.cdx 1828 >: fgrep -n '20230922034234 "https://www.hansaton.com/zh-hk/' all.cdx
1827 27516:20230922034234 "https://www.hansaton.com/zh-hk/%E6%B6%88%E8%B2%BB%E8%80%85.html", 1829 27516:20230922034234 "https://www.hansaton.com/zh-hk/%E6%B6%88%E8%B2%BB%E8%80%85.html",