Mercurial > hg > cc > work
log
| age | author | description |
|---|---|---|
| Fri, 03 Apr 2026 22:44:57 +0100 | Henry S. Thompson | done processing crawldiagnostics and robotstxt for 2023-40 |
| Thu, 02 Apr 2026 21:36:55 +0100 | Henry S. Thompson | complete satisfactory uniqueness check on 2023-40/warc new cdb_in format |
| Sat, 28 Mar 2026 21:39:32 +0000 | Henry S. Thompson | 2023-40 w2c.py done for all 10 deciles, needs dup testing |
| Fri, 27 Mar 2026 12:36:06 +0000 | Henry S. Thompson | abandoned --array again |
| Mon, 16 Mar 2026 13:50:31 +0000 | Henry S. Thompson | noting block offsets while scanning warc files now working in gzip_plus/warc/test_warc |
| Thu, 12 Mar 2026 18:10:13 +0000 | Henry S. Thompson | progress wrt block boundary logging |
| Wed, 11 Mar 2026 18:49:57 +0000 | Henry S. Thompson | towards using file+offset as cdb key |