log

age author description
Mon, 06 Apr 2026 23:10:22 +0100 Henry S. Thompson figure out the right number and sizes for the full
Mon, 06 Apr 2026 16:22:50 +0100 Henry S. Thompson add in the 2-bit file type info,
Sat, 04 Apr 2026 21:22:57 +0100 Henry S. Thompson found a new duplicate problem, diagnosed it
Fri, 03 Apr 2026 22:44:57 +0100 Henry S. Thompson done processing crawldiagnostics and robotstxt for 2023-40
Thu, 02 Apr 2026 21:36:55 +0100 Henry S. Thompson complete satisfactory uniqueness check on 2023-40/warc new cdb_in format
Sat, 28 Mar 2026 21:39:32 +0000 Henry S. Thompson 2023-40 w2c.py done for all 10 deciles, needs dup testing
Fri, 27 Mar 2026 12:36:06 +0000 Henry S. Thompson abandoned --array again