log

age author description
Thu, 12 Mar 2026 18:28:27 +0000 Henry S. Thompson back to igzip trim
Thu, 12 Mar 2026 18:20:01 +0000 Henry S. Thompson switch to plain GzipFile for comparison purposes, trim
Thu, 12 Mar 2026 18:08:54 +0000 Henry S. Thompson from python3.13 with block boundary tracking added by HST trim
Wed, 11 Mar 2026 18:42:21 +0000 Henry S. Thompson Now using isal_zlib.decompressobj trim
Wed, 11 Mar 2026 18:20:05 +0000 Henry S. Thompson rework test output to read better trim
Wed, 11 Mar 2026 18:09:01 +0000 Henry S. Thompson trivial trim
Wed, 11 Mar 2026 18:07:41 +0000 Henry S. Thompson fixed last-buffer bug trim
Wed, 11 Mar 2026 16:08:35 +0000 Henry S. Thompson refactor slightly, read whole warc file as test, seems to be working, still using zlib.decompressobj trim
Wed, 11 Mar 2026 13:24:48 +0000 Henry S. Thompson decompOneBlock working with gzip trim
Tue, 10 Mar 2026 21:18:10 +0000 Henry S. Thompson process exactly one block at a time, maybe? trim
Tue, 10 Mar 2026 21:17:17 +0000 Henry S. Thompson update ROOT, fix deprecated patterns trim
Wed, 04 Mar 2026 21:14:15 +0000 Henry S. Thompson merge trim
Wed, 04 Mar 2026 21:11:38 +0000 Henry S. Thompson use WARC.REQ for URI for crawldiagnostics too trim
Tue, 03 Mar 2026 14:25:09 +0000 Henry S. Thompson with graphs, various additions including no_LM column trim
Tue, 03 Mar 2026 14:24:02 +0000 Henry S. Thompson as corrected by hand in excel trim
Tue, 03 Mar 2026 14:23:27 +0000 Henry S. Thompson script output trim
Mon, 02 Mar 2026 16:14:17 +0000 Henry S. Thompson normalise spacing trim
Mon, 02 Mar 2026 13:32:18 +0000 Henry S. Thompson sic trim
Sun, 01 Mar 2026 15:22:10 +0000 Henry S. Thompson do merge in python working trim
Sun, 01 Mar 2026 13:40:52 +0000 Henry S. Thompson begin rework to do merge in python trim
Sat, 28 Feb 2026 14:48:32 +0000 Henry S. Thompson not working yet trim
Wed, 28 Jan 2026 18:42:34 +0000 Henry S. Thompson don't add final blank line, need to be able to concat lots of outputs trim
Tue, 27 Jan 2026 17:31:27 +0000 Henry S. Thompson take WARC-Target-URI from Request trim
Tue, 27 Jan 2026 13:32:13 +0000 Henry S. Thompson comment-out debugging lines trim
Tue, 27 Jan 2026 13:29:50 +0000 Henry S. Thompson handle empty uri trim
Sat, 24 Jan 2026 12:01:43 +0000 Henry S. Thompson refined a bit trim
Fri, 23 Jan 2026 15:54:54 +0000 Henry S. Thompson use updated shrink_key.shrink_key to do date and lm trim
Fri, 23 Jan 2026 15:54:02 +0000 Henry S. Thompson separate date from date+lm itself trim
Fri, 23 Jan 2026 15:52:59 +0000 Henry S. Thompson cythonise a bit trim
Fri, 23 Jan 2026 15:50:15 +0000 Henry S. Thompson working on comparing miss key with miss url trim