| Mon, 16 Mar 2026 12:25:00 +0000 |
Henry S. Thompson |
cython flags
plus
|
| Mon, 16 Mar 2026 10:43:45 +0000 |
Henry S. Thompson |
use gzip_plus to get access to gzip block offsets
plus
|
| Mon, 16 Mar 2026 10:43:01 +0000 |
Henry S. Thompson |
give access to block offsets via callback
trim
|
| Thu, 12 Mar 2026 18:28:27 +0000 |
Henry S. Thompson |
back to igzip
trim
|
| Thu, 12 Mar 2026 18:20:01 +0000 |
Henry S. Thompson |
switch to plain GzipFile for comparison purposes,
trim
|
| Thu, 12 Mar 2026 18:08:54 +0000 |
Henry S. Thompson |
from python3.13 with block boundary tracking added by HST
trim
|
| Wed, 11 Mar 2026 18:42:21 +0000 |
Henry S. Thompson |
Now using isal_zlib.decompressobj
trim
|
| Wed, 11 Mar 2026 18:20:05 +0000 |
Henry S. Thompson |
rework test output to read better
trim
|
| Wed, 11 Mar 2026 18:09:01 +0000 |
Henry S. Thompson |
trivial
trim
|
| Wed, 11 Mar 2026 18:07:41 +0000 |
Henry S. Thompson |
fixed last-buffer bug
trim
|
| Wed, 11 Mar 2026 16:08:35 +0000 |
Henry S. Thompson |
refactor slightly, read whole warc file as test, seems to be working, still using zlib.decompressobj
trim
|
| Wed, 11 Mar 2026 13:24:48 +0000 |
Henry S. Thompson |
decompOneBlock working with gzip
trim
|
| Tue, 10 Mar 2026 21:18:10 +0000 |
Henry S. Thompson |
process exactly one block at a time, maybe?
trim
|
| Tue, 10 Mar 2026 21:17:17 +0000 |
Henry S. Thompson |
update ROOT, fix deprecated patterns
trim
|
| Wed, 04 Mar 2026 21:14:15 +0000 |
Henry S. Thompson |
merge
trim
|
| Wed, 04 Mar 2026 21:11:38 +0000 |
Henry S. Thompson |
use WARC.REQ for URI for crawldiagnostics too
trim
|
| Tue, 03 Mar 2026 14:25:09 +0000 |
Henry S. Thompson |
with graphs, various additions including no_LM column
trim
|
| Tue, 03 Mar 2026 14:24:02 +0000 |
Henry S. Thompson |
as corrected by hand in excel
trim
|
| Tue, 03 Mar 2026 14:23:27 +0000 |
Henry S. Thompson |
script output
trim
|
| Mon, 02 Mar 2026 16:14:17 +0000 |
Henry S. Thompson |
normalise spacing
trim
|
| Mon, 02 Mar 2026 13:32:18 +0000 |
Henry S. Thompson |
sic
trim
|
| Sun, 01 Mar 2026 15:22:10 +0000 |
Henry S. Thompson |
do merge in python working
trim
|
| Sun, 01 Mar 2026 13:40:52 +0000 |
Henry S. Thompson |
begin rework to do merge in python
trim
|
| Sat, 28 Feb 2026 14:48:32 +0000 |
Henry S. Thompson |
not working yet
trim
|
| Wed, 28 Jan 2026 18:42:34 +0000 |
Henry S. Thompson |
don't add final blank line, need to be able to concat lots of outputs
trim
|
| Tue, 27 Jan 2026 17:31:27 +0000 |
Henry S. Thompson |
take WARC-Target-URI from Request
trim
|
| Tue, 27 Jan 2026 13:32:13 +0000 |
Henry S. Thompson |
comment-out debugging lines
trim
|
| Tue, 27 Jan 2026 13:29:50 +0000 |
Henry S. Thompson |
handle empty uri
trim
|
| Sat, 24 Jan 2026 12:01:43 +0000 |
Henry S. Thompson |
refined a bit
trim
|
| Fri, 23 Jan 2026 15:54:54 +0000 |
Henry S. Thompson |
use updated shrink_key.shrink_key to do date and lm
trim
|