| Tue, 30 Jun 2026 16:50:56 +0100 |
Henry S. Thompson |
added test 9 for wat that pretty-prints json content
plus tip
|
| Tue, 30 Jun 2026 15:40:40 +0100 |
Henry S. Thompson |
sic
plus
|
| Tue, 30 Jun 2026 15:40:08 +0100 |
Henry S. Thompson |
tweak usage
plus
|
| Mon, 22 Jun 2026 17:39:07 +0100 |
Henry S. Thompson |
forget utf-8
plus
|
| Mon, 22 Jun 2026 16:00:02 +0100 |
Henry S. Thompson |
part 4 == body for RESP working
plus
|
| Mon, 22 Jun 2026 15:58:51 +0100 |
Henry S. Thompson |
sic
plus
|
| Mon, 22 Jun 2026 12:33:52 +0100 |
Henry S. Thompson |
sic
plus
|
| Mon, 22 Jun 2026 12:33:40 +0100 |
Henry S. Thompson |
implement part with 4-bit set
plus
|
| Sat, 20 Jun 2026 16:39:46 +0100 |
Henry S. Thompson |
use USER in tmpfile creation,
plus
|
| Sat, 20 Jun 2026 15:03:12 +0100 |
Henry S. Thompson |
remove debug print
plus
|
| Sat, 20 Jun 2026 14:58:59 +0100 |
Henry S. Thompson |
tweak some arg doc strings, give NotImpl warning for -m
plus
|
| Mon, 15 Jun 2026 23:31:47 +0100 |
Henry S. Thompson |
working for ex4a
plus
|
| Fri, 12 Jun 2026 16:14:55 +0100 |
Henry S. Thompson |
output format now more congenial for subsequent merging
plus
|
| Thu, 11 Jun 2026 21:26:09 +0100 |
Henry S. Thompson |
version of warc.py which uses igzip, therefore doesn't support the block position in the callback result
plus
|
| Thu, 11 Jun 2026 21:23:19 +0100 |
Henry S. Thompson |
for 2026 MSc
plus
|
| Thu, 11 Jun 2026 21:13:15 +0100 |
Henry S. Thompson |
remove debugging breakpoint
plus
|
| Thu, 11 Jun 2026 21:11:15 +0100 |
Henry S. Thompson |
remove spurious f in cdb name
plus
|
| Thu, 11 Jun 2026 21:10:13 +0100 |
Henry S. Thompson |
works now
plus
|
| Thu, 11 Jun 2026 21:09:38 +0100 |
Henry S. Thompson |
color ls
plus
|
| Wed, 10 Jun 2026 19:07:01 +0100 |
Henry S. Thompson |
prep for exercise 4
plus
|
| Wed, 22 Apr 2026 18:47:51 +0100 |
Henry S. Thompson |
get new shrink_key working with warc2cdb and vv
plus
|
| Wed, 22 Apr 2026 15:09:30 +0100 |
Henry S. Thompson |
now linked from $CCC,
plus
|
| Tue, 21 Apr 2026 09:28:47 +0100 |
Henry S. Thompson |
add -d flag
plus
|
| Mon, 20 Apr 2026 18:19:43 +0100 |
Henry S. Thompson |
more record types
plus
|
| Mon, 20 Apr 2026 18:19:17 +0100 |
Henry S. Thompson |
bigger buffer to accommodate new bigger max size
plus
|
| Mon, 20 Apr 2026 18:18:32 +0100 |
Henry S. Thompson |
use $CCC
plus
|
| Mon, 20 Apr 2026 18:18:11 +0100 |
Henry S. Thompson |
-a working now?
plus
|
| Fri, 10 Apr 2026 16:02:09 +0100 |
Henry S. Thompson |
fix file type coding bug
plus
|
| Fri, 10 Apr 2026 16:01:33 +0100 |
Henry S. Thompson |
remove debug prints
plus
|
| Fri, 10 Apr 2026 16:00:51 +0100 |
Henry S. Thompson |
minor fixes to accommodate change in numbering
plus
|
| Wed, 08 Apr 2026 13:51:00 +0100 |
Henry S. Thompson |
got the full chain running
plus
|
| Tue, 07 Apr 2026 23:03:15 +0100 |
Henry S. Thompson |
new shrunk cdb en- and de-coding just barely working
plus
|
| Tue, 07 Apr 2026 15:04:09 +0100 |
Henry S. Thompson |
working on new shrunk cdb en- and de-coding
plus
|
| Thu, 26 Mar 2026 17:27:53 +0000 |
Henry S. Thompson |
maybe got -m working using --array
plus
|
| Thu, 19 Mar 2026 17:23:33 +0000 |
Henry S. Thompson |
handle missed negative case
plus
|
| Thu, 19 Mar 2026 17:21:51 +0000 |
Henry S. Thompson |
remove unused imports and declarations,
plus
|
| Thu, 19 Mar 2026 17:17:02 +0000 |
Henry S. Thompson |
cython not used (?), fix Q type
plus
|
| Mon, 16 Mar 2026 19:07:10 +0000 |
Henry S. Thompson |
towards new fixed-length key and safer mapping of oob values
plus
|
| Mon, 16 Mar 2026 19:06:17 +0000 |
Henry S. Thompson |
_out no longer used
plus
|
| Mon, 16 Mar 2026 13:18:51 +0000 |
Henry S. Thompson |
simple test of block ranges appears to work
plus
|
| Mon, 16 Mar 2026 12:25:29 +0000 |
Henry S. Thompson |
enable block offset recording with -b
plus
|
| Mon, 16 Mar 2026 12:25:00 +0000 |
Henry S. Thompson |
cython flags
plus
|
| Mon, 16 Mar 2026 10:43:45 +0000 |
Henry S. Thompson |
use gzip_plus to get access to gzip block offsets
plus
|
| Mon, 16 Mar 2026 10:43:01 +0000 |
Henry S. Thompson |
give access to block offsets via callback
trim
|
| Thu, 12 Mar 2026 18:28:27 +0000 |
Henry S. Thompson |
back to igzip
trim
|
| Thu, 12 Mar 2026 18:20:01 +0000 |
Henry S. Thompson |
switch to plain GzipFile for comparison purposes,
trim
|
| Thu, 12 Mar 2026 18:08:54 +0000 |
Henry S. Thompson |
from python3.13 with block boundary tracking added by HST
trim
|
| Wed, 11 Mar 2026 18:42:21 +0000 |
Henry S. Thompson |
Now using isal_zlib.decompressobj
trim
|
| Wed, 11 Mar 2026 18:20:05 +0000 |
Henry S. Thompson |
rework test output to read better
trim
|
| Wed, 11 Mar 2026 18:09:01 +0000 |
Henry S. Thompson |
trivial
trim
|
| Wed, 11 Mar 2026 18:07:41 +0000 |
Henry S. Thompson |
fixed last-buffer bug
trim
|
| Wed, 11 Mar 2026 16:08:35 +0000 |
Henry S. Thompson |
refactor slightly, read whole warc file as test, seems to be working, still using zlib.decompressobj
trim
|
| Wed, 11 Mar 2026 13:24:48 +0000 |
Henry S. Thompson |
decompOneBlock working with gzip
trim
|
| Tue, 10 Mar 2026 21:18:10 +0000 |
Henry S. Thompson |
process exactly one block at a time, maybe?
trim
|
| Tue, 10 Mar 2026 21:17:17 +0000 |
Henry S. Thompson |
update ROOT, fix deprecated patterns
trim
|
| Wed, 04 Mar 2026 21:14:15 +0000 |
Henry S. Thompson |
merge
trim
|
| Wed, 04 Mar 2026 21:11:38 +0000 |
Henry S. Thompson |
use WARC.REQ for URI for crawldiagnostics too
trim
|
| Tue, 03 Mar 2026 14:25:09 +0000 |
Henry S. Thompson |
with graphs, various additions including no_LM column
trim
|
| Tue, 03 Mar 2026 14:24:02 +0000 |
Henry S. Thompson |
as corrected by hand in excel
trim
|
| Tue, 03 Mar 2026 14:23:27 +0000 |
Henry S. Thompson |
script output
trim
|