Mercurial > hg > cc > cirrus_work

log

Find changesets by keywords (author, files, the commit message), revision number or hash, or revset expression.
less more | rev 396: (0) -120 tip
age author description
Tue, 30 Jun 2026 16:50:56 +0100 Henry S. Thompson added test 9 for wat that pretty-prints json content plus tip
Tue, 30 Jun 2026 15:40:40 +0100 Henry S. Thompson sic plus
Tue, 30 Jun 2026 15:40:08 +0100 Henry S. Thompson tweak usage plus
Mon, 22 Jun 2026 17:39:07 +0100 Henry S. Thompson forget utf-8 plus
Mon, 22 Jun 2026 16:00:02 +0100 Henry S. Thompson part 4 == body for RESP working plus
Mon, 22 Jun 2026 15:58:51 +0100 Henry S. Thompson sic plus
Mon, 22 Jun 2026 12:33:52 +0100 Henry S. Thompson sic plus
Mon, 22 Jun 2026 12:33:40 +0100 Henry S. Thompson implement part with 4-bit set plus
Sat, 20 Jun 2026 16:39:46 +0100 Henry S. Thompson use USER in tmpfile creation, plus
Sat, 20 Jun 2026 15:03:12 +0100 Henry S. Thompson remove debug print plus
Sat, 20 Jun 2026 14:58:59 +0100 Henry S. Thompson tweak some arg doc strings, give NotImpl warning for -m plus
Mon, 15 Jun 2026 23:31:47 +0100 Henry S. Thompson working for ex4a plus
Fri, 12 Jun 2026 16:14:55 +0100 Henry S. Thompson output format now more congenial for subsequent merging plus
Thu, 11 Jun 2026 21:26:09 +0100 Henry S. Thompson version of warc.py which uses igzip, therefore doesn't support the block position in the callback result plus
Thu, 11 Jun 2026 21:23:19 +0100 Henry S. Thompson for 2026 MSc plus
Thu, 11 Jun 2026 21:13:15 +0100 Henry S. Thompson remove debugging breakpoint plus
Thu, 11 Jun 2026 21:11:15 +0100 Henry S. Thompson remove spurious f in cdb name plus
Thu, 11 Jun 2026 21:10:13 +0100 Henry S. Thompson works now plus
Thu, 11 Jun 2026 21:09:38 +0100 Henry S. Thompson color ls plus
Wed, 10 Jun 2026 19:07:01 +0100 Henry S. Thompson prep for exercise 4 plus
Wed, 22 Apr 2026 18:47:51 +0100 Henry S. Thompson get new shrink_key working with warc2cdb and vv plus
Wed, 22 Apr 2026 15:09:30 +0100 Henry S. Thompson now linked from $CCC, plus
Tue, 21 Apr 2026 09:28:47 +0100 Henry S. Thompson add -d flag plus
Mon, 20 Apr 2026 18:19:43 +0100 Henry S. Thompson more record types plus
Mon, 20 Apr 2026 18:19:17 +0100 Henry S. Thompson bigger buffer to accommodate new bigger max size plus
Mon, 20 Apr 2026 18:18:32 +0100 Henry S. Thompson use $CCC plus
Mon, 20 Apr 2026 18:18:11 +0100 Henry S. Thompson -a working now? plus
Fri, 10 Apr 2026 16:02:09 +0100 Henry S. Thompson fix file type coding bug plus
Fri, 10 Apr 2026 16:01:33 +0100 Henry S. Thompson remove debug prints plus
Fri, 10 Apr 2026 16:00:51 +0100 Henry S. Thompson minor fixes to accommodate change in numbering plus
Wed, 08 Apr 2026 13:51:00 +0100 Henry S. Thompson got the full chain running plus
Tue, 07 Apr 2026 23:03:15 +0100 Henry S. Thompson new shrunk cdb en- and de-coding just barely working plus
Tue, 07 Apr 2026 15:04:09 +0100 Henry S. Thompson working on new shrunk cdb en- and de-coding plus
Thu, 26 Mar 2026 17:27:53 +0000 Henry S. Thompson maybe got -m working using --array plus
Thu, 19 Mar 2026 17:23:33 +0000 Henry S. Thompson handle missed negative case plus
Thu, 19 Mar 2026 17:21:51 +0000 Henry S. Thompson remove unused imports and declarations, plus
Thu, 19 Mar 2026 17:17:02 +0000 Henry S. Thompson cython not used (?), fix Q type plus
Mon, 16 Mar 2026 19:07:10 +0000 Henry S. Thompson towards new fixed-length key and safer mapping of oob values plus
Mon, 16 Mar 2026 19:06:17 +0000 Henry S. Thompson _out no longer used plus
Mon, 16 Mar 2026 13:18:51 +0000 Henry S. Thompson simple test of block ranges appears to work plus
Mon, 16 Mar 2026 12:25:29 +0000 Henry S. Thompson enable block offset recording with -b plus
Mon, 16 Mar 2026 12:25:00 +0000 Henry S. Thompson cython flags plus
Mon, 16 Mar 2026 10:43:45 +0000 Henry S. Thompson use gzip_plus to get access to gzip block offsets plus
Mon, 16 Mar 2026 10:43:01 +0000 Henry S. Thompson give access to block offsets via callback trim
Thu, 12 Mar 2026 18:28:27 +0000 Henry S. Thompson back to igzip trim
Thu, 12 Mar 2026 18:20:01 +0000 Henry S. Thompson switch to plain GzipFile for comparison purposes, trim
Thu, 12 Mar 2026 18:08:54 +0000 Henry S. Thompson from python3.13 with block boundary tracking added by HST trim
Wed, 11 Mar 2026 18:42:21 +0000 Henry S. Thompson Now using isal_zlib.decompressobj trim
Wed, 11 Mar 2026 18:20:05 +0000 Henry S. Thompson rework test output to read better trim
Wed, 11 Mar 2026 18:09:01 +0000 Henry S. Thompson trivial trim
Wed, 11 Mar 2026 18:07:41 +0000 Henry S. Thompson fixed last-buffer bug trim
Wed, 11 Mar 2026 16:08:35 +0000 Henry S. Thompson refactor slightly, read whole warc file as test, seems to be working, still using zlib.decompressobj trim
Wed, 11 Mar 2026 13:24:48 +0000 Henry S. Thompson decompOneBlock working with gzip trim
Tue, 10 Mar 2026 21:18:10 +0000 Henry S. Thompson process exactly one block at a time, maybe? trim
Tue, 10 Mar 2026 21:17:17 +0000 Henry S. Thompson update ROOT, fix deprecated patterns trim
Wed, 04 Mar 2026 21:14:15 +0000 Henry S. Thompson merge trim
Wed, 04 Mar 2026 21:11:38 +0000 Henry S. Thompson use WARC.REQ for URI for crawldiagnostics too trim
Tue, 03 Mar 2026 14:25:09 +0000 Henry S. Thompson with graphs, various additions including no_LM column trim
Tue, 03 Mar 2026 14:24:02 +0000 Henry S. Thompson as corrected by hand in excel trim
Tue, 03 Mar 2026 14:23:27 +0000 Henry S. Thompson script output trim
Mon, 02 Mar 2026 16:14:17 +0000 Henry S. Thompson normalise spacing trim
Mon, 02 Mar 2026 13:32:18 +0000 Henry S. Thompson sic trim
Sun, 01 Mar 2026 15:22:10 +0000 Henry S. Thompson do merge in python working trim
Sun, 01 Mar 2026 13:40:52 +0000 Henry S. Thompson begin rework to do merge in python trim
Sat, 28 Feb 2026 14:48:32 +0000 Henry S. Thompson not working yet trim
Wed, 28 Jan 2026 18:42:34 +0000 Henry S. Thompson don't add final blank line, need to be able to concat lots of outputs trim
Tue, 27 Jan 2026 17:31:27 +0000 Henry S. Thompson take WARC-Target-URI from Request trim
Tue, 27 Jan 2026 13:32:13 +0000 Henry S. Thompson comment-out debugging lines trim
Tue, 27 Jan 2026 13:29:50 +0000 Henry S. Thompson handle empty uri trim
Sat, 24 Jan 2026 12:01:43 +0000 Henry S. Thompson refined a bit trim
Fri, 23 Jan 2026 15:54:54 +0000 Henry S. Thompson use updated shrink_key.shrink_key to do date and lm trim
Fri, 23 Jan 2026 15:54:02 +0000 Henry S. Thompson separate date from date+lm itself trim
Fri, 23 Jan 2026 15:52:59 +0000 Henry S. Thompson cythonise a bit trim
Fri, 23 Jan 2026 15:50:15 +0000 Henry S. Thompson working on comparing miss key with miss url trim
Wed, 21 Jan 2026 19:22:08 +0000 Henry S. Thompson tabulate candidate entries filtered by seg range trim
Tue, 20 Jan 2026 19:52:50 +0000 Henry S. Thompson handle pipelined input trim
Tue, 20 Jan 2026 19:46:48 +0000 Henry S. Thompson centralise all need for new approach to cdb index shrinking in one place trim
Fri, 16 Jan 2026 17:12:33 +0000 Henry S. Thompson works trim
Tue, 13 Jan 2026 15:22:28 +0000 Henry S. Thompson for tracking progress (of w2c?) trim
Sun, 11 Jan 2026 15:07:05 +0000 Henry S. Thompson works with one shrunken .cdb, one test case trim
Fri, 09 Jan 2026 22:31:17 +0000 Henry S. Thompson shrink working, probably, can we recover the data from it? trim
Tue, 23 Dec 2025 20:08:26 +0000 Henry S. Thompson date-stamp OK, deal with OOB value, maybe trim
Tue, 23 Dec 2025 17:14:19 +0000 Henry S. Thompson date-stamp still wrong trim
Tue, 23 Dec 2025 16:59:32 +0000 Henry S. Thompson mostly working, date-stamp issue? trim
Mon, 22 Dec 2025 22:23:37 +0000 Henry S. Thompson CC has moved trim
Mon, 22 Dec 2025 22:19:54 +0000 Henry S. Thompson CC has moved trim
Mon, 22 Dec 2025 22:19:07 +0000 Henry S. Thompson include dbt.pyx trim
Mon, 22 Dec 2025 22:18:16 +0000 Henry S. Thompson to fix unshrunk 2023-40, not yet working trim
Wed, 21 May 2025 22:05:24 +0100 Henry S. Thompson double buffer size to deal with massive header cases trim
Sun, 18 May 2025 13:08:04 +0100 Henry S. Thompson replace xargs with an explicit serial loop plus wait trim
Sat, 17 May 2025 11:12:46 +0100 Henry S. Thompson get rm in loop in right place, ensure unique pipe names trim
Tue, 13 May 2025 14:44:15 +0100 Henry S. Thompson working trim
Tue, 13 May 2025 13:32:26 +0100 Henry S. Thompson fixed time-stamp fixup bugs trim
Tue, 13 May 2025 12:06:01 +0100 Henry S. Thompson sic trim
Tue, 13 May 2025 12:05:22 +0100 Henry S. Thompson adapt to new configuration trim
Tue, 13 May 2025 12:04:01 +0100 Henry S. Thompson works trim
Thu, 08 May 2025 19:00:26 +0100 Henry S. Thompson just starting trim
Tue, 06 May 2025 16:52:32 +0100 Henry S. Thompson try trimming various more-or-less constant bits of the key and value trim
Mon, 05 May 2025 20:57:46 +0100 Henry S. Thompson robotstxt now working? default
Mon, 05 May 2025 20:57:30 +0100 Henry S. Thompson add another digit or two (segment #) to key for r_t
Mon, 05 May 2025 20:39:16 +0100 Henry S. Thompson better font
Wed, 23 Apr 2025 11:03:48 +0100 Henry S. Thompson still hacking var bindings...
Tue, 22 Apr 2025 14:32:07 +0100 Henry S. Thompson job index arg to doit, slightly better diagnostic output
Fri, 18 Apr 2025 13:39:55 +0100 Henry S. Thompson extend, then fix, to get it working for crawldiagnostics warc files
Wed, 09 Apr 2025 20:42:29 +0100 Henry S. Thompson fix another long-tail bug
Wed, 09 Apr 2025 17:15:40 +0100 Henry S. Thompson accommodate to change to digits for record type,
Wed, 09 Apr 2025 12:57:50 +0100 Henry S. Thompson simple refill working?
Wed, 09 Apr 2025 11:15:14 +0100 Henry S. Thompson try simpler refill
Tue, 08 Apr 2025 16:06:33 +0100 Henry S. Thompson park that, try fixed large buffer and large-enough min to ensure we always have a whole record in view
Mon, 07 Apr 2025 16:34:31 +0100 Henry S. Thompson in the midst of trying to rethink the refill logic
Mon, 24 Mar 2025 14:30:32 +0000 Henry S. Thompson trying to recover from partial, not-ordered, run of segs 0--7
Sat, 08 Mar 2025 22:31:14 +0000 Henry S. Thompson fix GMT fix,
Fri, 07 Mar 2025 21:17:47 +0000 Henry S. Thompson try to do the whole thing in one go
Fri, 07 Mar 2025 18:15:41 +0000 Henry S. Thompson type decls, cythonize works
Fri, 07 Mar 2025 15:39:36 +0000 Henry S. Thompson type decls, cythonize works
Wed, 05 Mar 2025 23:29:25 +0000 Henry S. Thompson automate a cdb chain
Thu, 27 Feb 2025 18:23:31 +0000 Henry S. Thompson move final report to stderr
Thu, 27 Feb 2025 18:23:05 +0000 Henry S. Thompson work with cdb logging, not sure why it was necessary
Wed, 26 Feb 2025 19:52:22 +0000 Henry S. Thompson parameterise the range of cdbs and segments,
Wed, 19 Feb 2025 17:49:31 +0000 Henry S. Thompson push value printing into C,
less more | rev 396: (0) -120 tip