Mercurial > hg > cc > work
graph
-
noting block offsets while scanning warc files now working in gzip_plus/warc/test_warcMon, 16 Mar 2026 13:50:31 +0000, by Henry S. Thompson
-
progress wrt block boundary loggingThu, 12 Mar 2026 18:10:13 +0000, by Henry S. Thompson
-
towards using file+offset as cdb keyWed, 11 Mar 2026 18:49:57 +0000, by Henry S. Thompson
-
...Fri, 06 Mar 2026 14:42:05 +0000, by Henry S. Thompson
-
glitch in crawldiagnostics...Thu, 05 Mar 2026 18:23:31 +0000, by Henry S. Thompson
-
cd and rt warc2cdb.py done for 2023-40Wed, 04 Mar 2026 21:10:37 +0000, by Henry S. Thompson
-
got all 2019-35 statuses-by-yearMon, 02 Mar 2026 22:49:21 +0000, by Henry S. Thompson
-
complete stats for status code from 2019-35Mon, 02 Mar 2026 10:55:33 +0000, by Henry S. Thompson
-
brief excursion to look at status codes by yearFri, 27 Feb 2026 20:44:17 +0000, by Henry S. Thompson
-
new grouped date-shrinking working betterThu, 05 Feb 2026 14:53:35 +0000, by Henry S. Thompson
-
minor glitch w. warc2cdb.py,Wed, 28 Jan 2026 18:35:47 +0000, by Henry S. Thompson
-
w2c.py now looks good, running all of 2023-40Wed, 28 Jan 2026 12:26:10 +0000, by Henry S. Thompson
-
reran w2c.py and cdb_one on x0/24Tue, 27 Jan 2026 19:15:03 +0000, by Henry S. Thompson
-
found the 'bug', fixed in warc2cdb.pyTue, 27 Jan 2026 17:32:08 +0000, by Henry S. Thompson
-
got it!Mon, 26 Jan 2026 12:51:56 +0000, by Henry S. Thompson
-
Probably \unnnn is the problem?Sun, 25 Jan 2026 21:45:14 +0000, by Henry S. Thompson
-
Maybe \unnnn is the problem?Sun, 25 Jan 2026 21:31:08 +0000, by Henry S. Thompson
-
still searching for missing lm hits in shrunk.cdbSat, 24 Jan 2026 12:02:23 +0000, by Henry S. Thompson
-
simple key check fails to reproduce the errorThu, 22 Jan 2026 18:30:01 +0000, by Henry S. Thompson
-
still no agreementWed, 21 Jan 2026 19:12:15 +0000, by Henry S. Thompson
-
still redoingWed, 21 Jan 2026 15:47:48 +0000, by Henry S. Thompson
-
use shrink_key.shrink_date, now encorporating LM shrinkage, everywhere, including warc2cdb.pyTue, 20 Jan 2026 19:50:40 +0000, by Henry S. Thompson
-
but first...Mon, 19 Jan 2026 18:31:56 +0000, by Henry S. Thompson
-
talk myself through the problemMon, 19 Jan 2026 17:26:16 +0000, by Henry S. Thompson
-
move date shrink to shrink.pyMon, 19 Jan 2026 12:06:54 +0000, by Henry S. Thompson
-
...Fri, 16 Jan 2026 13:34:15 +0000, by Henry S. Thompson
-
...Wed, 14 Jan 2026 14:06:30 +0000, by Henry S. Thompson
-
...Wed, 14 Jan 2026 10:55:11 +0000, by Henry Thompson
-
...Fri, 09 Jan 2026 18:01:19 +0000, by Henry S. Thompson
-
ByteIO ?Thu, 18 Dec 2025 14:45:59 +0000, by Henry S. Thompson
-
shrinking...Wed, 17 Dec 2025 15:23:33 +0000, by Henry S. Thompson
-
filled inFri, 12 Dec 2025 21:50:10 +0000, by Henry S. Thompson
-
explore fixing lack of shrinkage in 2023-40Wed, 10 Dec 2025 19:15:14 +0000, by Henry S. Thompson
-
parquet example, _inter alia_Sat, 06 Dec 2025 18:28:21 +0000, by Henry S. Thompson
-
got min-max for 2024-33, updated/tidied status.xlsx to match dates.tsvWed, 03 Dec 2025 19:16:13 +0000, by Henry S. Thompson
-
2025-33 indexMon, 01 Dec 2025 17:15:01 +0000, by Henry S. Thompson
-
minorWed, 05 Nov 2025 15:23:14 +0000, by Henry S. Thompson
-
as submittedWed, 05 Nov 2025 15:21:19 +0000, by Henry S. Thompson
-
as submittedWed, 05 Nov 2025 15:13:44 +0000, by Henry S. Thompson
-
shrink to 2 pagesWed, 05 Nov 2025 12:03:27 +0000, by Henry S. Thompson
-
nearly readyWed, 05 Nov 2025 11:47:42 +0000, by Henry S. Thompson
-
as submittedTue, 04 Nov 2025 11:26:21 +0000, by Henry S. Thompson
-
movedTue, 04 Nov 2025 11:22:15 +0000, by Henry S. Thompson
-
movedTue, 04 Nov 2025 11:16:15 +0000, by Henry S. Thompson
-
repair broken cases, cdb_in for 2023-40/warc now complete, but not trimmedWed, 21 May 2025 22:04:18 +0100, by Henry S. Thompson
-
2019-35 reindexing with c_d and r_t nearly done, just needs cluster.idxMon, 19 May 2025 22:16:32 +0100, by Henry S. Thompson
-
cdb_chain workingTue, 13 May 2025 14:45:25 +0100, by Henry Thompson
-
xFri, 09 May 2025 17:38:38 +0100, by Henry S. Thompson
-
begin actual cdb creation experiment on expanded data (including r_t, c_d) for 2019-35Fri, 02 May 2025 17:09:22 +0100, by Henry S. Thompson
-
shuffle a bit, planFri, 02 May 2025 13:10:21 +0100, by Henry S. Thompson
-
successful redo 2019-35 segs 0-9Wed, 23 Apr 2025 18:23:35 +0100, by Henry S. Thompson
-
trying to (re)do 2019-35 segs 0-9, having done robotstxt and crawldiagnosticsWed, 23 Apr 2025 17:03:32 +0100, by Henry S. Thompson
-
switch to robotstxt crawldiagnostics,Fri, 18 Apr 2025 19:18:52 +0100, by Henry S. Thompson
-
Confirmed new approach matches ks{,_errs} for the three cases we have: 0, 4 and 15Mon, 14 Apr 2025 15:22:32 +0100, by Henry S. Thompson
-
new simpler warc.py did a whole segment, divided in 5 equal partsWed, 09 Apr 2025 21:53:55 +0100, by Henry S. Thompson
-
taking stockWed, 02 Apr 2025 16:48:27 +0100, by Henry S. Thompson
-
xMon, 31 Mar 2025 12:41:58 +0100, by Henry S. Thompson
-
2023-40 gap-filling wrt segments 0-2 and cross-validationTue, 25 Mar 2025 19:48:02 +0000, by Henry S. Thompson
-
trying 15 down to 8 at a timeWed, 19 Mar 2025 21:48:44 -0400, by Henry Thompson
-
cleaned up/filled in after mergeWed, 19 Mar 2025 14:42:41 -0400, by Henry Thompson