| Sun, 25 Jan 2026 21:45:14 +0000 |
Henry S. Thompson |
Probably \unnnn is the problem?
|
| Sun, 25 Jan 2026 21:31:08 +0000 |
Henry S. Thompson |
Maybe \unnnn is the problem?
|
| Sat, 24 Jan 2026 12:02:23 +0000 |
Henry S. Thompson |
still searching for missing lm hits in shrunk.cdb
|
| Thu, 22 Jan 2026 18:30:01 +0000 |
Henry S. Thompson |
simple key check fails to reproduce the error
|
| Wed, 21 Jan 2026 19:12:15 +0000 |
Henry S. Thompson |
still no agreement
|
| Wed, 21 Jan 2026 15:47:48 +0000 |
Henry S. Thompson |
still redoing
|
| Tue, 20 Jan 2026 19:50:40 +0000 |
Henry S. Thompson |
use shrink_key.shrink_date, now encorporating LM shrinkage, everywhere, including warc2cdb.py
|
| Mon, 19 Jan 2026 18:31:56 +0000 |
Henry S. Thompson |
but first...
|
| Mon, 19 Jan 2026 17:26:16 +0000 |
Henry S. Thompson |
talk myself through the problem
|
| Mon, 19 Jan 2026 12:06:54 +0000 |
Henry S. Thompson |
move date shrink to shrink.py
|
| Fri, 16 Jan 2026 13:34:15 +0000 |
Henry S. Thompson |
...
|
| Wed, 14 Jan 2026 14:06:30 +0000 |
Henry S. Thompson |
...
|
| Wed, 14 Jan 2026 10:55:11 +0000 |
Henry Thompson |
...
|
| Fri, 09 Jan 2026 18:01:19 +0000 |
Henry S. Thompson |
...
|
| Thu, 18 Dec 2025 14:45:59 +0000 |
Henry S. Thompson |
ByteIO ?
|
| Wed, 17 Dec 2025 15:23:33 +0000 |
Henry S. Thompson |
shrinking...
|
| Fri, 12 Dec 2025 21:50:10 +0000 |
Henry S. Thompson |
filled in
|
| Wed, 10 Dec 2025 19:15:14 +0000 |
Henry S. Thompson |
explore fixing lack of shrinkage in 2023-40
|
| Sat, 06 Dec 2025 18:28:21 +0000 |
Henry S. Thompson |
parquet example, _inter alia_
|
| Wed, 03 Dec 2025 19:16:13 +0000 |
Henry S. Thompson |
got min-max for 2024-33, updated/tidied status.xlsx to match dates.tsv
|
| Mon, 01 Dec 2025 17:15:01 +0000 |
Henry S. Thompson |
2025-33 index
|
| Wed, 05 Nov 2025 15:23:14 +0000 |
Henry S. Thompson |
minor
|
| Wed, 05 Nov 2025 15:21:19 +0000 |
Henry S. Thompson |
as submitted
|
| Wed, 05 Nov 2025 15:13:44 +0000 |
Henry S. Thompson |
as submitted
|
| Wed, 05 Nov 2025 12:03:27 +0000 |
Henry S. Thompson |
shrink to 2 pages
|
| Wed, 05 Nov 2025 11:47:42 +0000 |
Henry S. Thompson |
nearly ready
|
| Tue, 04 Nov 2025 11:26:21 +0000 |
Henry S. Thompson |
as submitted
|
| Tue, 04 Nov 2025 11:22:15 +0000 |
Henry S. Thompson |
moved
|
| Tue, 04 Nov 2025 11:16:15 +0000 |
Henry S. Thompson |
moved
|
| Wed, 21 May 2025 22:04:18 +0100 |
Henry S. Thompson |
repair broken cases, cdb_in for 2023-40/warc now complete, but not trimmed
|
| Mon, 19 May 2025 22:16:32 +0100 |
Henry S. Thompson |
2019-35 reindexing with c_d and r_t nearly done, just needs cluster.idx
|
| Tue, 13 May 2025 14:45:25 +0100 |
Henry Thompson |
cdb_chain working
|
| Fri, 09 May 2025 17:38:38 +0100 |
Henry S. Thompson |
x
|
| Fri, 02 May 2025 17:09:22 +0100 |
Henry S. Thompson |
begin actual cdb creation experiment on expanded data (including r_t, c_d) for 2019-35
|
| Fri, 02 May 2025 13:10:21 +0100 |
Henry S. Thompson |
shuffle a bit, plan
|
| Wed, 23 Apr 2025 18:23:35 +0100 |
Henry S. Thompson |
successful redo 2019-35 segs 0-9
|
| Wed, 23 Apr 2025 17:03:32 +0100 |
Henry S. Thompson |
trying to (re)do 2019-35 segs 0-9, having done robotstxt and crawldiagnostics
|
| Fri, 18 Apr 2025 19:18:52 +0100 |
Henry S. Thompson |
switch to robotstxt crawldiagnostics,
|
| Mon, 14 Apr 2025 15:22:32 +0100 |
Henry S. Thompson |
Confirmed new approach matches ks{,_errs} for the three cases we have: 0, 4 and 15
|
| Wed, 09 Apr 2025 21:53:55 +0100 |
Henry S. Thompson |
new simpler warc.py did a whole segment, divided in 5 equal parts
|
| Wed, 02 Apr 2025 16:48:27 +0100 |
Henry S. Thompson |
taking stock
|
| Mon, 31 Mar 2025 12:41:58 +0100 |
Henry S. Thompson |
x
|
| Tue, 25 Mar 2025 19:48:02 +0000 |
Henry S. Thompson |
2023-40 gap-filling wrt segments 0-2 and cross-validation
|
| Wed, 19 Mar 2025 21:48:44 -0400 |
Henry Thompson |
trying 15 down to 8 at a time
|
| Wed, 19 Mar 2025 14:42:41 -0400 |
Henry Thompson |
cleaned up/filled in after merge
|
| Wed, 19 Mar 2025 14:40:20 -0400 |
Henry Thompson |
?
|
| Wed, 19 Mar 2025 16:40:40 +0000 |
Henry S. Thompson |
merged
|
| Wed, 19 Mar 2025 16:27:26 +0000 |
Henry S. Thompson |
performance problems
|
| Mon, 10 Mar 2025 01:19:56 +0000 |
Henry Thompson |
cross-check wrt seg 15 of 2023-40
|
| Sun, 09 Mar 2025 19:59:50 +0000 |
Henry Thompson |
working on cross-check of warc2cdb
|
| Thu, 06 Mar 2025 01:45:24 +0000 |
Henry Thompson |
breakthrough wrt performance of chained cdb approach
|
| Wed, 26 Feb 2025 19:53:07 +0000 |
Henry S. Thompson |
can't seem to give up on cdb...
|
| Tue, 11 Feb 2025 17:10:31 +0000 |
Henry S. Thompson |
build _17_ .cdb files
|
| Tue, 11 Feb 2025 15:31:47 +0000 |
Henry S. Thompson |
notes.txt
|
| Mon, 10 Feb 2025 15:27:12 +0000 |
Henry S. Thompson |
build 16 .cdb
|
| Tue, 04 Feb 2025 12:50:52 +0000 |
Henry S. Thompson |
malloc
|
| Fri, 31 Jan 2025 13:26:07 +0000 |
Henry S. Thompson |
sequestration of cdb handle complete and working
|
| Fri, 24 Jan 2025 15:15:33 +0000 |
Henry S. Thompson |
baby steps with cdb
|
| Sat, 18 Jan 2025 21:33:00 +0000 |
Henry S. Thompson |
progress with cdb
|
| Mon, 06 Jan 2025 17:59:20 +0000 |
Henry S. Thompson |
comparing profiles w and w/o cython
|
