cc/cirrus_work: revision graph

graph

less more | rev 144: (0) -120 tip

refactor to enable rerun with fixup,
Mon, 02 Oct 2023 18:56:50 +0100, by Henry S. Thompson
correct mistaken futnsz test,
Mon, 02 Oct 2023 18:55:48 +0100, by Henry S. Thompson
change path to merge_date.py
Mon, 02 Oct 2023 18:54:10 +0100, by Henry S. Thompson
remove the mistaken deletion of NONPRINT,
Mon, 02 Oct 2023 18:52:43 +0100, by Henry S. Thompson
fix a bad fix and a bad test for the televida case
Sat, 30 Sep 2023 18:04:15 +0100, by Henry S. Thompson
fix and test for all-decimal host
Sat, 30 Sep 2023 14:13:19 +0100, by Henry S. Thompson
no import in lmh.__init__ any more
Sat, 30 Sep 2023 14:12:39 +0100, by Henry S. Thompson
importing in __init__ causes problems
Sat, 30 Sep 2023 14:11:49 +0100, by Henry S. Thompson
commented out duplicate, handle comments better
Fri, 29 Sep 2023 15:59:34 +0100, by Henry S. Thompson
more corner case tests
Fri, 29 Sep 2023 15:14:29 +0100, by Henry S. Thompson
tweaks to get all tests through #14
Fri, 29 Sep 2023 15:13:51 +0100, by Henry S. Thompson
get 7f (two cases) and %25 working
Thu, 28 Sep 2023 18:31:23 +0100, by Henry S. Thompson
add televida case test
Thu, 28 Sep 2023 18:30:48 +0100, by Henry S. Thompson
add test description
Thu, 28 Sep 2023 16:36:15 +0100, by Henry S. Thompson
importable just in case
Thu, 28 Sep 2023 16:35:39 +0100, by Henry S. Thompson
move most of the hacking into fixGoogleCanon,
Thu, 28 Sep 2023 16:34:49 +0100, by Henry S. Thompson
forget assert, allow multiple failures
Thu, 28 Sep 2023 16:10:05 +0100, by Henry S. Thompson
x
Thu, 28 Sep 2023 16:09:38 +0100, by Henry S. Thompson
found right place for \x7f hack, maybe
Thu, 28 Sep 2023 14:08:36 +0100, by Henry S. Thompson
readability
Thu, 28 Sep 2023 14:06:11 +0100, by Henry S. Thompson
x
Thu, 28 Sep 2023 11:00:36 +0100, by Henry S. Thompson
refactor to sort a module in an lmh package
Thu, 28 Sep 2023 11:00:24 +0100, by Henry S. Thompson
start some regression tests
Thu, 28 Sep 2023 10:54:12 +0100, by Henry S. Thompson
creating lmh package
Thu, 28 Sep 2023 09:01:18 +0100, by Henry S. Thompson
moved from bin
Thu, 28 Sep 2023 08:46:01 +0100, by Henry S. Thompson
minor bug wrt EOF of final cdx input file
Wed, 27 Sep 2023 17:29:51 +0100, by Henry S. Thompson
replicate two extremely-corner cases of the way
Wed, 27 Sep 2023 17:29:09 +0100, by Henry S. Thompson
a bit more logging
Tue, 26 Sep 2023 18:55:43 +0100, by Henry S. Thompson
a bit more logging
Tue, 26 Sep 2023 18:55:11 +0100, by Henry S. Thompson
robotstxt and crawldiagnostics get free ride,
Tue, 26 Sep 2023 17:42:57 +0100, by Henry S. Thompson
a few more from ecclerig,
Tue, 26 Sep 2023 14:18:40 +0100, by Henry S. Thompson
refactor datestream reading,
Tue, 26 Sep 2023 09:03:47 +0100, by Henry S. Thompson
more faithful regexps and non-byte uri output
Mon, 25 Sep 2023 23:53:13 +0100, by Henry S. Thompson
one uncommited fix from quentin
Fri, 22 Sep 2023 15:27:28 +0100, by Henry S. Thompson
pass in debug flag(s) to merge_date.py
Tue, 19 Sep 2023 19:40:58 +0100, by Henry Thompson
loosen must-match criterion in the both-messy case
Tue, 19 Sep 2023 19:29:41 +0100, by Henry Thompson
one more sid fix,
Tue, 19 Sep 2023 19:28:34 +0100, by Henry Thompson
working on sessionID pblms, still
Sun, 17 Sep 2023 15:18:11 +0100, by Henry S. Thompson
first try
Thu, 14 Sep 2023 19:27:23 +0100, by Henry Thompson
switch to gzip -7 to get comparable compressed cdx block size
Wed, 13 Sep 2023 16:48:43 +0100, by Henry S. Thompson
use my own Canonicalizer to fix more obscure
Wed, 13 Sep 2023 12:41:55 +0100, by Henry S. Thompson
re-instate logging splits for .idx
Wed, 13 Sep 2023 12:40:39 +0100, by Henry S. Thompson
reinstate better check to start queuing,
Tue, 12 Sep 2023 12:14:04 +0100, by Henry S. Thompson
bug4 fixed, but that created a new, earlier bug
Mon, 11 Sep 2023 22:06:45 +0100, by Henry S. Thompson
rework handling of session key problem
Mon, 11 Sep 2023 12:56:47 +0100, by Henry S. Thompson
initialise paths for csing
Fri, 08 Sep 2023 21:40:52 +0100, by Henry S. Thompson
d'oh
Fri, 08 Sep 2023 21:40:06 +0100, by Henry S. Thompson
include full URI in output
Fri, 08 Sep 2023 18:06:54 +0100, by Henry S. Thompson
try to do csing correctly on compute nodes
Fri, 08 Sep 2023 18:05:57 +0100, by Henry S. Thompson
version which outputs more identification,
Fri, 08 Sep 2023 09:29:25 +0100, by Henry S. Thompson
last version before giving up on approach based only on key and datestamp
Thu, 07 Sep 2023 18:03:55 +0100, by Henry S. Thompson
improve reordering, still failing on cdx-00004
Wed, 06 Sep 2023 18:51:21 +0100, by Henry S. Thompson
attempt at reordering if necessary
Tue, 05 Sep 2023 17:33:29 +0100, by Henry S. Thompson
mostly working, but need to reorder in case of cfid and friends
Tue, 05 Sep 2023 17:32:46 +0100, by Henry S. Thompson
flip loops
Thu, 31 Aug 2023 14:14:21 +0100, by Henry S. Thompson
merge a stream of ks files with a set of cdx files
Wed, 30 Aug 2023 21:49:43 +0100, by Henry S. Thompson
final keystroke fixes, recurse and decimal www stripping
Wed, 30 Aug 2023 11:11:31 +0100, by Henry S. Thompson
final keystroke fixes,
Wed, 30 Aug 2023 11:10:54 +0100, by Henry S. Thompson
handle double .www, more keep-me chars
Mon, 28 Aug 2023 21:07:43 +0100, by Henry S. Thompson
work-around for weird handling of %-encoding in Java impl. of SURT
Thu, 24 Aug 2023 18:21:41 +0100, by Henry S. Thompson
merge, including pointless fix wrt pq
Mon, 21 Aug 2023 13:06:20 -0400, by Henry Thompson
use surt instead of trying to create index term by hand
Sat, 19 Aug 2023 16:33:23 -0400, by Henry Thompson
merge
Sat, 19 Aug 2023 16:02:29 -0400, by Henry Thompson
stale
Sat, 19 Aug 2023 15:58:38 -0400, by Henry Thompson
catching up by hand with markup version,
Sat, 19 Aug 2023 15:53:59 -0400, by Henry Thompson
include timestamp
Mon, 21 Aug 2023 13:37:07 +0100, by Henry S. Thompson
include query
Sun, 20 Aug 2023 00:28:43 +0100, by Henry S. Thompson
make CC's own sorting explicit
Fri, 18 Aug 2023 18:25:54 +0100, by Henry S. Thompson
handle corner cases with final . and initial www..+
Thu, 10 Aug 2023 22:14:49 +0100, by Henry S. Thompson
handle %-encoded utf-8 as idna
Wed, 09 Aug 2023 02:01:32 +0100, by Henry S. Thompson
merge
Tue, 08 Aug 2023 17:48:29 +0100, by Henry S. Thompson
compute timestamps, key and sort lmh lines
Tue, 08 Aug 2023 17:47:27 +0100, by Henry S. Thompson
work with csing
Tue, 08 Aug 2023 17:46:20 +0100, by Henry S. Thompson
get man -k working
Tue, 08 Aug 2023 17:46:02 +0100, by Henry S. Thompson
for warc_lmh slurm logs
Fri, 28 Jul 2023 00:50:13 +0100, by Henry Thompson
for timing analysis
Wed, 26 Jul 2023 18:42:19 +0100, by Henry S. Thompson
add support for multiple calls to srun with a counter
Fri, 21 Jul 2023 11:37:47 +0100, by Henry S. Thompson
fix eof bug, expand error messages
Thu, 20 Jul 2023 10:32:55 +0100, by Henry S. Thompson
part 2 is now working for all types
Wed, 19 Jul 2023 13:20:46 +0100, by Henry S. Thompson
add a response-only test
Wed, 19 Jul 2023 13:19:58 +0100, by Henry S. Thompson
revert to just showing first LM
Wed, 19 Jul 2023 13:19:42 +0100, by Henry S. Thompson
more tests
Fri, 14 Jul 2023 17:39:14 +0100, by Henry S. Thompson
Test 2 works with parts=1,2,3.
Fri, 14 Jul 2023 17:38:54 +0100, by Henry S. Thompson
whole working
Fri, 14 Jul 2023 12:08:09 +0100, by Henry S. Thompson
tests 1 & 2 now working
Thu, 13 Jul 2023 14:02:02 +0100, by Henry S. Thompson
avoid slicing buf by using memoryview to save copying
Thu, 13 Jul 2023 11:28:24 +0100, by Henry S. Thompson
but skip at eobp is not working (with test 2)
Wed, 12 Jul 2023 19:07:56 +0100, by Henry S. Thompson
works with all types, part=1
Wed, 12 Jul 2023 18:48:27 +0100, by Henry S. Thompson
rework completely to refill as much as possible only when necessary,
Mon, 10 Jul 2023 19:52:18 +0100, by Henry S. Thompson
finds multiples
Mon, 10 Jul 2023 18:17:35 +0100, by Henry S. Thompson
little steps
Fri, 07 Jul 2023 19:30:23 +0100, by Henry S. Thompson
made 1 mean 1, still losing after a while
Fri, 07 Jul 2023 19:04:16 +0100, by Henry S. Thompson
better debugging output
Fri, 07 Jul 2023 17:04:05 +0100, by Henry S. Thompson
working better, gets confused by 3-part response
Fri, 07 Jul 2023 17:03:52 +0100, by Henry S. Thompson
a bit better
Fri, 07 Jul 2023 13:39:23 +0100, by Henry S. Thompson
just barely working for 1, need to rethink buffering
Thu, 06 Jul 2023 14:53:28 +0100, by Henry S. Thompson
starting on conversion to direct-querying of buffer
Thu, 06 Jul 2023 13:27:33 +0100, by Henry S. Thompson
sic
Thu, 06 Jul 2023 10:19:02 +0100, by Henry S. Thompson
support on-board unzipping, reduce buffer size to 2MB
Wed, 05 Jul 2023 19:32:36 +0100, by Henry S. Thompson
make test 1 idempotent
Wed, 05 Jul 2023 19:32:02 +0100, by Henry S. Thompson
just count part length
Wed, 05 Jul 2023 17:51:44 +0100, by Henry S. Thompson
get EOF right, finally
Wed, 05 Jul 2023 17:49:24 +0100, by Henry S. Thompson
make warc.py a library, separate out testing
Wed, 05 Jul 2023 15:37:16 +0100, by Henry S. Thompson
correct comment
Wed, 05 Jul 2023 15:12:54 +0100, by Henry S. Thompson
add lots more debugging output,
Wed, 05 Jul 2023 15:12:07 +0100, by Henry S. Thompson
moved from home bin
Wed, 05 Jul 2023 15:09:57 +0100, by Henry S. Thompson
doc pointer
Tue, 10 Jan 2023 17:49:01 +0000, by Henry S. Thompson
push actions in main fn
Tue, 13 Dec 2022 14:16:42 +0000, by Henry S. Thompson
fixed for paper
Tue, 13 Dec 2022 14:16:22 +0000, by Henry S. Thompson
fix N
Thu, 24 Nov 2022 12:37:17 +0000, by Henry S. Thompson
compute and graph confidence intervals
Wed, 23 Nov 2022 11:05:45 +0000, by Henry S. Thompson
generalise hist
Tue, 22 Nov 2022 19:13:25 +0000, by Henry S. Thompson
add sort flag to plot_x
Tue, 22 Nov 2022 11:02:51 +0000, by Henry S. Thompson
get multi-ranking done right
Thu, 17 Nov 2022 13:51:19 +0000, by Henry S. Thompson
comments and more care about rows vs. columns
Thu, 17 Nov 2022 11:27:07 +0000, by Henry S. Thompson
start work on ranking,
Wed, 16 Nov 2022 19:52:50 +0000, by Henry S. Thompson
Spearman for matlab
Wed, 16 Nov 2022 17:29:55 +0000, by Henry S. Thompson
move all plots into functions
Wed, 16 Nov 2022 17:28:56 +0000, by Henry S. Thompson
a bit more
Tue, 15 Nov 2022 19:37:28 +0000, by Henry S. Thompson
framework for stats over results of rank correlations
Mon, 14 Nov 2022 18:52:35 +0000, by Henry S. Thompson

less more | rev 144: (0) -120 tip

Mercurial > hg > cc > cirrus_work

graph