cc/cirrus_work: revision graph

graph

less more | rev 214: (0) -120 tip

csing-related tweaks
Thu, 15 Feb 2024 22:30:40 +0000, by Henry S. Thompson
merge
Thu, 15 Feb 2024 16:36:00 +0000, by Henry S. Thompson
see Paul:Documents/HTalks/WebSci2024
Thu, 15 Feb 2024 15:10:34 +0000, by Henry S. Thompson
add some debugging info
Thu, 11 Jan 2024 16:44:45 +0000, by Henry S. Thompson
use 2-digit suffixes,
Thu, 11 Jan 2024 16:43:16 +0000, by Henry S. Thompson
sic
Fri, 08 Dec 2023 10:32:07 +0000, by Henry S. Thompson
sic
Thu, 07 Dec 2023 18:23:11 +0000, by Henry S. Thompson
added back missing years
Thu, 07 Dec 2023 18:21:48 +0000, by Henry S. Thompson
support semilogy from cmd line
Thu, 07 Dec 2023 18:15:43 +0000, by Henry S. Thompson
means of all columns in length analyses
Wed, 06 Dec 2023 13:36:49 +0000, by Henry S. Thompson
normalise % counts by non-empty bases only
Wed, 06 Dec 2023 13:33:25 +0000, by Henry S. Thompson
new plots various
Tue, 05 Dec 2023 19:49:29 +0000, by Henry S. Thompson
get single graph working, tweak params various
Tue, 05 Dec 2023 19:49:11 +0000, by Henry S. Thompson
compute (component) uri lengths and a few other properties
Tue, 05 Dec 2023 10:35:15 +0000, by Henry S. Thompson
with three tracks from two years
Mon, 04 Dec 2023 19:06:13 +0000, by Henry S. Thompson
for pub
Mon, 04 Dec 2023 10:42:02 +0000, by Henry S. Thompson
tweaked formatting
Mon, 04 Dec 2023 10:40:47 +0000, by Henry S. Thompson
excel rewrote, no important changes (?)
Mon, 04 Dec 2023 10:21:30 +0000, by Henry S. Thompson
replace wrong one with right one
Mon, 04 Dec 2023 09:42:39 +0000, by Henry S. Thompson
merge
Mon, 04 Dec 2023 09:37:14 +0000, by Henry S. Thompson
implement alternative confidence measure using stats.bootstrap,
Mon, 04 Dec 2023 09:35:53 +0000, by Henry S. Thompson
for LMh percentile
Mon, 04 Dec 2023 09:33:13 +0000, by Henry S. Thompson
decorated
Thu, 30 Nov 2023 14:42:46 +0000, by Henry S. Thompson
merge
Thu, 30 Nov 2023 14:20:22 +0000, by Henry S. Thompson
can't add props to DescribeResult
Thu, 30 Nov 2023 14:18:56 +0000, by Henry S. Thompson
for 2023-40
Thu, 30 Nov 2023 14:17:34 +0000, by Henry S. Thompson
with decorations
Tue, 28 Nov 2023 18:40:38 +0000, by Henry S. Thompson
excel rewrote, no important changes (?)
Tue, 28 Nov 2023 18:40:17 +0000, by Henry S. Thompson
with percentile instead of raw mean correl
Tue, 28 Nov 2023 10:23:20 +0000, by Henry S. Thompson
change heatmap to by percentile
Tue, 28 Nov 2023 10:22:38 +0000, by Henry S. Thompson
with heat
Tue, 28 Nov 2023 10:21:36 +0000, by Henry S. Thompson
heat map for mime vs. nl1 vs. len
Mon, 27 Nov 2023 22:15:39 +0000, by Henry S. Thompson
add head_map fn
Mon, 27 Nov 2023 22:14:53 +0000, by Henry S. Thompson
add explore_deltas and predict analysis fns
Mon, 27 Nov 2023 18:25:39 +0000, by Henry S. Thompson
rename to avoid name clash with scipy.stats
Sun, 26 Nov 2023 21:24:38 +0000, by Henry S. Thompson
move to class with local vars instead of many globals
Fri, 24 Nov 2023 20:41:03 +0000, by Henry S. Thompson
renamed to by_interval.py
Fri, 24 Nov 2023 20:40:09 +0000, by Henry S. Thompson
renamed from spearman.py
Fri, 24 Nov 2023 20:39:08 +0000, by Henry S. Thompson
renamed to stats.py
Fri, 24 Nov 2023 20:38:39 +0000, by Henry S. Thompson
do the __main__ thing
Fri, 24 Nov 2023 19:52:52 +0000, by Henry S. Thompson
put results in numbered subdirs
Fri, 24 Nov 2023 19:52:14 +0000, by Henry S. Thompson
add minimal logging and don't return until finished
Fri, 24 Nov 2023 19:50:12 +0000, by Henry S. Thompson
should work for months also now
Wed, 15 Nov 2023 10:24:32 +0000, by Henry S. Thompson
cross-language confusion :-)
Wed, 15 Nov 2023 09:36:23 +0000, by Henry S. Thompson
LM plot for multiple crawls, magnitude or %age
Mon, 06 Nov 2023 15:55:57 +0000, by Henry S. Thompson
can overlay the two
Fri, 03 Nov 2023 19:05:54 +0000, by Henry S. Thompson
fix output year
Thu, 02 Nov 2023 15:38:39 +0000, by Henry S. Thompson
sic
Thu, 02 Nov 2023 13:49:02 +0000, by Henry S. Thompson
sic
Tue, 31 Oct 2023 14:05:12 +0000, by Henry S. Thompson
get in/out file management working right
Tue, 31 Oct 2023 14:04:24 +0000, by Henry S. Thompson
refactor to provide for buffer overflow fix
Tue, 31 Oct 2023 14:03:02 +0000, by Henry S. Thompson
bug-fix wrt 1st time,
Tue, 31 Oct 2023 14:01:50 +0000, by Henry S. Thompson
make extra file info optional
Mon, 30 Oct 2023 12:19:53 +0000, by Henry S. Thompson
forget parallel, just do (default 2) parallel single threads
Wed, 25 Oct 2023 23:01:59 +0100, by Henry S. Thompson
add missing makedir
Wed, 25 Oct 2023 23:00:45 +0100, by Henry S. Thompson
now does one named segment only
Tue, 24 Oct 2023 16:59:23 +0100, by Henry S. Thompson
resurrect parallel fetch
Tue, 24 Oct 2023 16:58:44 +0100, by Henry S. Thompson
convert to single thread,
Tue, 24 Oct 2023 14:34:58 +0100, by Henry S. Thompson
avoid global name conflict
Tue, 24 Oct 2023 14:26:36 +0100, by Henry S. Thompson
moved from /beegfs/common-crawl to get under .hg
Wed, 11 Oct 2023 12:51:06 +0100, by Henry S. Thompson
fix typo
Wed, 11 Oct 2023 12:50:29 +0100, by Henry S. Thompson
build cluster.idx
Fri, 06 Oct 2023 15:06:53 +0100, by Henry S. Thompson
no longer using cmp_to_key
Fri, 06 Oct 2023 15:05:55 +0100, by Henry S. Thompson
handle -m case, support src from cmdline mergefix
Wed, 04 Oct 2023 20:04:34 +0100, by Henry S. Thompson
new branch to save do_idx.sh from abandoned merge fixup mergefix
Thu, 05 Oct 2023 10:42:15 +0100, by Henry S. Thompson
try to get the counts right, particularly when re-merging
Wed, 04 Oct 2023 18:53:55 +0100, by Henry S. Thompson
for use in debugging, see notes and tests 2, 17, merge test
Wed, 04 Oct 2023 18:51:56 +0100, by Henry S. Thompson
add various www deletion cases
Tue, 03 Oct 2023 17:45:57 +0100, by Henry S. Thompson
iterate WPAT fix with improved pattern
Tue, 03 Oct 2023 17:44:59 +0100, by Henry S. Thompson
loosen WARC pattern to avoid failure from "mime" = "{...}" intervening
Tue, 03 Oct 2023 17:43:52 +0100, by Henry S. Thompson
refactor to enable rerun with fixup,
Mon, 02 Oct 2023 18:56:50 +0100, by Henry S. Thompson
correct mistaken futnsz test,
Mon, 02 Oct 2023 18:55:48 +0100, by Henry S. Thompson
change path to merge_date.py
Mon, 02 Oct 2023 18:54:10 +0100, by Henry S. Thompson
remove the mistaken deletion of NONPRINT,
Mon, 02 Oct 2023 18:52:43 +0100, by Henry S. Thompson
fix a bad fix and a bad test for the televida case
Sat, 30 Sep 2023 18:04:15 +0100, by Henry S. Thompson
fix and test for all-decimal host
Sat, 30 Sep 2023 14:13:19 +0100, by Henry S. Thompson
no import in lmh.__init__ any more
Sat, 30 Sep 2023 14:12:39 +0100, by Henry S. Thompson
importing in __init__ causes problems
Sat, 30 Sep 2023 14:11:49 +0100, by Henry S. Thompson
commented out duplicate, handle comments better
Fri, 29 Sep 2023 15:59:34 +0100, by Henry S. Thompson
more corner case tests
Fri, 29 Sep 2023 15:14:29 +0100, by Henry S. Thompson
tweaks to get all tests through #14
Fri, 29 Sep 2023 15:13:51 +0100, by Henry S. Thompson
get 7f (two cases) and %25 working
Thu, 28 Sep 2023 18:31:23 +0100, by Henry S. Thompson
add televida case test
Thu, 28 Sep 2023 18:30:48 +0100, by Henry S. Thompson
add test description
Thu, 28 Sep 2023 16:36:15 +0100, by Henry S. Thompson
importable just in case
Thu, 28 Sep 2023 16:35:39 +0100, by Henry S. Thompson
move most of the hacking into fixGoogleCanon,
Thu, 28 Sep 2023 16:34:49 +0100, by Henry S. Thompson
forget assert, allow multiple failures
Thu, 28 Sep 2023 16:10:05 +0100, by Henry S. Thompson
x
Thu, 28 Sep 2023 16:09:38 +0100, by Henry S. Thompson
found right place for \x7f hack, maybe
Thu, 28 Sep 2023 14:08:36 +0100, by Henry S. Thompson
readability
Thu, 28 Sep 2023 14:06:11 +0100, by Henry S. Thompson
x
Thu, 28 Sep 2023 11:00:36 +0100, by Henry S. Thompson
refactor to sort a module in an lmh package
Thu, 28 Sep 2023 11:00:24 +0100, by Henry S. Thompson
start some regression tests
Thu, 28 Sep 2023 10:54:12 +0100, by Henry S. Thompson
creating lmh package
Thu, 28 Sep 2023 09:01:18 +0100, by Henry S. Thompson
moved from bin
Thu, 28 Sep 2023 08:46:01 +0100, by Henry S. Thompson
minor bug wrt EOF of final cdx input file
Wed, 27 Sep 2023 17:29:51 +0100, by Henry S. Thompson
replicate two extremely-corner cases of the way
Wed, 27 Sep 2023 17:29:09 +0100, by Henry S. Thompson
a bit more logging
Tue, 26 Sep 2023 18:55:43 +0100, by Henry S. Thompson
a bit more logging
Tue, 26 Sep 2023 18:55:11 +0100, by Henry S. Thompson
robotstxt and crawldiagnostics get free ride,
Tue, 26 Sep 2023 17:42:57 +0100, by Henry S. Thompson
a few more from ecclerig,
Tue, 26 Sep 2023 14:18:40 +0100, by Henry S. Thompson
refactor datestream reading,
Tue, 26 Sep 2023 09:03:47 +0100, by Henry S. Thompson
more faithful regexps and non-byte uri output
Mon, 25 Sep 2023 23:53:13 +0100, by Henry S. Thompson
one uncommited fix from quentin
Fri, 22 Sep 2023 15:27:28 +0100, by Henry S. Thompson
pass in debug flag(s) to merge_date.py
Tue, 19 Sep 2023 19:40:58 +0100, by Henry Thompson
loosen must-match criterion in the both-messy case
Tue, 19 Sep 2023 19:29:41 +0100, by Henry Thompson
one more sid fix,
Tue, 19 Sep 2023 19:28:34 +0100, by Henry Thompson
working on sessionID pblms, still
Sun, 17 Sep 2023 15:18:11 +0100, by Henry S. Thompson
first try
Thu, 14 Sep 2023 19:27:23 +0100, by Henry Thompson
switch to gzip -7 to get comparable compressed cdx block size
Wed, 13 Sep 2023 16:48:43 +0100, by Henry S. Thompson
use my own Canonicalizer to fix more obscure
Wed, 13 Sep 2023 12:41:55 +0100, by Henry S. Thompson
re-instate logging splits for .idx
Wed, 13 Sep 2023 12:40:39 +0100, by Henry S. Thompson
reinstate better check to start queuing,
Tue, 12 Sep 2023 12:14:04 +0100, by Henry S. Thompson
bug4 fixed, but that created a new, earlier bug
Mon, 11 Sep 2023 22:06:45 +0100, by Henry S. Thompson
rework handling of session key problem
Mon, 11 Sep 2023 12:56:47 +0100, by Henry S. Thompson
initialise paths for csing
Fri, 08 Sep 2023 21:40:52 +0100, by Henry S. Thompson
d'oh
Fri, 08 Sep 2023 21:40:06 +0100, by Henry S. Thompson
include full URI in output
Fri, 08 Sep 2023 18:06:54 +0100, by Henry S. Thompson
try to do csing correctly on compute nodes
Fri, 08 Sep 2023 18:05:57 +0100, by Henry S. Thompson
version which outputs more identification,
Fri, 08 Sep 2023 09:29:25 +0100, by Henry S. Thompson

less more | rev 214: (0) -120 tip

Mercurial > hg > cc > cirrus_work

graph