Mercurial > hg > cc > cirrus_home
graph
-
trying to move to slurmWed, 03 Mar 2021 19:33:56 +0000, by Henry S. Thompson
-
improved F handling/loggingSat, 09 May 2020 16:16:28 +0100, by Henry S. Thompson
-
keep separate antecedants separate, buggy?Fri, 08 May 2020 19:52:36 +0100, by Henry S. Thompson
-
track redirects, need to us full crawldiagnostics.warc.gz for "location:" and "Uri:"Thu, 07 May 2020 18:47:24 +0100, by Henry S. Thompson
-
refactor, change summary print (problem?)Thu, 07 May 2020 11:33:24 +0100, by Henry S. Thompson
-
bare framework workingWed, 06 May 2020 18:28:52 +0100, by Henry S. Thompson
-
starting on tool to assemble as complete as we have info wrt a seed URIWed, 06 May 2020 14:25:44 +0100, by Henry S. Thompson
-
use local .m2/repository for Hadoop 3.4.0Wed, 06 May 2020 14:24:42 +0100, by Henry S. Thompson
-
works for big files with Hadoop 3.4.0Wed, 06 May 2020 14:23:33 +0100, by Henry S. Thompson
-
xWed, 06 May 2020 14:22:48 +0100, by Henry S. Thompson
-
log trucationsTue, 28 Apr 2020 19:02:34 +0100, by Henry S. Thompson
-
impose some limitsTue, 28 Apr 2020 19:02:14 +0100, by Henry S. Thompson
-
xTue, 28 Apr 2020 19:01:41 +0100, by Henry S. Thompson
-
xFri, 24 Apr 2020 20:12:44 +0100, by Henry S. Thompson
-
mostly from SebastianFri, 24 Apr 2020 20:12:29 +0100, by Henry S. Thompson
-
miscFri, 24 Apr 2020 20:03:29 +0100, by Henry S. Thompson
-
miscFri, 24 Apr 2020 20:01:35 +0100, by Henry S. Thompson
-
fix from SebastianFri, 24 Apr 2020 20:01:25 +0100, by Henry S. Thompson
-
miscFri, 24 Apr 2020 19:57:16 +0100, by Henry S. Thompson
-
miscFri, 24 Apr 2020 19:55:11 +0100, by Henry S. Thompson
-
several efficiency (hofentlich) tweaksFri, 24 Apr 2020 15:20:33 +0100, by Henry S. Thompson
-
xThu, 23 Apr 2020 17:26:55 +0100, by Henry S. Thompson
-
switch for use on login server, invoke by hand with 0/1 as only cmd line argThu, 23 Apr 2020 17:25:25 +0100, by Henry S. Thompson
-
java stuffWed, 22 Apr 2020 18:42:40 +0100, by Henry S. Thompson
-
try nutch fetch for big pdfsWed, 22 Apr 2020 18:42:23 +0100, by Henry S. Thompson
-
final most general versinWed, 15 Apr 2020 18:44:18 +0100, by Henry S. Thompson
-
too big for /dev/shm, split in halfTue, 14 Apr 2020 17:52:34 +0100, by Henry S. Thompson
-
one-off to convert big extracts.tar into lots of smaller onesTue, 14 Apr 2020 16:10:22 +0100, by Henry S. Thompson
-
as used successfully for 3rd runMon, 13 Apr 2020 17:29:31 +0100, by Henry S. Thompson
-
ready to try another pass with robust diff checkingMon, 13 Apr 2020 15:24:32 +0100, by Henry S. Thompson
-
working towards more robust diff checkingMon, 13 Apr 2020 14:12:12 +0100, by Henry S. Thompson
-
a few tweaks after 2nd parallel runSat, 11 Apr 2020 13:41:46 +0100, by Henry S. Thompson
-
another few log fixesFri, 10 Apr 2020 18:45:30 +0100, by Henry S. Thompson
-
as running, modulo 1 log output wrongFri, 10 Apr 2020 18:42:08 +0100, by Henry S. Thompson
-
log more, work around more glitchesFri, 10 Apr 2020 18:22:48 +0100, by Henry S. Thompson
-
xFri, 10 Apr 2020 18:22:24 +0100, by Henry S. Thompson
-
start try to work around failuresWed, 08 Apr 2020 14:11:04 +0100, by Henry S. Thompson
-
parallelised version of reExtract.shWed, 08 Apr 2020 11:27:33 +0100, by Henry S. Thompson
-
complete change of array var construction, used it for log file names too, tar update enabled, so maybe complete but w/o any parallelTue, 07 Apr 2020 18:00:29 +0100, by Henry S. Thompson
-
added computation of required additions to tar file, but not actually addedSat, 04 Apr 2020 15:31:58 +0100, by Henry S. Thompson
-
refactored, not testedFri, 03 Apr 2020 19:04:06 +0100, by Henry S. Thompson
-
done through re-extraction, fixing tars still to comeFri, 03 Apr 2020 17:35:17 +0100, by Henry S. Thompson
-
sketching moreThu, 02 Apr 2020 19:21:21 +0100, by Henry S. Thompson
-
towards re-running extraction in partThu, 02 Apr 2020 19:14:23 +0100, by Henry S. Thompson
-
up the time limitThu, 02 Apr 2020 19:13:40 +0100, by Henry S. Thompson
-
clean up after ourselvesThu, 02 Apr 2020 19:13:14 +0100, by Henry S. Thompson
-
fixed scope pblm in tar stepThu, 26 Mar 2020 15:29:12 +0000, by Henry S. Thompson
-
sync up filenames and log names,Thu, 26 Mar 2020 12:24:30 +0000, by Henry S. Thompson
-
pass through extract argsThu, 26 Mar 2020 12:23:33 +0000, by Henry S. Thompson
-
towards sub-division of resulting tar filesTue, 24 Mar 2020 17:53:35 +0000, by Henry S. Thompson
-
not relevantTue, 24 Mar 2020 17:52:52 +0000, by Henry S. Thompson
-
xThu, 19 Mar 2020 13:13:35 +0000, by Henry S. Thompson
-
better quotingThu, 19 Mar 2020 13:13:02 +0000, by Henry S. Thompson
-
try to fix multi-line lossageWed, 18 Mar 2020 21:54:47 +0000, by Henry S. Thompson
-
fix missing use of $tWed, 18 Mar 2020 21:52:06 +0000, by Henry S. Thompson
-
first cut at doing extraction hereWed, 18 Mar 2020 15:23:53 +0000, by Henry S. Thompson
-
finally hacked something that worksWed, 18 Mar 2020 13:42:47 +0000, by Henry S. Thompson
-
(none)Wed, 18 Mar 2020 11:08:47 +0000, by Henry S. Thompson
-
(none)Wed, 18 Mar 2020 11:08:23 +0000, by Henry S. Thompson
-
xWed, 18 Mar 2020 11:06:35 +0000, by Henry S. Thompson