view L4/notes.txt @ 137:0b223e6cdbef

noting block offsets while scanning warc files now working in gzip_plus/warc/test_warc
author Henry S. Thompson <ht@inf.ed.ac.uk>
date Mon, 16 Mar 2026 13:50:31 +0000
parents c59e71b33517
children
line wrap: on
line source

Scope: "Increase the development of computational science skills, such
as allowing students to work jointly with project leads to achieve the
aims of the proposed research, leading to improved software and coding
skills, and career paths"

lmh.py took ~3 hours for 4 segments using 8 nodes, 36 cores == 21,000 hours