Mercurial > hg > cc > work

view lurid3/notes.txt @ 40:4167d8f33325

Find changesets by keywords (author, files, the commit message), revision number or hash, or revset expression.
start lab notes for LURID3
author Henry S. Thompson <ht@inf.ed.ac.uk>
date Tue, 20 Aug 2024 15:27:47 +0100
parents
children 64b7fb44e8dc
line wrap: on
line source

See old_notes.txt for all older notes on Common Crawl dataprocessing,
starting from Azure via Turing and then LURID and LURID2.

Installed /beegfs/common_crawl/CC-MAIN-2024-33/cdx
  >: cd results/CC-MAIN-2024-33/cdx/
  >: cut -f 2 counts.tsv | btot
  2,793,986,828 

State of play wrt data -- see status.xlsx