Mercurial > hg > cc > cirrus_home

annotate bin/plinksRedo.sh @ 195:5f3c36e4fd6d default tip

Find changesets by keywords (author, files, the commit message), revision number or hash, or revset expression.
add target test-core which (dangerously) avoids (we hope pointless) recompilation of all the plugins
author Henry S. Thompson <ht@inf.ed.ac.uk>
date Thu, 26 Sep 2024 17:55:56 +0100
parents b976a7449d41
children
Ignore whitespace changes - Everywhere: Within whitespace: At end of lines:
rev   line source
17
Henry S. Thompson <ht@inf.ed.ac.uk>
parents:
diff changeset
1 #!/usr/bin/bash
Henry S. Thompson <ht@inf.ed.ac.uk>
parents:
diff changeset
2 module load miniconda/python3
Henry S. Thompson <ht@inf.ed.ac.uk>
parents:
diff changeset
3 echo $(date) $(hostname)
Henry S. Thompson <ht@inf.ed.ac.uk>
parents:
diff changeset
4 h=$(hostname)
Henry S. Thompson <ht@inf.ed.ac.uk>
parents:
diff changeset
5 hn=${h##*n}
Henry S. Thompson <ht@inf.ed.ac.uk>
parents:
diff changeset
6 cat /beegfs/common_crawl/CC-MAIN-2019-35/pdfs/links/redo_$hn |\
Henry S. Thompson <ht@inf.ed.ac.uk>
parents:
diff changeset
7 parallel --will-cite -j 48 -N 1 bin/doPlinks.sh ${hn} '{#}' '{}'
Henry S. Thompson <ht@inf.ed.ac.uk>
parents:
diff changeset
8 echo $(date) $(hostname) $?