Mercurial > hg > cc > cirrus_home

annotate bin/plinksRedo.sh @ 35:ec99b2d1d2fc

Find changesets by keywords (author, files, the commit message), revision number or hash, or revset expression.
sync up filenames and log names, attempt to save more smaller tar files
author Henry S. Thompson <ht@inf.ed.ac.uk>
date Thu, 26 Mar 2020 12:24:30 +0000
parents b976a7449d41
children
Ignore whitespace changes - Everywhere: Within whitespace: At end of lines:
rev   line source
17
Henry S. Thompson <ht@inf.ed.ac.uk>
parents:
diff changeset
1 #!/usr/bin/bash
Henry S. Thompson <ht@inf.ed.ac.uk>
parents:
diff changeset
2 module load miniconda/python3
Henry S. Thompson <ht@inf.ed.ac.uk>
parents:
diff changeset
3 echo $(date) $(hostname)
Henry S. Thompson <ht@inf.ed.ac.uk>
parents:
diff changeset
4 h=$(hostname)
Henry S. Thompson <ht@inf.ed.ac.uk>
parents:
diff changeset
5 hn=${h##*n}
Henry S. Thompson <ht@inf.ed.ac.uk>
parents:
diff changeset
6 cat /beegfs/common_crawl/CC-MAIN-2019-35/pdfs/links/redo_$hn |\
Henry S. Thompson <ht@inf.ed.ac.uk>
parents:
diff changeset
7 parallel --will-cite -j 48 -N 1 bin/doPlinks.sh ${hn} '{#}' '{}'
Henry S. Thompson <ht@inf.ed.ac.uk>
parents:
diff changeset
8 echo $(date) $(hostname) $?