Mercurial > hg > cc > cirrus_home

view bin/plinksRedo.sh @ 35:ec99b2d1d2fc

Find changesets by keywords (author, files, the commit message), revision number or hash, or revset expression.
sync up filenames and log names, attempt to save more smaller tar files
author Henry S. Thompson <ht@inf.ed.ac.uk>
date Thu, 26 Mar 2020 12:24:30 +0000
parents b976a7449d41
children
line wrap: on
line source

#!/usr/bin/bash
module load miniconda/python3
echo $(date) $(hostname)
h=$(hostname)
hn=${h##*n}
cat /beegfs/common_crawl/CC-MAIN-2019-35/pdfs/links/redo_$hn |\
parallel --will-cite -j 48 -N 1 bin/doPlinks.sh ${hn} '{#}' '{}'
echo $(date) $(hostname) $?