Mercurial > hg > cc > cirrus_home
view bin/plinksRedo.sh @ 62:346298ac3ab9
several efficiency (hofentlich) tweaks
| author | Henry S. Thompson <ht@inf.ed.ac.uk> |
|---|---|
| date | Fri, 24 Apr 2020 15:20:33 +0100 |
| parents | b976a7449d41 |
| children |
line wrap: on
line source
#!/usr/bin/bash module load miniconda/python3 echo $(date) $(hostname) h=$(hostname) hn=${h##*n} cat /beegfs/common_crawl/CC-MAIN-2019-35/pdfs/links/redo_$hn |\ parallel --will-cite -j 48 -N 1 bin/doPlinks.sh ${hn} '{#}' '{}' echo $(date) $(hostname) $?
