Mercurial > hg > cc > cirrus_home
view bin/extract.sh @ 143:ddff993994be
too clever by half, keys won't work in parallel for e.g. media types
author | Henry S. Thompson <ht@inf.ed.ac.uk> |
---|---|
date | Wed, 20 Oct 2021 15:47:55 +0000 |
parents | 1e479e3ea9c4 |
children |
line wrap: on
line source
#!/usr/bin/bash # Launch parallel tasks, one per segment from extract_?.txt # First line thereof gives CC identifier echo $(date) $(hostname) h=$(hostname) hn=${h##*n} head -1 extract_${hn}.txt |\ { read cc ; \ tail -n +2 extract_${hn}.txt |\ parallel --joblog topjob.log --will-cite -j 4 -N 1 \$HOME/bin/doExtract.sh "$cc" '{#}' '{}' ; } echo $(date) $(hostname) $?