Mercurial > hg > cc > cirrus_home
comparison bin/cdx_segment.sh @ 86:b5fef78cbb26
working for -t 2 -c 2
| author | Henry S. Thompson <ht@inf.ed.ac.uk> |
|---|---|
| date | Mon, 15 Mar 2021 14:26:42 +0000 |
| parents | |
| children | b6a5999d8e06 |
comparison
equal
deleted
inserted
replaced
| 85:e5d5958bf3fe | 86:b5fef78cbb26 |
|---|---|
| 1 #!/bin/bash | |
| 2 # Invoke this as e.g. sbatch -n 30 -c 10 masterJob.sh cdx_segment | |
| 3 # run cdx_segment.py in parallel | |
| 4 n=$SLURM_NTASKS | |
| 5 c=$SLURM_CPUS_PER_TASK | |
| 6 node=$SLURMD_NODENAME | |
| 7 local=$SLURM_LOCALID | |
| 8 proc=$SLURM_PROCID | |
| 9 echo $(date) $node:$proc $start | |
| 10 | |
| 11 module load gnu-parallel | |
| 12 | |
| 13 parallel --will-cite -j $c lib/python/cdx_segment.py 2019-35 15 '{}' < cdx_segment/$proc.txt | |
| 14 | |
| 15 echo $(date) $proc end | |
| 16 |