Mercurial > hg > cc > cirrus_home
view bin/test.sh @ 190:f2bf736c2d40
working, with issues:
1) warc.export.cdx.path is not set
2) mime property isn't getting through
3) lastMod isn't showing up
| author | Henry S. Thompson <ht@inf.ed.ac.uk> |
|---|---|
| date | Tue, 24 Sep 2024 17:08:05 +0100 |
| parents | 3213a8bb2ed1 |
| children |
line wrap: on
line source
#!/usr/bin/bash # Invoke this as e.g. sbatch --time=00:05:00 [--exclusive] --ntasks=6 -c 13 ~/bin/test.sh # run _test.sh in parallel on 3 nodes, 2 tasks each #SBATCH --time=00:01:00 #SBATCH --partition=standard #SBATCH --qos=standard #SBATCH --account=ec184-guest #SBATCH --job-name test export W=/work/dc007/dc007 echo $(date) Launching $SLURM_JOB_NUM_NODES nodes for test "$@" from $(hostname) to do $SLURM_NTASKS tasks, $SLURM_CPUS_PER_TASK cpus each srun -c $SLURM_CPUS_PER_TASK $W/shared/bin/sing $W/hst/bin/_test.sh "$@"