Mercurial > hg > cc > cirrus_home

annotate bin/nl1.sh @ 190:f2bf736c2d40

Find changesets by keywords (author, files, the commit message), revision number or hash, or revset expression.
working, with issues: 1) warc.export.cdx.path is not set 2) mime property isn't getting through 3) lastMod isn't showing up
author Henry S. Thompson <ht@inf.ed.ac.uk>
date Tue, 24 Sep 2024 17:08:05 +0100
parents fc1b16130961
children
Ignore whitespace changes - Everywhere: Within whitespace: At end of lines:
rev   line source
167
3213a8bb2ed1 new style batch jobs, see cirrus_work repo for _xxx.sh
Henry S. Thompson <ht@inf.ed.ac.uk>
parents:
diff changeset
1 #!/bin/bash
3213a8bb2ed1 new style batch jobs, see cirrus_work repo for _xxx.sh
Henry S. Thompson <ht@inf.ed.ac.uk>
parents:
diff changeset
2 # Invoke this as e.g. sbatch --ntasks=10 -c 20 nl1.sh \
3213a8bb2ed1 new style batch jobs, see cirrus_work repo for _xxx.sh
Henry S. Thompson <ht@inf.ed.ac.uk>
parents:
diff changeset
3 # CC-MAIN-2019-35 nl1_counts langs 0 299
3213a8bb2ed1 new style batch jobs, see cirrus_work repo for _xxx.sh
Henry S. Thompson <ht@inf.ed.ac.uk>
parents:
diff changeset
4 # It will run on the login node
3213a8bb2ed1 new style batch jobs, see cirrus_work repo for _xxx.sh
Henry S. Thompson <ht@inf.ed.ac.uk>
parents:
diff changeset
5
3213a8bb2ed1 new style batch jobs, see cirrus_work repo for _xxx.sh
Henry S. Thompson <ht@inf.ed.ac.uk>
parents:
diff changeset
6 #SBATCH --time=01:00:00
3213a8bb2ed1 new style batch jobs, see cirrus_work repo for _xxx.sh
Henry S. Thompson <ht@inf.ed.ac.uk>
parents:
diff changeset
7 #SBATCH --partition=standard
3213a8bb2ed1 new style batch jobs, see cirrus_work repo for _xxx.sh
Henry S. Thompson <ht@inf.ed.ac.uk>
parents:
diff changeset
8 #SBATCH --qos=standard
186
fc1b16130961 csing-related tweaks
Henry S. Thompson <ht@inf.ed.ac.uk>
parents: 167
diff changeset
9 #SBATCH --account=ec184-hst
167
3213a8bb2ed1 new style batch jobs, see cirrus_work repo for _xxx.sh
Henry S. Thompson <ht@inf.ed.ac.uk>
parents:
diff changeset
10 #SBATCH --job-name ex1
3213a8bb2ed1 new style batch jobs, see cirrus_work repo for _xxx.sh
Henry S. Thompson <ht@inf.ed.ac.uk>
parents:
diff changeset
11
3213a8bb2ed1 new style batch jobs, see cirrus_work repo for _xxx.sh
Henry S. Thompson <ht@inf.ed.ac.uk>
parents:
diff changeset
12 export W=/work/dc007/dc007
3213a8bb2ed1 new style batch jobs, see cirrus_work repo for _xxx.sh
Henry S. Thompson <ht@inf.ed.ac.uk>
parents:
diff changeset
13
3213a8bb2ed1 new style batch jobs, see cirrus_work repo for _xxx.sh
Henry S. Thompson <ht@inf.ed.ac.uk>
parents:
diff changeset
14 echo $(date) Launching $SLURM_JOB_NUM_NODES nodes for nl1 "$@" from $(hostname) to do $SLURM_NTASKS tasks, $SLURM_CPUS_PER_TASK cpus each
3213a8bb2ed1 new style batch jobs, see cirrus_work repo for _xxx.sh
Henry S. Thompson <ht@inf.ed.ac.uk>
parents:
diff changeset
15
186
fc1b16130961 csing-related tweaks
Henry S. Thompson <ht@inf.ed.ac.uk>
parents: 167
diff changeset
16 srun -c $SLURM_CPUS_PER_TASK $W/shared/bin/csing $W/hst/bin/_nl1.sh "$@"
fc1b16130961 csing-related tweaks
Henry S. Thompson <ht@inf.ed.ac.uk>
parents: 167
diff changeset
17
fc1b16130961 csing-related tweaks
Henry S. Thompson <ht@inf.ed.ac.uk>
parents: 167
diff changeset
18