Mercurial > hg > cc > cirrus_home
annotate bin/plinksMaster.sh @ 190:f2bf736c2d40
working, with issues:
1) warc.export.cdx.path is not set
2) mime property isn't getting through
3) lastMod isn't showing up
| author | Henry S. Thompson <ht@inf.ed.ac.uk> |
|---|---|
| date | Tue, 24 Sep 2024 17:08:05 +0100 |
| parents | 29263ba42361 |
| children |
| rev | line source |
|---|---|
| 11 | 1 #!/bin/bash |
| 2 # This runs on 1 machine to launch the real job on two machines | |
|
12
29263ba42361
add args for start tar and number of tars
Henry S. Thompson <ht@inf.ed.ac.uk>
parents:
11
diff
changeset
|
3 echo $(date) Launching plinks workers for "$@" |
|
29263ba42361
add args for start tar and number of tars
Henry S. Thompson <ht@inf.ed.ac.uk>
parents:
11
diff
changeset
|
4 parallel --will-cite --nonall -S r1i5n0 -S r1i5n1 bin/plinks.sh "$@" |
| 11 | 5 echo $(date) Workers done |
