Mercurial > hg > cc > cirrus_work
comparison bin/ex4_1.sh @ 385:615efac7fc09 plus
working for ex4a
| author | Henry S. Thompson <ht@inf.ed.ac.uk> |
|---|---|
| date | Mon, 15 Jun 2026 23:31:47 +0100 |
| parents | |
| children |
comparison
equal
deleted
inserted
replaced
| 384:7245d684b0b5 | 385:615efac7fc09 |
|---|---|
| 1 #!/usr/bin/bash | |
| 2 # Usage: ex4_1.sh j n | |
| 3 # Process the jth group of cdx files taken n at a time | |
| 4 # with 10 parallel threads at a time | |
| 5 j=$1 | |
| 6 n=$2 | |
| 7 c_s=$((n * j)) | |
| 8 c_e=$(( ( ( n * (j + 1) ) - 1 ) )) | |
| 9 echo ex4_1 passed j=$j n=$n, processing "[$c_s,$c_e]" | |
| 10 cd /work/dc007/dc007/hst/results/CC-MAIN-2025-33/warc_lmhx/idx | |
| 11 seq --format "%03g" $c_s $c_e | parallel -j 10 \ | |
| 12 /work/dc007/dc007/hst/bin/ex4_2.sh '{}' | uniq_merge.py | |
| 13 | |
| 14 |