Mercurial > hg > cc > cirrus_work
changeset 381:fb5e2d06a650 plus
remove debugging breakpoint
| author | Henry S. Thompson <ht@inf.ed.ac.uk> |
|---|---|
| date | Thu, 11 Jun 2026 21:13:15 +0100 |
| parents | 6082474a4e2e |
| children | ec914a136771 |
| files | lib/python/cc/warc.py |
| diffstat | 1 files changed, 1 insertions(+), 4 deletions(-) [+] |
line wrap: on
line diff
--- a/lib/python/cc/warc.py Thu Jun 11 21:11:15 2026 +0100 +++ b/lib/python/cc/warc.py Thu Jun 11 21:13:15 2026 +0100 @@ -156,10 +156,7 @@ # python3 ~/lib/python/cc/test_warc.py 4 /beegfs/common_crawl/CC-MAIN-2019-35/1566027313501.0/orig/crawldiagnostics/CC-MAIN-20190817222907-20190818004907-00000.warc.gz # at a point where bp+length is 11018, looking at >\n\r\n # bp += 1 [doesn't work] - try: - bp = buf.index(b'\r\n',bp+length) - except ValueError: - breakpoint() + bp = buf.index(b'\r\n',bp+length) # check if refill needed rl: int if (rl := (bp - start_1)) > RECORDMAX:
