qwarc

A framework for quick web archiving

История

JustAnotherArchivist 17fc3499ff Fix infinite loop in workaround for aiohttp issue 4630 If a response ends with '0\r\n' or '0\r\n\r', ClientResponse._read loops forever trying to read 4 more bytes. In addition, bump that read to 1 KiB for better worst-case performance.		преди 3 години
..
__init__.py	Log traceback on exceptions raised from an item	преди 4 години
aiohttp.py	Fix infinite loop in workaround for aiohttp issue 4630	преди 3 години
cli.py	Support deep/multiple inheritance from Item	преди 4 години
const.py	Catch exceptions in Item.process and mark the items as errors instead of crashing	преди 4 години
utils.py	Write only successful retrievals (i.e. ones that don't cause an exception) to WARC	преди 4 години
version.py	Use setuptools_scm for versioning	преди 4 години
warc.py	Stop deduping small responses	преди 4 години