204 Commits (dde44645559484f2857d6cb1a8da101837718e31)

 

Alle Branches   

Suchen

Autor	SHA1	Nachricht	Datum
JustAnotherArchivist	dde4464555	Cover two more rare URLs	vor 3 Jahren
JustAnotherArchivist	bbf2d2c315	Be more lenient regarding slashes to catch things with collapsed URLs in paths etc.	vor 3 Jahren
JustAnotherArchivist	362f66eb26	Handle youtube-nocookie.com and fix removenonyt mode not recognising CC domains	vor 3 Jahren
JustAnotherArchivist	81e2b4b999	Refine patterns	vor 3 Jahren
JustAnotherArchivist	9974d4613c	Stop trying to rewrite patterns for percent encoding	vor 3 Jahren
JustAnotherArchivist	0ee83bc0f2	Refactor	vor 3 Jahren
JustAnotherArchivist	b66260ca94	Add youtube-extract	vor 3 Jahren
JustAnotherArchivist	d82dff8b71	Add ETA column	vor 3 Jahren
JustAnotherArchivist	01274e461a	Prevent constantly moving bytes around for better performance on large chunked records	vor 3 Jahren
JustAnotherArchivist	77d9f61de0	Colourise output	vor 3 Jahren
JustAnotherArchivist	6512669cfd	Refactor and compare file list as well	vor 3 Jahren
JustAnotherArchivist	8e0cb30d0a	Add atdash mode	vor 3 Jahren
JustAnotherArchivist	5fe595d71c	Record wrapper script in meta WARC as well	vor 3 Jahren
JustAnotherArchivist	c1def0e7a8	Fix S3_WITH_LIST_URLS being defined (but empty) when --with-list-urls is not used	vor 3 Jahren
JustAnotherArchivist	398cbfdcda	Add s3-bucket-list-qwarc, rewritten s3-bucket-list on top of qwarc	vor 3 Jahren
JustAnotherArchivist	80084e0d35	Another alternative and performance/memory comparison	vor 3 Jahren
JustAnotherArchivist	6a288a6338	Use grep instead, which is faster but uses more memory	vor 3 Jahren
JustAnotherArchivist	4d274e64e0	Add dedupe	vor 3 Jahren
JustAnotherArchivist	a4af8e6ca6	Add IE6 UA	vor 3 Jahren
JustAnotherArchivist	ac277437a3	Add Googlebot UA	vor 3 Jahren
JustAnotherArchivist	0181e53f01	Treat NXDOMAIN and no A/AAAA record errors as ok	vor 3 Jahren
JustAnotherArchivist	41c2a9d2d4	Add support for alternative xmlns Used on Google's storage under https://storage.googleapis.com/bucket/	vor 3 Jahren
JustAnotherArchivist	830e9dbc43	Treat redirects as successful retrievals	vor 3 Jahren
JustAnotherArchivist	7a999c9b0a	Ignore redirects	vor 3 Jahren
JustAnotherArchivist	579d589853	Add a script to extract errors from wpull 2.x logs	vor 3 Jahren
JustAnotherArchivist	d60948e90f	Verbosity	vor 3 Jahren
JustAnotherArchivist	a9a4792854	Fix server validation	vor 3 Jahren
JustAnotherArchivist	57e2e26d80	Support multi-file uploads	vor 3 Jahren
JustAnotherArchivist	02c967f608	Add gofile.io download script	vor 3 Jahren
JustAnotherArchivist	a83d28d08e	Add WARC/1.1 support	vor 3 Jahren
JustAnotherArchivist	ba2f7db380	Merge warc-peek repository into little-things	vor 3 Jahren
JustAnotherArchivist	79fc113467	Merge kill-wpull-connections repository into little-things	vor 3 Jahren
JustAnotherArchivist	b4bb9babac	Switch to HTTPS	vor 3 Jahren
JustAnotherArchivist	9f3c7b3ca8	Support negative filter values for date columns as relative to the current datetime	vor 3 Jahren
JustAnotherArchivist	c7151efc3e	Add script for checking whether a file on transfer.notkiska.pw was archived correctly with AB	vor 3 Jahren
JustAnotherArchivist	4c90bacaed	Shield values in colons with angled brackets	vor 3 Jahren
JustAnotherArchivist	f51adccd3f	Add --meta mode for dump-responses which prefixes each line with information about the file and record	vor 3 Jahren
JustAnotherArchivist	9cc1f41917	Pass the filename in NewFile events	vor 3 Jahren
JustAnotherArchivist	a38efc31b6	Introduce a way to provide additional arguments to processors	vor 3 Jahren
JustAnotherArchivist	ecf667884b	Fix deb file URLs	vor 3 Jahren
JustAnotherArchivist	1e5fbedcef	Fix log message going to stdout	vor 3 Jahren
JustAnotherArchivist	3a2cea1980	Add script for recursing over Debian repos	vor 3 Jahren
JustAnotherArchivist	4f12f73b57	Refactor filtering and add --pyfilter	vor 3 Jahren
JustAnotherArchivist	785f13ece8	Add --replace-{concurrency,delay}	vor 3 Jahren
JustAnotherArchivist	5067c406b2	Fix errors on invalid filter or sort values	vor 3 Jahren
JustAnotherArchivist	7e2befc827	+x	vor 3 Jahren
JustAnotherArchivist	49376db51b	Decode HTTP request bodies	vor 3 Jahren
JustAnotherArchivist	171ca4252b	Disable truncation when stdout is not a terminal	vor 4 Jahren
JustAnotherArchivist	9763370976	Truncate URLs by default to fit the terminal width	vor 4 Jahren
JustAnotherArchivist	1bc1487ecc	Add script for extracting remaining wpull 2 queue	vor 4 Jahren