JustAnotherArchivist
/
little-things
2
0
Fork 0
Code Issues 0 Pull-Requests 0 Releases 0 Wiki Aktivität
437 Commits
1 Branch
1.7 MiB
Branch: master
Branches Tags
${ item.name }
Erstelle Branch ${ searchTerm }
von „master“
${ noResults }
Commit graph

31 Commits (master)

Autor SHA1 Nachricht Datum
  JustAnotherArchivist 4ff212eb20 Fix empty files being considered valid WARCs vor 10 Monaten
  JustAnotherArchivist 828dae2597 Raise an error when verification fails vor 10 Monaten
  JustAnotherArchivist 73f35f5591 Fix infinite loop when file ends with something that is not a WARC record vor 2 Jahren
  JustAnotherArchivist 06d60a798c Bump read size vor 2 Jahren
  JustAnotherArchivist 74485c399b Require decompressed WARCs with warc-tiny vor 2 Jahren
  JustAnotherArchivist fe0b020352 Add support for reading from stdin vor 2 Jahren
  JustAnotherArchivist 5b731fbde1 Fix compatibility with wpull 2.x vor 3 Jahren
  JustAnotherArchivist 743e0582ba Fix confusing error message when lxml is not installed vor 3 Jahren
  JustAnotherArchivist 491a80a04b Add warc-tiny scrape command for parsing HTTP responses using wpull and extracting links vor 3 Jahren
  JustAnotherArchivist 01274e461a Prevent constantly moving bytes around for better performance on large chunked records vor 3 Jahren
  JustAnotherArchivist 4c90bacaed Shield values in colons with angled brackets vor 3 Jahren
  JustAnotherArchivist f51adccd3f Add --meta mode for dump-responses which prefixes each line with information about the file and record vor 3 Jahren
  JustAnotherArchivist 9cc1f41917 Pass the filename in NewFile events vor 3 Jahren
  JustAnotherArchivist a38efc31b6 Introduce a way to provide additional arguments to processors vor 3 Jahren
  JustAnotherArchivist 49376db51b Decode HTTP request bodies vor 4 Jahren
  JustAnotherArchivist 34c1a58034 Fix detection of multiple transfer encodings vor 4 Jahren
  JustAnotherArchivist 5982e131a4 Stop gracefully when encountering a SIGPIPE vor 4 Jahren
  JustAnotherArchivist c13a1150df Add support for WARC/1.1 vor 4 Jahren
  JustAnotherArchivist 376cde7b8c Fix broken block digest calculation on malformed HTTP responses vor 4 Jahren
  JustAnotherArchivist b121cbd958 Write all log messages to stderr vor 4 Jahren
  JustAnotherArchivist ed1270d988 Add support for upper-cased chunk lengths vor 4 Jahren
  JustAnotherArchivist d4826abde2 Add record ID to log messages vor 4 Jahren
  JustAnotherArchivist 552a4147c2 Fix not returning complete body for non-chunked responses vor 4 Jahren
  JustAnotherArchivist f2e836d2e9 Add support for differently formatted digests vor 5 Jahren
  JustAnotherArchivist 94c4f76570 Fix crash when a digest is missing from a record vor 5 Jahren
  JustAnotherArchivist ef78a3318c Colour only the header field names but not the values vor 5 Jahren
  JustAnotherArchivist 9ce4653094 Document colouring and usage vor 5 Jahren
  JustAnotherArchivist e7c5d82254 Coloured WARCs?! vor 5 Jahren
  JustAnotherArchivist 70b413f5c1 Better events: include raw WARC header data and separate HTTP requests into headers and body vor 5 Jahren
  JustAnotherArchivist 641bc7a207 Fix infinite loop at end of WARC vor 5 Jahren
  JustAnotherArchivist 859c75a591 Add tool for WARC verification and extraction vor 5 Jahren