little-things

Аутор	SHA1	Порука	Датум
JustAnotherArchivist	d7a07d1d99	Normalise domain name to lower-case before further processing	пре 4 година
JustAnotherArchivist	e655080e20	Add support for Facebook /pages/category/Category/Name-ID URLs	пре 4 година
JustAnotherArchivist	daa1a95792	Proper URL decoding	пре 4 година
JustAnotherArchivist	1bee1cdcc7	Add support for Facebook /people/Name/ID URLs	пре 4 година
JustAnotherArchivist	00107c0ef0	Add support for YouTube /c/X URLs	пре 4 година
JustAnotherArchivist	b59b82041c	Add support for wiki list entries with options	пре 4 година
JustAnotherArchivist	d5953ca95c	Use old Opera UA for Twitter to force the old design	пре 4 година
JustAnotherArchivist	1fa57d41a3	Fix extraction on Wix sites from JSON inside a data attribute Example: https://www.martinedocourt.ch/	пре 4 година
JustAnotherArchivist	4a742162d0	Suppress output if there are no matched jobs	пре 4 година
JustAnotherArchivist	fe72d57d7e	Add filtering based on substrings anywhere in the string and on regex	пре 4 година
JustAnotherArchivist	cf30a53f82	Add case-insensitive filtering	пре 4 година
JustAnotherArchivist	711e444e8e	Highlight jobs that have been inactive for over 6 hours	пре 4 година
JustAnotherArchivist	b2919030ab	Fix sorting on numerical columns	пре 4 година
JustAnotherArchivist	257b578fbe	Add descending sort	пре 4 година
JustAnotherArchivist	6e7449d137	Support column names in any capitalisation	пре 4 година
JustAnotherArchivist	e5e7bdf8af	Add more filtering options	пре 4 година
JustAnotherArchivist	c611420be9	Remove options from usage line	пре 4 година
JustAnotherArchivist	824eb5e353	Add script for getting an AB job overview table	пре 4 година
JustAnotherArchivist	34c1a58034	Fix detection of multiple transfer encodings	пре 4 година
JustAnotherArchivist	195df08cd5	Fix marker loop on some filenames due to lacking HTML entity processing E.g. https://audio-market-dev.s3.amazonaws.com/?marker=media/23/Hard%20Style%20Producer	пре 4 година
JustAnotherArchivist	3cc3a1ed38	Fix nested tags E.g. <Owner> tag which has <ID> and <DisplayName>, e.g. https://appengage-video.s3.amazonaws.com/	пре 4 година
JustAnotherArchivist	5c907488e1	Handle broken pipe on stdout	пре 4 година
JustAnotherArchivist	b38349e91f	Fix duplicate slashes	пре 4 година
JustAnotherArchivist	f23e4cc71e	Retry on internal errors	пре 4 година
JustAnotherArchivist	bfe5f59e25	Add marker loop detection	пре 4 година
JustAnotherArchivist	66bdef3247	Take a bucket URL argument instead of hostname + bucketname	пре 4 година
JustAnotherArchivist	e385c1d302	Limit curl to 10 seconds	пре 4 година
JustAnotherArchivist	74162445aa	Replace curl-archivebot-ua with a more general curl-ua script that supports different UAs selected by aliases	пре 4 година
JustAnotherArchivist	9d712d64d7	Ignore certain URLs on Twitter and Instagram entirely	пре 4 година
JustAnotherArchivist	87826d4844	Use line variable instead of prefix+url	пре 4 година
JustAnotherArchivist	163aacf13c	Print deletion URL on stderr	пре 4 година
JustAnotherArchivist	486a593f15	Add support for more weird Facebook URLs	пре 4 година
JustAnotherArchivist	256a94443e	Fix deduplication within each section processing	пре 4 година
JustAnotherArchivist	98d77ecc96	Deduplicate output This uses mawk's extensions `-W interactive` and `delete array`; it will probably work with certain other AWK implementations as well, but for now it depends on mawk explicitly.	пре 4 година
JustAnotherArchivist	6ce64baf87	Remove redundant url-normalise after the extraction Since all input is run through url-normalise before processing and all output of website and social media extraction is also normalised, it's not necessary to re-normalise again at the end.	пре 4 година
JustAnotherArchivist	318183148e	Fix URL extraction from Facebook profile overview pages	пре 4 година
JustAnotherArchivist	869ade27eb	Separate names in stderr annotations for the various url-normalise processes	пре 4 година
JustAnotherArchivist	79f0bd4332	Normalise URLs everywhere to reduce duplicates	пре 4 година
JustAnotherArchivist	dc4efcfbfb	One URL normalisation script to rule them all Consolidate social media profile, YouTube, and (new) generic web page URL normalisation into one script	пре 4 година
JustAnotherArchivist	0f13a1fadd	Add verbosity options, and annotate stderr on wiki-recursive-extract	пре 4 година
JustAnotherArchivist	3ec816cd04	Add script for link extraction from social media profiles	пре 4 година
JustAnotherArchivist	5285c406d9	Add script for recursive website and social media discovery	пре 4 година
JustAnotherArchivist	2be9ca922e	Ignore more useless Facebook links	пре 4 година
JustAnotherArchivist	c3b0e5543e	Add support for facebook.com/pg/something	пре 4 година
JustAnotherArchivist	7c389f1fef	Add support for hashbang fragments on Twitter links	пре 4 година
JustAnotherArchivist	c56736bc4a	Ignore /intent on Twitter	пре 4 година
JustAnotherArchivist	4f34753788	Add support for Instagram posts and ignore spurious links from the CDN	пре 4 година
JustAnotherArchivist	ad030f5d21	Add support for Facebook pages and groups	пре 4 година
JustAnotherArchivist	cd0b3f6214	Ignore /vi/* on YouTube (video thumbnails)	пре 4 година
JustAnotherArchivist	6f1cca73ad	Support hashtags	пре 4 година

130 Комити (d7a07d1d9904b84059b61d781c79c1978a9d6fdc) All Branches Search

130 Комити (d7a07d1d9904b84059b61d781c79c1978a9d6fdc)

All Branches