The little things give you away... A collection of various small helper stuff
Vous ne pouvez pas sélectionner plus de 25 sujets Les noms de sujets doivent commencer par une lettre ou un nombre, peuvent contenir des tirets ('-') et peuvent comporter jusqu'à 35 caractères.
 
 
 
JustAnotherArchivist 0000d8ffd9 Add script to queue derive on IA il y a 5 ans
LICENSE Initial commit il y a 5 ans
README.md Initial commit il y a 5 ans
archivebot-high-memory First set of little things il y a 5 ans
archivebot-list-stuck-requests Fix line endings il y a 5 ans
archivebot-monitor-job-queue First set of little things il y a 5 ans
bing-scrape Add Bing, Reddit/Pushshift, and FoolFuuka scrapers il y a 5 ans
curl-archivebot-ua curl with ArchiveBot UA il y a 5 ans
foolfuuka-search Better workaround for the 5000 results limit; works for FoolFuuka 2.0.1 and up il y a 5 ans
format-size Split out size formatting il y a 5 ans
fos-ftp-upload First set of little things il y a 5 ans
get-crx4chrome-urls First set of little things il y a 5 ans
ia-derive Add script to queue derive on IA il y a 5 ans
ia-upload-progress Proper script for tracking size of uploaded data il y a 5 ans
iasha1check First set of little things il y a 5 ans
ix.io-upload Allow overriding the "remote filename" il y a 5 ans
killcx-all-https First set of little things il y a 5 ans
mastodon-outdated Finding outdated Mastodon instances il y a 5 ans
pipelines-launch-in-tmux-windows First set of little things il y a 5 ans
pipelines-monitor-tmux-wget-outcomes Monitor how a pipeline's wget processes are faring il y a 5 ans
pipelines-stop-gracefully First set of little things il y a 5 ans
reddit-pushshift-search Add Bing, Reddit/Pushshift, and FoolFuuka scrapers il y a 5 ans
run-every-five-minutes First set of little things il y a 5 ans
snscrape-extract-usernames Further helper scripts for snscrape: normalising usernames and extracting them from a list of URLs il y a 5 ans
snscrape-facebook-user Get rid of post-processing now that snscrape (dev version) has clean URLs il y a 5 ans
snscrape-instagram-user Instagram always uses lower-case usernames il y a 5 ans
snscrape-normalise Further helper scripts for snscrape: normalising usernames and extracting them from a list of URLs il y a 5 ans
snscrape-twitter-filter Filter Twitter hashtag scrapes based on account scrapes il y a 5 ans
snscrape-twitter-hashtag Add snscrape helpers il y a 5 ans
snscrape-twitter-user Automatically fix capitalisation of Facebook and Twitter usernames il y a 5 ans
snscrape-upload Helper tools for snscrape and the wiki pages il y a 5 ans
snscrape-vk-user Add VK scraping helper il y a 5 ans
snscrape-wiki-transfer-merge Helper tools for snscrape and the wiki pages il y a 5 ans
tar-many-files-progress First set of little things il y a 5 ans
tcp-closer Add tcp-closer command il y a 5 ans
transfer.notkiska.pw-upload Replace urlencoded @ symbol il y a 5 ans
uniqify Add uniqify il y a 5 ans
warc-size Split out size formatting il y a 5 ans
warc-tiny Add support for differently formatted digests il y a 5 ans
wget-spider-estimate-size First set of little things il y a 5 ans
wpull1-parallel-progress-monitor First set of little things il y a 5 ans
wpull1-progress-monitor First set of little things il y a 5 ans
wpull2-url-origin Fixed version which handles multiple roots correctly il y a 5 ans

README.md

Over the past few years, I’ve written and accumulated a number of useful little things to help with archival-related tasks. This repository collects them. I hope someone finds some of them useful.

License (applies to all programs in this repository)

This program is free software: you can redistribute it and/or modify it under the terms of the GNU General Public License as published by the Free Software Foundation, either version 3 of the License, or (at your option) any later version.

This program is distributed in the hope that it will be useful, but WITHOUT ANY WARRANTY; without even the implied warranty of MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the GNU General Public License for more details.

You should have received a copy of the GNU General Public License along with this program. If not, see https://www.gnu.org/licenses/.