archiving community contributions on YouTube: unpublished captions, title and description translations and caption credits

tech234a ede8c81927 Add shutdown notification and username sending		pirms 3 gadiem
.gitignore	Update gitignore	pirms 3 gadiem
Dockerfile	Added Dockerfile written by Fusl	pirms 3 gadiem
README.md	Add notice about project completion	pirms 3 gadiem
config.json	Allow specifying TRACKER_USERNAME in config.json	pirms 3 gadiem
discovery.py	Disable credit retrieval	pirms 3 gadiem
export.py	More robust rate limit check	pirms 3 gadiem
requirements.txt	Implement TRACKER_USERNAME support	pirms 3 gadiem
tracker.py	Update version	pirms 3 gadiem
worker.py	Add shutdown notification and username sending	pirms 3 gadiem
youtube_channel.py	youtube-util: Bug fix	pirms 3 gadiem
youtube_util.py	Update default API version	pirms 3 gadiem

README.md

YouTube Community Contributions Archiving Worker

This project is now complete, and we are working on sorting and finalizing the data. Thank you to everyone who contributed!

Worker for the Save Community Captions project: Archiving unpublished YouTube community-contributions.

Lost? Click here to learn what this is all about!

Current Stats

See how much has been archived so far.

Setup

To run these tools you will need to supply session cookies (SSID,HSID,SID) see the tutorial for more details.

Primary Usage

Heroku⭐️⭐️⭐️ (Minimal Setup! Minimal Maintenance!)

A wrapper repo for free and easy deployment and environment configuration, as well automatic updates every 24-27.6 hours is available. Deploy up to 5 instances of it to a free Heroku account (total max monthly runtime 550 hours) with no need for credit card verification by clicking the button below.

Archiving Worker⭐️

After completing the above setup steps, simply run

python3 worker.py

Docker image⭐️⭐️

Stable Docker Image:

docker pull fusl/ytcc-archive

Run:

docker container run --restart=unless-stopped --network=host -d --tmpfs /grab/out --name=grab_ext-yt-communitycontribs -e HSID=XXX-e SID=XXX -e SSID=XXX -e TRACKER_USERNAME=Fusl -e PYTHONUNBUFFERED=1 fusl/ytcc-archive

Bonus Features

Export Captions and Titles/Descriptions Manually

This feature requires an older version of export.py. Get this file, Python 3, and the requests module (pip install requests). Then, simply run python3 exporter.py followed by a list of space-separated YouTube video IDs, and all community-contributed captioning and titles/descriptions in all languages will be exported.

Discover Videos Manually

Simply run python3 discovery.py followed by a list of space-separated YouTube video IDs and a list of discovered video, channel and playlist IDs will be printed, as well as whether caption contributions are enabled.