Top 10 warc open source projects

Heritrix is the Internet Archive's open-source, extensible, web-scale, archival-quality web crawler project.

🗃 Open source self-hosted web archiving. Takes URLs/browser history/bookmarks/Pocket/Pinboard/etc., saves HTML, JS, PDFs, media, and more...

⚙️ A Rust library for reading and writing WARC files

Parse And Create Web ARChive (WARC) files with node.js

📇 Tools to Work with the Web Archive Ecosystem in R

Read Web ARChive (WARC) files in PHP.

Wget-AT is a modern Wget with Lua hooks, Zstandard (+dictionary) WARC compression and URL-agnostic deduplication.

🐋 One-Click User Instigated Preservation

A small tool which uses the CommonCrawl URL Index to download documents with certain file types or mime-types. This is used for mass-testing of frameworks like Apache POI and Apache Tika

A robust web archive analytics toolkit