wayback
Wayback is A Python API to the Internet Archive’s Wayback Machine. It gives you tools to search for and load mementos (historical copies of web pages).
The Internet Archive maintains an official “internetarchive” Python package, but it does not focus on the Wayback Machine. Instead, it is mainly concerned with the APIs and tools that manage the Internet Archive as a whole: managing items and collections. These are how e-books, audio recordings, movies, and other content in the Internet Archive are managed. It doesn’t, however, provide particularly good tools for finding or loading historical captures of specific URLs (i.e. the part of the Internet Archive called the “Wayback Machine”). That’s what this package does.
- Documentation:
- Current Release: https://wayback.readthedocs.io/en/stable/
- Development: https://wayback.readthedocs.io/en/latest/
Installation & Basic Usage
Install via pip on the command line:
$ pip install wayback
Then, in a Python script, import it and create a client:
import wayback
client = wayback.WaybackClient()Finally, search for all the mementos of nasa.gov before 1999 and download them:
for record in client.search('http://nasa.gov', to_date=date(1999, 1, 1)):
memento = client.get_memento(record)Read the full documentation for a more in-depth tutorial and complete API reference documentation at https://wayback.readthedocs.io/
Code of Conduct
This repository falls under EDGI’s Code of Conduct. Please take a moment to review it before commenting on or creating issues and pull requests.
Contributors
Thanks to the following people for their contributions and help on this package! See our contributing guidelines to find out how you can help.
- Dan Allan (Code, Tests, Documentation, Reviews)
- Rob Brackett (Code, Tests, Documentation, Reviews)
- Will Sackfield (Code, Tests)
- Ed Summers (Code, Tests)
- Lion Szlagowski (Code, Tests)
License & Copyright
Copyright (C) 2019-2022 Environmental Data and Governance Initiative (EDGI)
This program is free software: you can redistribute it and/or modify it under the terms of the 3-Clause BSD License. See the LICENSE file for details.