Weblib Package Documentation

Weblib Package Status

[!] The weblib package is deprecated and is not maintained.

If you are looking for web scraping tools check out https://github.com/lorien/awesome-web-scraping

Telegram Web Scraping Community

You are welcome to join these Telegram groups for discussing any web scraping and crawling topics:

• Telegram English chat: https://t.me/grablab
• Telegram Russian chat: https://t.me/grablab_ru

Weblib Package Content

Weblib provides tools to solve typical tasks in web scraping:

• processing HTML
• handling text encodings
• controling repeating and parallel tasks
• parsing RSS/ATOM feeds
• preparing data for HTTP requests
• working with DOM tree
• working with text and numeral data
• list of common user agents
• cross-platform file locking
• operations with files and directories

Weblib Package Installation

Run:

    pip install -U weblib

Weblib Package Documentation

Docs are incomplete. Most of documentation is auto-generated from modules/methods docstrings.

Check out docs here weblib.readthedocs.org