202 Open source projects that are alternatives of or similar to Web-crawler-engineer-for-Python

爬虫学习仓库，适合零基础的人学习，对新手比较友好

利昂图书馆预约系统自动预约&签到程序。支持包括中国人民大学、北京师范大学、济南大学、哈尔滨工业大学等在内的38所高校的图书馆系统

HomeAssistant HeWeather Plugin

微博话题关键词,个人微博采集, 微博博文一键删除 selenium获取cookie,requests处理

Unofficial client to access your Itaú bank data

🍳 apiron is a Python package that helps you cook a tasty client for RESTful APIs. Just don't wash it with SOAP.

Python SDK for Magickartenmarkt API

A Reddit bot that generates new context-aware comments using Markov chains trained from a set of given users or subreddits comments history.

A Python module to use the Tesla Motors Owner API

fetch ⭐️caching ⭐️deduplication

http requests lib for golang

Async wrapper for requests / aiohttp, and some crawler toolkits. Let synchronization code enjoy the performance of asynchronous programming.

A webserver plugin for cordova

Learn how to find and work with locations in Django, the Yelp API, and Google Maps api.

Pacote Python para acesso a dados abertos e APIs do governo brasileiro.

Data ETL & Analysis on the global and Mexican datasets of the COVID-19 pandemic.

☕🗄CAching Proxy in Python – Simple file based python http proxy

🔗 a CLI app can send pretty HTTP & API requests with TUI

Simple cURL C++17 wrapper

百度贴吧生日爬虫，可抓取贴吧内吧友生日，并且在对应日期自动发送祝福

A python wrapper for Indian Railways Enquiry API!

Template for downloading segmented video (.m3u8/.ts) from streaming websites

cp-tool is an auto generator for solved problems at different online judges.

An async persistent cache for aiohttp requests

An easy command line interface for the 2018 World Cup

Speed up your remote requests by automatically caching them on client and add support for offline navigation.

Web scraping using python, requests and selenium

daily report of @ARKInvest ETF activity + data collection

This email crawler will visit all pages of a provided website and parse and save emails found to a csv file.

An image scraper that scraps images from unsplash.com

requests+lxml爬虫，简单爬虫架构

Pacote para baixar os dados do portal de dados abertos da UFRN

Python3爬虫系列的理论验证，首先研究I/O模型，分别用Python实现了blocking I/O、nonblocking I/O、I/O multiplexing各模型下的TCP服务端和客户端。然后，研究同步I/O操作（依序下载、多进程并发、多线程并发）和异步I/O（asyncio）之间的效率差别

(TR) 4 saatlik Python başlangıç atölyesinin içerik dokümanı. (EN version is in progress!)

Methods for working with the GitHub Gist API. Node.js/JavaScript

Python package to download files on any topic in bulk.

C++ Requests: Curl for People, a spiritual port of Python Requests.

Peanuts is a free and open source wifi tracking tool. Based on the SensePosts Snoopy-NG project that is now closed.

NSE Nifty Option chain analysis on the web page.

Python Script to Scrape Pastebin with Regex

usim800 is a Python driver module for SIM800 GSM/GPRS .

REST API calls made easier

The sigarra scraping library no one asked for

Apple CloudKit Python library.

Aplicação para registo e acompanhamento de encomendas da CTT Expresso, automatiza a consulta online do estado de tracking para várias remessas e mantém um registo dos pagamentos referentes aos envios à cobrança. As remessas que requerem atenção, devido a atrasos na entrega ou na receção do pagamento correspondente, bem como os cheques cuja data …

Repository for tracking module requests

dnevnik.ru parser

Code examples and slides from my 2021 talk Server-Side is Dead! Long Live Server-Side (+ HTMX), presented at DjangoCon and Code Code Code

show full stack technology applications : Scrapy + webservice[restful] + websocket + VueJS + MongoDB

💵 Free & open source API service for current and historical foreign exchange rates.

Anime streaming without ads using Beautifulsoup and requests Python

python编写的爬虫代理ip池

Real-time cryptocurrencies prices.

Script using requests module to register accounts to Slam Jam Socialism raffles.

R interface to Python requests module

📷 web scrapping in python: multiple libraries -requests, beautifulsoup, mechanize, selenium

surfstudio.github.io/nodekit

Asynchronous Library made using Python and aiohttp to get proxies from multiple services!

收集各种免费的 Python 爬虫项目

Monitors for restocks