1124 Open source projects that are alternatives of or similar to python-crawler

python爬虫

《数据采集从入门到放弃》源码。内容简介：爬虫介绍、就业情况、爬虫工程师面试题 ；HTTP协议介绍； Requests使用 ；解析器Xpath介绍； MongoDB与MySQL； 多线程爬虫； Scrapy介绍 ；Scrapy-redis介绍； 使用docker部署； 使用nomad管理docker集群； 使用EFK查询docker日志

豆瓣电影top250、斗鱼爬取json数据以及爬取美女图片、淘宝、有缘、CrawlSpider爬取红娘网相亲人的部分基本信息以及红娘网分布式爬取和存储redis、爬虫小demo、Selenium、爬取多点、django开发接口、爬取有缘网信息、模拟知乎登录、模拟github登录、模拟图虫网登录、爬取多点商城整站数据、爬取微信公众号历史文章、爬取微信群或者微信好友分享的文章、itchat监听指定微信公众号分享的文章

An image scraper that scraps images from unsplash.com

🚀电商网站爬虫合集，淘宝京东亚马逊等

微博话题关键词,个人微博采集, 微博博文一键删除 selenium获取cookie,requests处理

Code for the second edition Web Scraping with Python book by Packt Publications

Python爬虫实战 - 模拟登陆各大网站 包含但不限于：滑块验证、拼多多、美团、百度、bilibili、大众点评、淘宝，如果喜欢请start ❤️

Simple but useful Python web scraping tutorial code.

🏀 Python3 网络爬虫实战（部分含详细教程）猫眼 腾讯视频 豆瓣 研招网 微博 笔趣阁小说 百度热点 B站 CSDN 网易云阅读 阿里文学 百度股票 今日头条 微信公众号 网易云音乐 拉勾 有道 unsplash 实习僧 汽车之家 英雄联盟盒子 大众点评 链家 LPL赛程 台风 梦幻西游、阴阳师藏宝阁 天气 牛客网 百度文库 睡前故事 知乎 Wish

📷 web scrapping in python: multiple libraries -requests, beautifulsoup, mechanize, selenium

An open source webapp for scraping: towards a public service for webscraping

Build and deploy a machine learning app from scratch 🚀

ScrapingOutsourcing专注分享爬虫代码 尽量每周更新一个

Analysis of the characteristics of different countries

Pythonic HTML Parsing for Humans™

An example using Selenium webdrivers for python and Scrapy framework to create a web scraper to crawl an ASP site

收集各种免费的 Python 爬虫项目

Python入门网络爬虫之精华版

京东商品价格监控：监控用户设定商品价格，降价邮件/微信提醒。技术：Python爬虫/IP代理池/JS接口爬取/Selenium页面爬取

Simple and friendly Bot for Instagram, using Selenium and Scrapy with Python.

Script using requests module to register accounts to Slam Jam Socialism raffles.

Scrapy middleware to handle javascript pages using selenium

小密圈备份，圈子/话题/图片/文件。

Integration layer between Requests and Selenium for automation of web actions.

AutoLink是一个开源Web IDE自动化测试集成解决方案

With Selenium headless browsing and CAPTCHA solving

《Python爬虫开发 从入门到实战》配套源代码。

一些非常有趣的python爬虫例子,对新手比较友好,主要爬取淘宝、天猫、微信、豆瓣、QQ等网站。(Some interesting examples of python crawlers that are friendly to beginners. )

show full stack technology applications : Scrapy + webservice[restful] + websocket + VueJS + MongoDB

AlipaySpider on Scrapy(use chrome driver); 支付宝爬虫(基于Scrapy)

Automation for Kivy Application

A Python module to use the Tesla Motors Owner API

usim800 is a Python driver module for SIM800 GSM/GPRS .

Keep track of jobs you've applied to, automate resume & cover letter creation; generate PDFs from .odt templates on the fly while scraping the job post and tracking employer status.

Simon is a Python library that helps made easy the browser automation for WhatsApp Web service

No description or website provided.

Using Scrapy to crawl Autohome, storage into MonogDB, simple analysis and NLP coming soon

A test harness that allows Selenium tests to be run using JUnit and test fixtures to be created and injected by a WebDriver-aware Guice

Web.whatsapp.com bot made with selenium

Comparing FC VAE / FCN VAE / PCA / UMAP on MNIST / FMNIST

Most simple Elixir wrapper for xmerl xpath

Automate the process of sending referral request and cold mailing on LinkedIn

Python Program To Send Instagram Story Views

Data ETL & Analysis on the global and Mexican datasets of the COVID-19 pandemic.

Python SDK for Magickartenmarkt API

A simple automation script that logs into your kra account and files your taxes with one command

利昂图书馆预约系统自动预约&签到程序。支持包括中国人民大学、北京师范大学、济南大学、哈尔滨工业大学等在内的38所高校的图书馆系统

No description or website provided.

This project is a finite state machine designed to be used in games.

Python分布式爬虫打造搜索引擎

A library to read a YML file with Xpath or CSS Selectors and extract data from HTML pages using them

Automatische Impfterminbuchung für www.impfterminservice.de

It is almost spring, so time for a pre spring cleaning. This time: taking care of your Facebook. This script can safe you a lot of time if you would try to do that by hand.

📷 Instagram Bot - Tool for automated Instagram interactions

Complete Python Appium framework in 360 degree

NSE Nifty Option chain analysis on the web page.

基于asyncio与aiohttp的异步协程爬虫框架 欢迎Star

👍 京东爬虫（大量注释，对刚入门爬虫者极度友好）

AssetUpdater is a Unity plugin which helps developers build assetbundles and download it easily