All Projects → netcan → MyCrawler

netcan / MyCrawler

Licence: GPL-3.0 License
我的爬虫合集

Programming Languages

python
139335 projects - #7 most used programming language
PHP
23972 projects - #3 most used programming language
shell
77523 projects

Projects that are alternatives of or similar to MyCrawler

Colly
Elegant Scraper and Crawler Framework for Golang
Stars: ✭ 15,535 (+28145.45%)
Mutual labels:  crawler, scraper
Goose Parser
Universal scrapping tool, which allows you to extract data using multiple environments
Stars: ✭ 211 (+283.64%)
Mutual labels:  crawler, scraper
Tianyancha
pip安装的天眼查爬虫API,指定的单个/多个企业工商信息一键保存为Excel/JSON格式。A Battery-included Scraper API of Tianyancha, the best Chinese business data and investigation platform.
Stars: ✭ 206 (+274.55%)
Mutual labels:  crawler, scraper
Jvppeteer
Headless Chrome For Java (Java 爬虫)
Stars: ✭ 193 (+250.91%)
Mutual labels:  crawler, scraper
Polite
Be nice on the web
Stars: ✭ 253 (+360%)
Mutual labels:  crawler, scraper
Querylist
🕷️ The progressive PHP crawler framework! 优雅的渐进式PHP采集框架。
Stars: ✭ 2,392 (+4249.09%)
Mutual labels:  crawler, scraper
dijnet-bot
Az összes számlád még egy helyen :)
Stars: ✭ 17 (-69.09%)
Mutual labels:  crawler, scraper
Datmusic Api
Alternative for VK Audio API
Stars: ✭ 160 (+190.91%)
Mutual labels:  crawler, scraper
Skrape.it
A Kotlin-based testing/scraping/parsing library providing the ability to analyze and extract data from HTML (server & client-side rendered). It places particular emphasis on ease of use and a high level of readability by providing an intuitive DSL. It aims to be a testing lib, but can also be used to scrape websites in a convenient fashion.
Stars: ✭ 231 (+320%)
Mutual labels:  crawler, scraper
Annie
👾 Fast and simple video download library and CLI tool written in Go
Stars: ✭ 16,369 (+29661.82%)
Mutual labels:  crawler, scraper
Goribot
[Crawler/Scraper for Golang]🕷A lightweight distributed friendly Golang crawler framework.一个轻量的分布式友好的 Golang 爬虫框架。
Stars: ✭ 190 (+245.45%)
Mutual labels:  crawler, scraper
arachnod
High performance crawler for Nodejs
Stars: ✭ 17 (-69.09%)
Mutual labels:  crawler, scraper
Instagram Crawler
Crawl instagram photos, posts and videos for download.
Stars: ✭ 178 (+223.64%)
Mutual labels:  crawler, scraper
bots-zoo
No description or website provided.
Stars: ✭ 59 (+7.27%)
Mutual labels:  crawler, scraper
Linkedin Profile Scraper
🕵️‍♂️ LinkedIn profile scraper returning structured profile data in JSON. Works in 2020.
Stars: ✭ 171 (+210.91%)
Mutual labels:  crawler, scraper
Media Scraper
Scrapes all photos and videos in a web page / Instagram / Twitter / Tumblr / Reddit / pixiv / TikTok
Stars: ✭ 206 (+274.55%)
Mutual labels:  crawler, scraper
Youtube Projects
This repository contains all the code I use in my YouTube tutorials.
Stars: ✭ 144 (+161.82%)
Mutual labels:  crawler, scraper
Instagram Scraper
scrapes medias, likes, followers, tags and all metadata. Inspired by instagram-php-scraper,bot
Stars: ✭ 2,209 (+3916.36%)
Mutual labels:  crawler, scraper
Ruiji.net
crawler framework, distributed crawler extractor
Stars: ✭ 220 (+300%)
Mutual labels:  crawler, scraper
papercut
Papercut is a scraping/crawling library for Node.js built on top of JSDOM. It provides basic selector features together with features like Page Caching and Geosearch.
Stars: ✭ 15 (-72.73%)
Mutual labels:  crawler, scraper

MyCrawler

我的爬虫合集

  • QQ空间爬虫
  • 合肥工业大学思政题库爬虫
Note that the project description data, including the texts, logos, images, and/or trademarks, for each open source project belongs to its rightful owner. If you wish to add or remove any projects, please contact us at [email protected].