1142 Open source projects that are alternatives of or similar to Goribot

CoCrawler is a versatile web crawler built using modern tools and concurrency.

Your web font utility belt. It can subset web fonts. It can find unicode-ranges for you automatically. It makes julienne fries.

A utility package for automating lighthouse reporting

Xenomorph Crawler, a Concise, Declarative and Observable Distributed Crawler(Node / Go / Java / Rust) For Web, RDB, OS, also can act as a Monitor(with Prometheus) or ETL for Infrastructure 💫 多语言执行器，分布式爬虫

A powerful dynamic crawler for web vulnerability scanners

dynamic server-side rendering using headless Chrome to effortlessly solve the SEO problem for modern javascript websites

Scrapy pipeline to store chunked items into Amazon S3 or Google Cloud Storage bucket.

A Moodle downloader that downloads course content fast from Moodle (eg. lecture pdfs)

PHP Scraper - an highly opinionated web-interface for PHP

哔咔漫画收藏夹下载程序

🤖 微信订阅机器人 | 🐟 微信订阅机器人之闲鱼二手商品监控

Web Scraping Craigslist's Engineering Jobs in NY with Scrapy

comic updater, mangafied

Tangerine Bank scraper

Script that generates a sitemap by crawling a given URL

Some toolkits implements part of BT Protocol, like DHT spider.

create some tools use go lang.

Last-Statement-of-Death-Row, 人之将死，其言也善

🚕 Simple automation desktop app to download and organize your receipts from Uber/Lyft. Try out our new Ride Receipts PRO !

Intuitive timetable builder for the Australian National University.

一些爬虫的代码

Leetcode Contest Ranking Searcher

This package is a complete tool for creating a large dataset of images (specially designed -but not only- for machine learning enthusiasts). It can crawl the web, download images, rename / resize / covert the images and merge folders..

🐞 立马理财销售统计(爬虫+页面展示)

网易云爬虫解决方案

An Unofficial Pitchfork Music API client for Node.js

🐝 Web vertical crawler framework for fun

네이버 뉴스 수집을 위한 도구

抖音爬虫，tiktok crawler，抖音数据采集接口，抖音视频去水印，百分百成功，不需要服务器，不需要代理 IP。

netease-music-spider is a sipder that you can find beautiful girlfriend or handsome boyfriend.

Sample of using proxies to crawl baidu search results.

An Instagram Scrapper

a spider for cnki patent content, just for study and commucation, no use for business.

Get the lyrics for the song currently playing on Spotify

根据腾讯安全应急响应中心的架构编写的一款超强爬虫（广度优先搜索）

简单、易用、高效 一个有态度的开源.Net Http请求框架!可以用制作爬虫，api请求等等。

房价预测完整项目：1.爬取链家网数据 2.处理后，用sklearn中几个逻辑回归机器学习模型和keras神经网络搭建模型预测房价 最终结果神经网络效果更好，R^2值0.75左右

Pyppeteer integration for Scrapy

Backend para coleta e disponibilização dos dados 📜

基于NodeJS的基金数据爬虫，爬取的数据存于github的@nullpointer/fund-data。

依赖Scrapy和搜狗搜索微信公众号文章

使用Python3爬取煎蛋妹纸图片

Touhou Project random music video generator/player, crawling image and video from websites to generate MV.

java framework for prerender

Scrapy框架下的pixiv多功能爬虫

A Strong, Fast and Flexible Pixiv Client based on .NET Core and WPF

Viewers for statistics and dashboarding of Domain Search Engine data

Webscraper

Enjoy driving on a Javascriptive (originally Pythonic) way to Japanese AV!

Python爬虫和Flask实现小说网站

Kodi Bae Repository - Kodi is a registered trademark of the XBMC Foundation. We are not connected to or in any other way affiliated with Kodi - DMCA: [email protected]

Node.js seed downloader (Node.js 种子神器)

A instagram scraper wrote in python. Similar to instagram-php-scraper.Usages are in example.py. Enjoy it!

新浪微博爬虫，用python爬取新浪微博数据，并下载微博图片和微博视频

🌈Wenshu_Spider-Scrapy框架爬取中国裁判文书网案件数据(2019-1-9最新版)

Bitextor generates translation memories from multilingual websites.

Go process used to crawl websites

Tool to fetch Instagram's public content.

Shopify Scraper (not monitor)

ScraperWiki Python library for scraping and saving data