653 Open source projects that are alternatives of or similar to Gecco

本仓库收集整理爬虫相关资源，开发语言以Java为主

A simple and flexible web crawler framework for java.

Android 本地网络小说爬虫，基于jsoup及xpath

Java 網路資料爬蟲包

A Kotlin-based testing/scraping/parsing library providing the ability to analyze and extract data from HTML (server & client-side rendered). It places particular emphasis on ease of use and a high level of readability by providing an intuitive DSL. It aims to be a testing lib, but can also be used to scrape websites in a convenient fashion.

新一代爬虫平台，以图形化方式定义爬虫流程，不写代码即可完成爬虫。

OWASP D4N155 - Intelligent and dynamic wordlist using OSINT

Vecty lets you build responsive and dynamic web frontends in Go using WebAssembly, competing with modern web frameworks like React & VueJS.

用 node.js 爬你自己的 leetcode 解题源码

Polite, slim and concurrent web crawler.

一款分布式爬虫平台，帮助你更好的管理和开发爬虫。 内置一套爬虫定义规则（模版），可使用模版快速定义爬虫，也可当作框架手动开发爬虫。(兴趣使然的项目，用的不爽了就更新)

Script that generates a sitemap by crawling a given URL

使用jsoup爬取樱花动漫部分内容编写的第三方Android客户端。

🎀 SuperTextView for Android 是一个在TextView的基础上扩展了几种动画效果的控件。

链家网和贝壳网房价爬虫，采集北京上海广州深圳等21个中国主要城市的房价数据（小区，二手房，出租房，新房），稳定可靠快速！支持csv,MySQL, MongoDB,Excel, json存储，支持Python2和3，图表展示数据，注释丰富 ，点星支持，仅供学习参考，请勿用于商业用途，后果自负。

Alternative for VK Audio API

疫情数据爬虫，2019新型冠状病毒数据仓库，轨迹数据，同乘数据，报道

An image crawler written in Python.

Cross Platform C# web crawler framework built for speed and flexibility. Please star this project! +1.

🚀 Plugin for Android Studio And IntelliJ Idea to generate Kotlin data class code from JSON text ( Json to Kotlin )

🌈 A simple plugin to dynamic change ant-design theme whether less or css.

An easy to use, powerful crawler implemented in PHP. Can execute Javascript.

A dynamic Web Map tile server

🕵️‍♂️ LinkedIn profile scraper returning structured profile data in JSON. Works in 2020.

Dynamic meta tags in your AngularJS single page application

📢 Ptt 文章通知機器人！Notify Ptt Article in Realtime

Crawl some picture for fun

네이버 뉴스 수집을 위한 도구

抖音爬虫，tiktok crawler，抖音数据采集接口，抖音视频去水印，百分百成功，不需要服务器，不需要代理 IP。

🐝 Web vertical crawler framework for fun

Bitextor generates translation memories from multilingual websites.

[DEPRECATED]

ScrapingOutsourcing专注分享爬虫代码 尽量每周更新一个

💐Marmot | Web Crawler/HTTP protocol Download Package 🐭

load and run golang code at runtime.

A library for dynamic view-to-view transitions

JS逆向研究

A simple distributed crawler for zhihu && data analysis

DownZemAll! is a download manager for Windows, MacOS and Linux

scrapes medias, likes, followers, tags and all metadata. Inspired by instagram-php-scraper,bot

Jsoup + MaterialViewPager + RxJava2 + Retrofit + Lifecycle + Realm + Fresco + Retrolambda example 一款Android图文精选app，通过抓取网页获得图文列表。目前包含猫弄（MONO）早午茶、站酷（Zcool）精选、国家地理（National Geographic）每日一图、知乎日报、豆瓣一刻（Moment）。

根据关键词抓取微博数据，再生成词云

🥄 A package for building specific Proxy Pool for different Sites.

Python爬虫实战 - 模拟登陆各大网站 包含但不限于：滑块验证、拼多多、美团、百度、bilibili、大众点评、淘宝，如果喜欢请start ❤️

Collection of China illegal cases about web crawler 本项目用来整理所有中国大陆爬虫开发者涉诉与违规相关的新闻、资料与法律法规。致力于帮助在中国大陆工作的爬虫行业从业者了解我国相关法律，避免触碰数据合规红线。 [AD]中文知识图谱门户

A lite distributed Java spider framework :-)

Crawler for LinkedIn full profiles 2019

The C# REST Client - the only REST/ HTTP Client you will ever need

🥚 Netty实践学习案例，见微知著！带着你的心，跟着教程。我相信你行欧。

🌘 The Dynamic_Walls scripts replicating macOS Mojave's dynamic wallpaper feature combined into an app

🕷️ A node crawler for github trending.

2019新型冠状病毒疫情实时爬虫及API | COVID-19/2019-nCoV Realtime Infection Crawler and API

A Simple Blog Powered by Flask

Python爬虫代理IP池(proxy pool)

CoCrawler is a versatile web crawler built using modern tools and concurrency.

Desktop that changes based on weather & time

A cross platform UI crawler which scans view trees then generate and execute UI test cases.

美观、漂亮，我抽离出来的，拿来即用的简单后台管理系统！

dynamic server-side rendering using headless Chrome to effortlessly solve the SEO problem for modern javascript websites