1046 Open source projects that are alternatives of or similar to Ghcrawler

疫情数据爬虫，2019新型冠状病毒数据仓库，轨迹数据，同乘数据，报道

中国大陆大学列表爬虫

用严肃的数据来回答“什么样的企业会到什么样的大学招聘”？

scrapy专利爬虫（停止维护）

pip安装的天眼查爬虫API，指定的单个/多个企业工商信息一键保存为Excel/JSON格式。A Battery-included Scraper API of Tianyancha, the best Chinese business data and investigation platform.

GitHub on your command line. Use your terminal, not the browser.

Quran JSON ~ 6236 verses, 114 surah, 30 Juz

磁力網站U3C3介紹以及域名更新

Update Version of weibo_terminator, This is Workflow Version aim at Get Job Done!

爬蟲極簡教學（fetch, parse, search, multiprocessing, API）- PTT 為例

Data Science Hacks consists of tips, tricks to help you become a better data scientist. Data science hacks are for all - beginner to advanced. Data science hacks consist of python, jupyter notebook, pandas hacks and so on.

All the Fake Data for All Your Real Needs 🙂

line-bot-tutorial use python flask

DotnetSpider, a .NET standard web crawling library. It is lightweight, efficient and fast high-level web crawling & scraping framework

Typed struct and value objects

Lightweight, simple structured NoSQL database for Android

[Temporarily unavailable]The node version of github-profile-summary with GraphQL

[WIP] GOPA, a spider written in Golang, for Elasticsearch. DEMO: http://index.elasticsearch.cn

The simple, easy to use command line web crawler.

This repository helps you understand python from the scratch.

🏁 API client for Kaggle

An R web crawler and scraper

Identify bias and measure fairness of your data

A fast tool to fetch URLs from HTML attributes by crawl-in.

A GitHub action to create a repository dispatch event

模拟登录各类网站，操作 API 完成各种不可描述的事情

Web Application Security Scanner Framework

Main yt repository

Platform to connect contributors and projects based on skill level and shared interests.

golang实现的爬虫框架，使用者只需关心页面规则，提供web管理界面。基于colly开发。

Immutable and structurally typed data

CKAN is an open-source DMS (data management system) for powering data hubs and data portals. CKAN makes it easy to publish, share and use data. It powers catalog.data.gov, open.canada.ca/data, data.humdata.org among many other sites.

A React web application to query and share any PostgreSQL database.

Browser extension to view GitHub trending projects on new tab 📈

A simple, easy to use data modeling framework for JavaScript

📰 A responsive interface of Hacker News with summaries and thumbnails.

GitHub client for Android based on the abandoned official app

約100年に渡るアニメ作品リストデータベース

This is a Multi-thread crawler for Tumblr.

Introduction to Data Science: A Python Approach to Concepts, Techniques and Applications

🍬 A tiny library converting excel rows to a list of Java objects based on Apache POI

Simple yet powerful automation stuffs.

🍭 epub generator for (light)novels (轻) 小说 epub 生成器，支持站点：轻之国度、轻小说文库

Easily create XML sitemaps for your website.

A GitHub Protocol & API emulation

A library designed to diff and patch Clojure data structures

Data visualization application showing all BTC transactions in real-time

🌹 Making GitHub more socially engaging 🎮 and fun 🍥 for all

Recursive and multi-threaded broken link checker

Android library to create beautiful surveys (aligned with ResearchKit on iOS)

A backup solution and data migration utility for Android

Really quickly build APKs on handheld device (smartphone and tablet) in Amazon, Android, Chromebook, PRoot and Windows📲 See https://buildapks.github.io/docsBuildAPKs/setup to start building APKs.

文献下载助手(ArticelsHelper) 基线拉平程序(Baseline Alignment) Q-PCR数据处理(Q-PCR Data)

我的爬虫合集

Crawlera middleware for Scrapy

A demo project based on MVVM architecture and material design & animations.

Simple Weibo Scraper

Quizzes & Assignment Solutions for Google Data Analytics Professional Certificate on Coursera. Also included a few resources on side that I found helpful.

🌀 JS standard CRC-32 implementation