824 Open source projects that are alternatives of or similar to Arachnid

A Tumblr Backup Application

🕷️ A node crawler for github trending.

以Node.js基于express以及爬虫实现的视频资源后端

Statamic Peak is an opinionated starter kit for all your Statamic sites.

Lightweight package to query popular search engines and scrape for result titles, links and descriptions

京东口罩库存监控爬虫(非selenium)，扫码登录、查价、加购、下单、秒杀

Getting started with Puppeteer and Chrome Headless for Web Scraping

[Crawler/Scraper for Golang]🕷A lightweight distributed friendly Golang crawler framework.一个轻量的分布式友好的 Golang 爬虫框架。

Python爬虫实战 - 模拟登陆各大网站 包含但不限于：滑块验证、拼多多、美团、百度、bilibili、大众点评、淘宝，如果喜欢请start ❤️

抖音爬虫，tiktok crawler，抖音数据采集接口，抖音视频去水印，百分百成功，不需要服务器，不需要代理 IP。

SEO utilities including a unique field type, sitemap & redirect manager

Bitextor generates translation memories from multilingual websites.

🍿爬虫代理IP池(proxy pool) python🍟一个还ok的IP代理池

Python Lambda Chrome Automation (naming pending)

Polite, slim and concurrent web crawler.

Headless Chrome For Java （Java 爬虫）

JS逆向研究

Scrapes all photos and videos in a web page / Instagram / Twitter / Tumblr / Reddit / pixiv / TikTok

Pythonic HTML Parsing for Humans™

Seo Manager Package for Laravel ( with Localization )

DownZemAll! is a download manager for Windows, MacOS and Linux

📋 A simple website launch checklist to keep track of the most important enrichment possibilities for a website.

scrapes medias, likes, followers, tags and all metadata. Inspired by instagram-php-scraper,bot

Anime-dl is a command-line program to download anime from CrunchyRoll and Funimation.

Extract data or evaluate value from HTML/XML documents using XPath

Easy to use lightweight web crawler（易用的轻量化网络爬虫）

📢 Ptt 文章通知機器人！Notify Ptt Article in Realtime

crawler framework, distributed crawler extractor

💐Marmot | Web Crawler/HTTP protocol Download Package 🐭

CoCrawler is a versatile web crawler built using modern tools and concurrency.

A lite distributed Java spider framework :-)

SEO Tools for Laravel

2019新型冠状病毒疫情实时爬虫及API | COVID-19/2019-nCoV Realtime Infection Crawler and API

Transistor, a Python web scraping framework for intelligent use cases.

An image crawler written in Python.

Pick the most common user-agents on the Internet 👻

PHP Scraper - an highly opinionated web-interface for PHP

基于react(ssr)服务端框架next.js和antd-design搭建的个人博客

Simple news aggregator displaying top stories in real time

基于 Selenium 的知乎关键词爬虫

一些爬虫的代码

简单、易用、高效 一个有态度的开源.Net Http请求框架!可以用制作爬虫，api请求等等。

🐝 Web vertical crawler framework for fun

Touhou Project random music video generator/player, crawling image and video from websites to generate MV.

Enjoy driving on a Javascriptive (originally Pythonic) way to Japanese AV!

A browser testing and web crawling library for PHP and Symfony

链家网和贝壳网房价爬虫，采集北京上海广州深圳等21个中国主要城市的房价数据（小区，二手房，出租房，新房），稳定可靠快速！支持csv,MySQL, MongoDB,Excel, json存储，支持Python2和3，图表展示数据，注释丰富 ，点星支持，仅供学习参考，请勿用于商业用途，后果自负。

Go process used to crawl websites

由Python编写的全异步实现的动漫之家(dmzj)漫画批量下载器（爬虫）

A simple distributed crawler for zhihu && data analysis

Scraping statistics, predicting NBA player performance with neural networks and boosting algorithms, and optimising lineups for Draft Kings with genetic algorithm. Capstone Project for Machine Learning Engineer Nanodegree by Udacity.

data resource untuk NLP bahasa indonesia

Mirror of Asqatasun ---> we've moved to GITLAB https://gitlab.com/asqatasun/Asqatasun - Opensource web site analyser, used for web accessibility "a11y"

Web crawler.

JavaScript + BeautifulSoup = JSSoup

Collection of China illegal cases about web crawler 本项目用来整理所有中国大陆爬虫开发者涉诉与违规相关的新闻、资料与法律法规。致力于帮助在中国大陆工作的爬虫行业从业者了解我国相关法律，避免触碰数据合规红线。 [AD]中文知识图谱门户

🔥 Shadowsocks 账号爬虫

Simple Query Scraping with CSS and Go Reflection (MOVED to Gitlab)

GitHub Action for running @GoogleChromeLabs Lighthouse audits with all the bells and whistles 🔔 Multiple audits, Slack notifications, and more!

This repository contains all the code I use in my YouTube tutorials.