1218 Open source projects that are alternatives of or similar to Work_crawler

Learn Python Regular Expressions step by step from beginner to advanced levels

🚀 A fast and lightweight utility and Python library for downloading posts, stories, and highlights from Instagram.

SecStory (Security Story) adalah buku digital yang berisi kumpulan donasi cerita, ditulis oleh para pemangku kepentingan keamanan siber di Indonesia.

Simple notebook to stream torrent files to Google Drive using Google Colab and python3.

vulnx 🕷️ is an intelligent bot auto shell injector that detect vulnerabilities in multiple types of cms { `wordpress , joomla , drupal , prestashop .. `}

🐾 Creeper - The Next Generation Crawler Framework (Go)

A simple and flexible web crawler that follows the robots.txt policies and crawl delays.

A Facebook crawler

Youtube and Spotify music downloader with metadata.

The Prime Cross Site Request Forgery (CSRF) Audit and Exploitation Toolkit.

自学入门 Python 优质中文资源索引，包含 书籍 / 文档 / 视频，适用于 爬虫 / Web / 数据分析 / 机器学习 方向

支援 PTT 還有 PTT2 的 PTT API

[DEPRECATED] Simple, flexible, delightful web crawler/spider package

💖 High available distributed ip proxy pool, powerd by Scrapy and Redis

📘 电子书 -《Real-Time Rendering 3rd》提炼总结 | 全书共9万7千余字。你可以把它看做中文通俗版的《Real-Time Rendering 3rd》，也可以把它看做《Real-Time Rendering 3rd》的解读版与配套学习伴侣，或者《Real-Time Rendering 4th》的前置阅读材料。

Scrapes Reddit to download media of your choice.

抖音爬虫. 通过手机代理爬取用户的作品和用户的喜欢

🐍 Syntax, working with Shell commands, Files, Text Processing, and more...

Ebook: Module developer's guide to FreeCAD 's source code

a new crawler based on python with more function including Network fingerprint search

🐞简单轻便的Java爬虫框架，只要会一点简单的正则表达式和简单的css选择器就能轻松的采集数据。

PyTorch tutorials and best practices.

Very customizable imageboard/booru downloader with powerful filenaming features.

因为ehviewer近一年多没更新了，所以想copy过来试着更新下

A collection of awesome web crawler,spider in different languages

ReadMarvel's open sourced code

Open multi-site list manager for Unix-like systems. (ex-wMAL)

A PHP library to read and write EPub meta data

用严肃的数据来回答“什么样的企业会到什么样的大学招聘”？

Adds a download task to Gradle that displays progress information

👻 A public SnapChat story downloader

Document reader

《数据结构（Python语言描述）》"Fundamentals of Python:Data Structures" 电子书和配套代码

Got: Simple golang package and CLI tool to download large files faster 🏃 than cURL and Wget!

Subloader is a simple and minimalistic subtitle downloader that enables you to quickly find and download subtitles for your video files.

Crawler for Nintendo Switch eShop

Download and update MaxMind's GeoIP2 databases on a time-based schedule

下载可以很简单

Python: An all-in-one Web Crawler, Web Parser and Web Scrapping library!

📈 A live cryptocurrency historical trade data blotter. Download live historical trade data from any cryptoexchange, be it for machine learning, backtesting/visualizing trading strategies or for Quantopian/Zipline.

Python E-book library for handling books in EPUB2/EPUB3 format -

LinkedIn Scraper (currently working 2020)

Leetcode Contest Ranking Searcher

Crawl BookCorpus

Crawler used to crawl papers

Html网页正文提取

Muxes and converts videos from YoutubeExplode

👁 ReadiumJS viewer: default web app for Readium.js library

Tor website crawler (specific for Alphabay at the time)

An UWP Client for https://e-hentai.org.

This package is a complete tool for creating a large dataset of images (specially designed -but not only- for machine learning enthusiasts). It can crawl the web, download images, rename / resize / covert the images and merge folders..

Easily download all the photos/videos from tumblr blogs. 下载指定的 Tumblr 博客中的图片，视频

💐 Full Amazon Automatic Download

Book publishing as easy as it should be (built with Symfony components)

Self-hosted YouTube downloader built on Material Design

Roy Fielding's REST dissertation in .epub

🤘 The native golang ssh client to execute your commands over ssh connection. 🚀🚀

The fastest file download client

python crawler spider

hproxy - Asynchronous IP proxy pool, aims to make getting proxy as convenient as possible.(异步爬虫代理池)