545 Open source projects that are alternatives of or similar to Scrapy Training

react + flask + scrapy 构建的单页应用漫画网站

Examples of build scripts and unit test frameworks for various languages, and how these can be used with the Jenkins continuous integration server. Contact: @mikej888

This repository provides you with a easy to use labeling tool for State-of-the-art Deep Learning training purposes.

A curated list of code katas

[cvpr19] Demo, training and evaluation code for generating dense hand+object reconstructions from single rgb images

It is a re-implementation of paper named "Deep Video Super-Resolution Network Using Dynamic Upsampling Filters Without Explicit Motion Compensation" called VSR-DUF model. There are both training codes and test codes about VSR-DUF based tensorflow.

基于微博的数据挖掘与社交舆情分析

DotnetCrawler is a straightforward, lightweight web crawling/scrapying library for Entity Framework Core output based on dotnet core. This library designed like other strong crawler libraries like WebMagic and Scrapy but for enabling extandable your custom requirements. Medium link : https://medium.com/@mehmetozkaya/creating-custom-web-crawler-with-dotnet-core-using-entity-framework-core-ec8d23f0ca7c

Lite version of Crawlab. 轻量版 Crawlab 爬虫管理平台

Some research experiments

scrapy框架爬取51job(scrapy.Spider)，智联招聘(扒接口)，拉勾网(CrawlSpider)

an awesome public proxy server crawler based on scrapy framework

基于Scrapy的QQ音乐爬虫(QQ Music Spider)，爬取歌曲信息、歌词、精彩评论等，并且分享了QQ音乐中排名前6400名的内地和港台歌手的49万+的音乐语料

💦 Tools to Work with the 'Splash' JavaScript Rendering Service in R

基于Spark的电影推荐系统，包含爬虫项目、web网站、后台管理系统以及spark推荐系统

This repository is primarily maintained by Omar Santos and includes thousands of resources related to ethical hacking / penetration testing, digital forensics and incident response (DFIR), vulnerability research, exploit development, reverse engineering, and more.

Learn Python for the next 30 (or so) Days.

Django based application that allows creating, deploying and running Scrapy spiders in a distributed manner

Repository for my tutorial course: Bootstrap 4 Essential Training on LinkedIn Learning and Lynda.com.

Azure Developer College's application development training days content.

Scala for Statistical Computing and Data Science Short Course

Simple web scraping for R

PHP Scraper - an highly opinionated web-interface for PHP

Implementing YOLO using ResNet as the feature extraction network

An example using Selenium webdrivers for python and Scrapy framework to create a web scraper to crawl an ASP site

The main functionality is to extract all the emails from one or several URLs - La funcionalidad principal es extraer todos los correos electrónicos de una o varias Url

Zillow Scraper for Python using Selenium

Super Heroes Kata for Android Developers in Kotlin. The main goal is to practice UI Testing.

用爬虫爬取小说网站上所有小说，存储到数据库中，并用爬到的数据构建自己的小说网站

OLX Scraper in Python Scrapy

Detailed web scraping tutorials for dummies with financial data crawlers on Reddit WallStreetBets, CME (both options and futures), US Treasury, CFTC, LME, SHFE and news data crawlers on BBC, Wall Street Journal, Al Jazeera, Reuters, Financial Times, Bloomberg, CNN, Fortune, The Economist

capture pictures from website like sina, lofter, huaban and so on

a spider for cnki patent content, just for study and commucation, no use for business.

Some scrapy and web.py exmaples

pigat ( Passive Intelligence Gathering Aggregation Tool ) 被动信息收集聚合工具

Receive an email or Telegram message as soon as Migros Sanalmarket is available for delivery in your neighborhood.

General Assembly's 2015 Data Science course in Washington, DC

This is the repository for my course, Electron: Building Cross Platform Desktop Apps on LinkedIn Learning and Lynda.com.

SciPy 2017 Pandas Tutorial

Go cascadia package command line CSS selector

scrapy专利爬虫（停止维护）

Headless 'Chrome' Orchestration in R

Kubernetes course on Udemy from @BretFisher and @jpetazzo

A Clojure training course for Developers and Senior Developers

Unmaintained 🐳 ☕️ 🕷 Scala crawler(spider) framework, inspired by scrapy, created by @gaocegege

使用Scrapy采集淘宝数据，Flask展示

A Chrome extension for writing custom web scraping programs and web automation programs. Just demonstrate how to collect the first row of data, then let the extension write the program for collecting all rows.

Fetch user's data across social media

最新动态在这里【我的程序员日志】

Download/access photos, videos, stories, story highlights, postlives, following and followers of Instagram

Indonesia Index News Crawler, including 10 online media

MetaData html scraper and parser for Node.js (supports Promises and callback style)

Materials for workshops on text mining, machine learning, and data visualization

Scrapy pipeline to store chunked items into Amazon S3 or Google Cloud Storage bucket.

Code for the second edition Web Scraping with Python book by Packt Publications

A Router WiFi key recovery/cracking tool with a twist.

Snapchat-like Face Filters in OpenCV

😩Tool For Taobao/Tmall| 儿时玩具已经过时

all kinds of scrapy demo

lots of spider (很多爬虫）