imdb-spider
Scrapy spider for scraping imdb {movie_id: [recommended, ...]}
Don't forget to:
- change your proxy settings: "meta" in each request in spider and middleware in settings.py
- create database, or change processing.py as you need.
iggisv9t / imdb-spider
Licence: MIT license
scrapy spider for scraping imdb {movie_id: [recommended, ...]}
Stars: ✭ 23
Programming Languages
python
139335 projects - #7 most used programming language
Projects that are alternatives of or similar to imdb-spider
imdb-scraper
🎬 An attempt at the most complete IMDb API
Stars: ✭ 24 (+4.35%)
Mutual labels: imdb, imdb-webscrapping
Magic google
Google search results crawler, get google search results that you need
Stars: ✭ 247 (+973.91%)
Mutual labels: spider
Killshot
A Penetration Testing Framework, Information gathering tool & Website Vulnerability Scanner
Stars: ✭ 237 (+930.43%)
Mutual labels: spider
Gerapy
Distributed Crawler Management Framework Based on Scrapy, Scrapyd, Django and Vue.js
Stars: ✭ 2,601 (+11208.7%)
Mutual labels: spider
Spiderkeeper
admin ui for scrapy/open source scrapinghub
Stars: ✭ 2,562 (+11039.13%)
Mutual labels: spider
Laravel Crawler Detect
A Laravel wrapper for CrawlerDetect - the web crawler detection library
Stars: ✭ 227 (+886.96%)
Mutual labels: spider
Ppspider
web spider built by puppeteer, support task-queue and task-scheduling by decorators，support nedb / mongodb, support data visualization; 基于puppeteer的web爬虫框架，提供灵活的任务队列管理调度方案，提供便捷的数据保存方案（nedb/mongodb），提供数据可视化和用户交互的实现方案
Stars: ✭ 237 (+930.43%)
Mutual labels: spider
Chromium for spider
dynamic crawler for web vulnerability scanner
Stars: ✭ 220 (+856.52%)
Mutual labels: spider
Note that the project description data, including the texts, logos, images, and/or trademarks,
for each open source project belongs to its rightful owner.
If you wish to add or remove any projects, please contact us at [email protected].