All Projects → Scrapy-SearchEngines → Similar Projects or Alternatives

362 Open source projects that are alternatives of or similar to Scrapy-SearchEngines

Bulk Bing Image Downloader
Download full sized images returned from bing image search
Stars: ✭ 271 (+867.86%)
Mutual labels:  bing
scrapy-wayback-machine
A Scrapy middleware for scraping time series data from Archive.org's Wayback Machine.
Stars: ✭ 92 (+228.57%)
Mutual labels:  scrapy
bing-translate-api
A simple and free API for Bing Translator for Node.js
Stars: ✭ 37 (+32.14%)
Mutual labels:  bing
Scrapy-tripadvisor-reviews
Using scrapy to scrape tripadvisor in order to get users' reviews.
Stars: ✭ 24 (-14.29%)
Mutual labels:  scrapy
BingPicApi
Bing 每日图片 API
Stars: ✭ 58 (+107.14%)
Mutual labels:  bing
bing-wallpaper
Python Skript that sets the daily www.bing.com picture as a Desktop Wallpaper
Stars: ✭ 21 (-25%)
Mutual labels:  bing
bing-dict.el
Minimalists' Bing dictionary for Emacs
Stars: ✭ 48 (+71.43%)
Mutual labels:  bing
UEditorNetCore
百度在线编辑器UEditor在ASP.NET Core下的服务端,使用简单,易于扩展。
Stars: ✭ 14 (-50%)
Mutual labels:  baidu
freshpaper
This utility automatically sets the wallpaper of the day from various sources as your Desktop wallpaper.
Stars: ✭ 35 (+25%)
Mutual labels:  bing
mpapi
🐤 小程序API兼容插件,一次编写,多端运行。支持:微信小程序、支付宝小程序、百度智能小程序、字节跳动小程序
Stars: ✭ 40 (+42.86%)
Mutual labels:  baidu
gosimac
Fetch the wallpaper from Bing, Unsplash, etc.
Stars: ✭ 22 (-21.43%)
Mutual labels:  bing
pagser
Pagser is a simple, extensible, configurable parse and deserialize html page to struct based on goquery and struct tags for golang crawler
Stars: ✭ 82 (+192.86%)
Mutual labels:  scrapy
BingMapsSDSToolkit
This toolkit makes it easy to use the Bing Maps Spatial Data Services (SDS) in .NET
Stars: ✭ 39 (+39.29%)
Mutual labels:  bing
easypoi
简单、免费、高效的百度地图poi采集和分析工具。
Stars: ✭ 87 (+210.71%)
Mutual labels:  scrapy
Google-Blocklist
适用于uBlacklist的订阅列表,拯救Google等搜索引擎的搜索体验(过滤内容农场、机器翻译站、垃圾站点)
Stars: ✭ 70 (+150%)
Mutual labels:  bing
domains
World’s single largest Internet domains dataset
Stars: ✭ 461 (+1546.43%)
Mutual labels:  scrapy
double-agent
A test suite of common scraper detection techniques. See how detectable your scraper stack is.
Stars: ✭ 123 (+339.29%)
Mutual labels:  scrapy
Filesensor
Dynamic file detection tool based on crawler 基于爬虫的动态敏感文件探测工具
Stars: ✭ 227 (+710.71%)
Mutual labels:  scrapy
Python Tutorial
🏃 Some of the python tutorial - 《Python学习笔记》
Stars: ✭ 122 (+335.71%)
Mutual labels:  scrapy
Spiderkeeper
admin ui for scrapy/open source scrapinghub
Stars: ✭ 2,562 (+9050%)
Mutual labels:  scrapy
RARBG-scraper
With Selenium headless browsing and CAPTCHA solving
Stars: ✭ 38 (+35.71%)
Mutual labels:  scrapy
City Scrapers
Scrape, standardize and share public meetings from local government websites
Stars: ✭ 220 (+685.71%)
Mutual labels:  scrapy
Idt
Image Dataset Tool (idt) is a cli tool designed to make the otherwise repetitive and slow task of creating image datasets into a fast and intuitive process.
Stars: ✭ 202 (+621.43%)
Mutual labels:  bing
scrapy-LBC
Araignée LeBonCoin avec Scrapy et ElasticSearch
Stars: ✭ 14 (-50%)
Mutual labels:  scrapy
uranus
[W.I.P] An ecosystem of crawlers for detecting: leaks, sensitive data exposure and attempts exfiltration of data
Stars: ✭ 22 (-21.43%)
Mutual labels:  bing
Search Deflector
A small program that forwards searches from Cortana to your preferred browser and search engine.
Stars: ✭ 620 (+2114.29%)
Mutual labels:  bing
Py Elasticsearch Django
基于python语言开发的千万级别搜索引擎
Stars: ✭ 207 (+639.29%)
Mutual labels:  scrapy
Bing Upyun
轻量必应每日一图API,支持上传至又拍云调用,支持图片处理(高斯模糊、灰阶),支持回溯。
Stars: ✭ 179 (+539.29%)
Mutual labels:  bing
News spider
新闻抓取(微信、微博、头条...)
Stars: ✭ 190 (+578.57%)
Mutual labels:  scrapy
bing-daily-photo
A simple PHP class to fetch Bing's photo of the day.
Stars: ✭ 34 (+21.43%)
Mutual labels:  bing
Livetv mining
直播网站数据采集
Stars: ✭ 188 (+571.43%)
Mutual labels:  scrapy
Osmdeepod
OSMDeepOD - OpenStreetMap (OSM) and Machine Learning (Deep Learning) based Object Detection from Aerial Imagery (Formerly also known as "OSM-Crosswalk-Detection").
Stars: ✭ 174 (+521.43%)
Mutual labels:  bing
Marmot
💐Marmot | Web Crawler/HTTP protocol Download Package 🐭
Stars: ✭ 186 (+564.29%)
Mutual labels:  scrapy
crawler
python爬虫项目集合
Stars: ✭ 29 (+3.57%)
Mutual labels:  scrapy
Wenshu spider
🌈Wenshu_Spider-Scrapy框架爬取中国裁判文书网案件数据(2019-1-9最新版)
Stars: ✭ 177 (+532.14%)
Mutual labels:  scrapy
Bingmapsresttoolkit
This is a portable class library which makes it easy to access the Bing Maps REST services from .NET.
Stars: ✭ 136 (+385.71%)
Mutual labels:  bing
Scrapingoutsourcing
ScrapingOutsourcing专注分享爬虫代码 尽量每周更新一个
Stars: ✭ 164 (+485.71%)
Mutual labels:  scrapy
scrapy-mysql-pipeline
scrapy mysql pipeline
Stars: ✭ 47 (+67.86%)
Mutual labels:  scrapy
Netflix Clone
Netflix like full-stack application with SPA client and backend implemented in service oriented architecture
Stars: ✭ 156 (+457.14%)
Mutual labels:  scrapy
Bingmapsv8codesamples
This is a collection of over two hundred code samples an growing for the Bing Maps V8 web control.
Stars: ✭ 111 (+296.43%)
Mutual labels:  bing
Movie recommend
基于Spark的电影推荐系统,包含爬虫项目、web网站、后台管理系统以及spark推荐系统
Stars: ✭ 2,092 (+7371.43%)
Mutual labels:  scrapy
asyncpy
使用asyncio和aiohttp开发的轻量级异步协程web爬虫框架
Stars: ✭ 86 (+207.14%)
Mutual labels:  scrapy
Juno crawler
Scrapy crawler to collect data on the back catalog of songs listed for sale.
Stars: ✭ 150 (+435.71%)
Mutual labels:  scrapy
Bing
Bing 壁纸 API
Stars: ✭ 1,325 (+4632.14%)
Mutual labels:  bing
Awesome Web Scraper
A collection of awesome web scaper, crawler.
Stars: ✭ 147 (+425%)
Mutual labels:  scrapy
hupu spider
虎扑步行街爬虫
Stars: ✭ 22 (-21.43%)
Mutual labels:  scrapy
Scrapy guru
Everybody can be scrapy guru
Stars: ✭ 145 (+417.86%)
Mutual labels:  scrapy
Image search
Python Library to download images and metadata from popular search engines.
Stars: ✭ 86 (+207.14%)
Mutual labels:  bing
react-leaflet-bing
Bing layer as React component for Leaflet | This repo is obsolete. Plz, use https://github.com/TA-Geoforce/react-leaflet-bing
Stars: ✭ 13 (-53.57%)
Mutual labels:  bing
Feapder
feapder是一款支持分布式、批次采集、任务防丢、报警丰富的python爬虫框架
Stars: ✭ 110 (+292.86%)
Mutual labels:  scrapy
Crow Translate
A simple and lightweight translator that allows to translate and speak text using Google, Yandex and Bing.
Stars: ✭ 503 (+1696.43%)
Mutual labels:  bing
Soul Manga
react + flask + scrapy 构建的单页应用漫画网站
Stars: ✭ 126 (+350%)
Mutual labels:  scrapy
fernando-pessoa
Classificador de poemas do Fernando Pessoa de acordo com os seus heterônimos
Stars: ✭ 31 (+10.71%)
Mutual labels:  scrapy
Bing.netcore
Bing是基于 .net core 2.0 的框架,旨在提升团队的开发输出能力,由常用公共操作类(工具类、帮助类)、分层架构基类,第三方组件封装,第三方业务接口封装等组成。
Stars: ✭ 758 (+2607.14%)
Mutual labels:  bing
waline
💬 A Simple, Safe Comment System
Stars: ✭ 1,145 (+3989.29%)
Mutual labels:  baidu
scrapy-fieldstats
A Scrapy extension to log items coverage when the spider shuts down
Stars: ✭ 17 (-39.29%)
Mutual labels:  scrapy
baidu-chain-dog
百度莱茨狗爬虫。
Stars: ✭ 52 (+85.71%)
Mutual labels:  baidu
itemadapter
Common interface for data container classes
Stars: ✭ 47 (+67.86%)
Mutual labels:  scrapy
scrapy-rotated-proxy
A scrapy middleware to use rotated proxy ip list.
Stars: ✭ 22 (-21.43%)
Mutual labels:  scrapy
Geocoding.net
C# GeoCoding / Address Validation API
Stars: ✭ 377 (+1246.43%)
Mutual labels:  bing
61-120 of 362 similar projects