362 Open source projects that are alternatives of or similar to Scrapy-SearchEngines

Download images from Google, Bing, Baidu. 谷歌、百度、必应图片下载.

jSearch(聚搜) 是一款专注内容的chrome搜索扩展，一次搜索聚合多平台内容。

码云仓库链接:AJay13/ECommerceCrawlers Github 仓库链接:DropsDevopsOrg/ECommerceCrawlers 项目展示平台链接:http://wechat.doonsec.com

一个开源，高隐私，自架自用的聚合搜索引擎。 https://xinahn.com

Search Google/Bing/Ecosia/DuckDuckGo/Yandex/Yahoo for a search term with a default set of websites, bug bounty programs or a custom collection.

🌏🌍🌎Translators🌎🌍🌏 is a library which aims to bring free, multiple, enjoyable translation to individuals and students in Python. Translators是一个旨在用Python为个人和学生带来免费、多样、愉快翻译的库。

Analyze scraped data

🗑在Typecho中加入百度文本内容审核，过滤评论中的敏感内容

项目已经移动至：https://github.com/BaiduSpider/BaiduSpider ！！ 一个爬取百度搜索结果的爬虫，目前支持百度网页搜索，百度图片搜索，百度知道搜索，百度视频搜索，百度资讯搜索，百度文库搜索，百度经验搜索和百度百科搜索。

Lightweight package to query popular search engines and scrape for result titles, links and descriptions

Inventus is a spider designed to find subdomains of a specific domain by crawling it and any subdomains it discovers.

Crawling the data from lazada, websosanh, compare.vn, cdiscount and cungmua with flexible configs

Utilities, Baselines, Statistics and Descriptions Related to the MSMARCO DATASET

Convert text to speech using Google Translate API

Crawling zhihu, jobbole, lagou by Scrapy, and using Elasticsearch+Django to build a Search Engine website --- README_zh.md (including: implementation roadmap, distributed-crawler and coping with anti-crawling strategies).

python+scrapy+splash 爬取拉勾全站职位信息

Distributed crawling/scraping, Kafka And Redis based components for Scrapy

Scraping the real estate agencies for up-to-date house listings as soon as they arrive!

My code for scraping financial data in Vietnam

Image Dataset Tool (idt) is a cli tool designed to make the otherwise repetitive and slow task of creating image datasets into a fast and intuitive process.

Raspagem de dados para iniciante usando Scrapy e outras libs básicas

必应每日超清壁纸（4K）

📙 Awesome collection of meta tags

GNOME shell extension that sets your desktop wallpaper & lock screen image to Microsoft Bing's Image of the Day.

Use Bing daily photo as your wallpaper for macOS.

Scrapy downloader middleware that stores response HTMLs to disk.

Iota is a web scraper which can find all of the images and links/suburls on a webpage

简单易用的命令行词典 📕 📙 📗 📘 📓

a terminal-translate tool

A Scrapy middleware for scraping time series data from Archive.org's Wayback Machine.

Using scrapy to scrape tripadvisor in order to get users' reviews.

Python Skript that sets the daily www.bing.com picture as a Desktop Wallpaper

百度在线编辑器UEditor在ASP.NET Core下的服务端，使用简单，易于扩展。

🐤 小程序API兼容插件，一次编写，多端运行。支持：微信小程序、支付宝小程序、百度智能小程序、字节跳动小程序

Pagser is a simple, extensible, configurable parse and deserialize html page to struct based on goquery and struct tags for golang crawler

简单、免费、高效的百度地图poi采集和分析工具。

World’s single largest Internet domains dataset

A test suite of common scraper detection techniques. See how detectable your scraper stack is.

With Selenium headless browsing and CAPTCHA solving

Araignée LeBonCoin avec Scrapy et ElasticSearch

轻量必应每日一图API，支持上传至又拍云调用，支持图片处理（高斯模糊、灰阶），支持回溯。

A simple PHP class to fetch Bing's photo of the day.

OSMDeepOD - OpenStreetMap (OSM) and Machine Learning (Deep Learning) based Object Detection from Aerial Imagery (Formerly also known as "OSM-Crosswalk-Detection").

python爬虫项目集合

This is a portable class library which makes it easy to access the Bing Maps REST services from .NET.

scrapy mysql pipeline

This is a collection of over two hundred code samples an growing for the Bing Maps V8 web control.

使用asyncio和aiohttp开发的轻量级异步协程web爬虫框架

Bing 壁纸 API

虎扑步行街爬虫

Bing layer as React component for Leaflet | This repo is obsolete. Plz, use https://github.com/TA-Geoforce/react-leaflet-bing

Python Library to download images and metadata from popular search engines.

Dynamic configurable crawl (动态可配置化爬虫)

Simple bing daily wallpaper API lib for Node.js. 极简的 Node.js 版必应壁纸 API 库。

Classificador de poemas do Fernando Pessoa de acordo com os seus heterônimos

Bing是基于 .net core 2.0 的框架，旨在提升团队的开发输出能力，由常用公共操作类（工具类、帮助类）、分层架构基类，第三方组件封装，第三方业务接口封装等组成。

[W.I.P] An ecosystem of crawlers for detecting: leaks, sensitive data exposure and attempts exfiltration of data

💬 A Simple, Safe Comment System

A Scrapy extension to log items coverage when the spider shuts down

百度莱茨狗爬虫。