yokawasa / Scrapy Azuresearch Crawler Samples
Licence: mit
Scrapy as a Web Crawler for Azure Search Samples
Stars: ✭ 20
Programming Languages
Projects that are alternatives of or similar to Scrapy Azuresearch Crawler Samples
Opensearchserver
Open-source Enterprise Grade Search Engine Software
Stars: ✭ 408 (+1940%)
Mutual labels: search, crawler
Scrapple
A framework for creating semi-automatic web content extractors
Stars: ✭ 464 (+2220%)
Mutual labels: crawler, scrapy
Crawlertutorial
爬蟲極簡教學（fetch, parse, search, multiprocessing, API）- PTT 為例
Stars: ✭ 282 (+1310%)
Mutual labels: search, crawler
Easy Scraping Tutorial
Simple but useful Python web scraping tutorial code.
Stars: ✭ 583 (+2815%)
Mutual labels: crawler, scrapy
Scrapy Redis
Redis-based components for Scrapy.
Stars: ✭ 4,998 (+24890%)
Mutual labels: crawler, scrapy
Algoliasearch Netlify
Official Algolia Plugin for Netlify. Index your website to Algolia when deploying your project to Netlify with the Algolia Crawler
Stars: ✭ 208 (+940%)
Mutual labels: search, crawler
Filemasta
A search application to explore, discover and share online files
Stars: ✭ 571 (+2755%)
Mutual labels: search, crawler
Fess
Fess is very powerful and easily deployable Enterprise Search Server.
Stars: ✭ 561 (+2705%)
Mutual labels: search, crawler
indieweb-search
Source code for the IndieWeb search engine.
Stars: ✭ 16 (-20%)
Mutual labels: search, crawler
Jivesearch
A search engine that doesn't track you.
Stars: ✭ 364 (+1720%)
Mutual labels: search, crawler
Haipproxy
💖 High available distributed ip proxy pool, powerd by Scrapy and Redis
Stars: ✭ 4,993 (+24865%)
Mutual labels: crawler, scrapy
Icrawler
A multi-thread crawler framework with many builtin image crawlers provided.
Stars: ✭ 629 (+3045%)
Mutual labels: crawler, scrapy
scrapy-azuresearch-crawler-samples
Scrapy as a Web Crawler for Azure Search Sample
Samples
- quotes: Web Scraping Quotes to Scrape's quote list and indexing them with Azure Search
- craigslist: Web Scraping Craigslist's Jobs in Tokyo and indexing them with Azure Search
- unofficialism: Web Scraping Unofficialism's all blog articles and indexing them with Azure Search
Tips
- Scrapy.org
- Scrapy Totorial
- Welcome to Azure Cosmos DB
- What is Azure Search?
- Azure Search Indexer Overview
- Connecting Cosmos DB with Azure Search using indexers
Contributing
Bug reports and pull requests are welcome on GitHub at https://github.com/yokawasa/scrapy-azuresearch-crawler-samples
Note that the project description data, including the texts, logos, images, and/or trademarks,
for each open source project belongs to its rightful owner.
If you wish to add or remove any projects, please contact us at [email protected].