kant2002 / Ncrawler
Licence: lgpl-2.1
Web Crawler written in C#
Stars: ✭ 34
Labels
Projects that are alternatives of or similar to Ncrawler
Symfony Crawler Bundle
Implements the crawler package into Symfony
Stars: ✭ 8 (-76.47%)
Mutual labels: crawler
Onion Crawler
Tor website crawler (specific for Alphabay at the time)
Stars: ✭ 15 (-55.88%)
Mutual labels: crawler
Vw Crawler
🐞简单轻便的Java爬虫框架，只要会一点简单的正则表达式和简单的css选择器就能轻松的采集数据。
Stars: ✭ 32 (-5.88%)
Mutual labels: crawler
Axegrinder
Crawl websites for accessibility issues from the command line.
Stars: ✭ 12 (-64.71%)
Mutual labels: crawler
Nodespider
[DEPRECATED] Simple, flexible, delightful web crawler/spider package
Stars: ✭ 33 (-2.94%)
Mutual labels: crawler
Pypergrabber
Fetches PubMed article IDs (PMIDs) from email inbox, then crawls PubMed, Google Scholar and Sci-Hub for respective PDF files.
Stars: ✭ 14 (-58.82%)
Mutual labels: crawler
Autocrawler
Google, Naver multiprocess image web crawler (Selenium)
Stars: ✭ 957 (+2714.71%)
Mutual labels: crawler
Sina Stock Crawler
Sina stock options crawler with CSV output 新浪上证ETF期权数据爬虫
Stars: ✭ 12 (-64.71%)
Mutual labels: crawler
Pic Gather
[ Closed ] 🎨 image collector, which supports custom acquisition source configuration and is compatible with MacOS and Windows operating systems.
Stars: ✭ 842 (+2376.47%)
Mutual labels: crawler
Scrapy Azuresearch Crawler Samples
Scrapy as a Web Crawler for Azure Search Samples
Stars: ✭ 20 (-41.18%)
Mutual labels: crawler
News Please
news-please - an integrated web crawler and information extractor for news that just works.
Stars: ✭ 969 (+2750%)
Mutual labels: crawler
Universityrecruitment Ssurvey
用严肃的数据来回答“什么样的企业会到什么样的大学招聘”？
Stars: ✭ 30 (-11.76%)
Mutual labels: crawler
ncrawler
Copy of NCrawler from http://ncrawler.codeplex.com/
Simple and very efficient multithreaded web crawler with pipeline based processing written in C#. Contains HTML, Text, PDF, and IFilter document processors and language detection(Google). Easy to add pipeline steps to extract, use and alter information.
Build Nuget packages
Create debug packages
.\Build.ps1 -VersionSuffix build002
Create release packages
.\Build.ps1
Note that the project description data, including the texts, logos, images, and/or trademarks,
for each open source project belongs to its rightful owner.
If you wish to add or remove any projects, please contact us at [email protected].