942 Open source projects that are alternatives of or similar to N2h4

News, full-text, and article metadata extraction in Python 3. Advanced docs:

Elegant Scraper and Crawler Framework for Golang

The simple, easy to use command line web crawler.

a userscript project that parses korean news site and then making more readable view

Continuous scalable web crawler built on top of Flink and crawler-commons

Simple news aggregator displaying top stories in real time

DotnetCrawler is a straightforward, lightweight web crawling/scrapying library for Entity Framework Core output based on dotnet core. This library designed like other strong crawler libraries like WebMagic and Scrapy but for enabling extandable your custom requirements. Medium link : https://medium.com/@mehmetozkaya/creating-custom-web-crawler-with-dotnet-core-using-entity-framework-core-ec8d23f0ca7c

利用文本挖掘技术进行新闻热点关注问题分析

HTTP API for Scrapy spiders

a reliable high-level web crawling & scraping framework for Node.js.

news-please - an integrated web crawler and information extractor for news that just works.

No description or website provided.

Distributed crawler powered by Headless Chrome

Go process used to crawl websites

An interactive Command-Line Interface Build in NodeJS for downloading a single or multiple images to disk from URL

Declarative web scraping

[Unmaintained] A simple and clean video/music/image downloader 👾

Antch, a fast, powerful and extensible web crawling & scraping framework for Go

Scrapy-based Crawlers for news of Taiwan

[WIP] GOPA, a spider written in Golang, for Elasticsearch. DEMO: http://index.elasticsearch.cn

一个灵活、友好的爬虫框架

Simple but useful Python web scraping tutorial code.

Crawly, a high-level web crawling & scraping framework for Elixir.

Scrapy, a fast high-level web crawling & scraping framework for Python.

蓝天采集器是一款免费的数据采集发布爬虫软件，采用php+mysql开发，可部署在云服务器，几乎能采集所有类型的网页，无缝对接各类CMS建站程序，免登录实时发布数据，全自动无需人工干预！是网页大数据采集软件中完全跨平台的云端爬虫系统

Squidwarc is a high fidelity, user scriptable, archival crawler that uses Chrome or Chromium with or without a head

今日头条机器人，支持用户登陆、关注、取消关注、获取关注粉丝、发文、发悟空问答、点赞、评论、采集各种类型新闻讯息等，使用今日头条网页版API实现

Golang 기술 소식 뉴스레터

Powerful web scraping framework for Crystal

An Instagram bot developed using the Selenium Framework

🕵️‍♂️ LinkedIn profile scraper returning structured profile data in JSON. Works in 2020.

DownZemAll! is a download manager for Windows, MacOS and Linux

Bitextor generates translation memories from multilingual websites.

Cross Platform C# web crawler framework built for speed and flexibility. Please star this project! +1.

scrapes medias, likes, followers, tags and all metadata. Inspired by instagram-php-scraper,bot

Crawler for LinkedIn full profiles 2019

Code for the twitter bot nyt_diff

📺 A news app using YouTube playlists, built with React Native

An easy to use, powerful crawler implemented in PHP. Can execute Javascript.

ScrapingOutsourcing专注分享爬虫代码 尽量每周更新一个

A news curator and newsletter subscription package for Django

根据关键词抓取微博数据，再生成词云

Collection of neat modular utilities for bumping up development in NODE and Browser

PHP Formatter is a PHP developer friendly set of tools

Ordinare sorts gems in your Gemfile alphabetically

Symfony SonataNewsBundle

The repository algorithms implemented on the Go

Python爬虫实战 - 模拟登陆各大网站 包含但不限于：滑块验证、拼多多、美团、百度、bilibili、大众点评、淘宝，如果喜欢请start ❤️

Dynamic meta tags in your AngularJS single page application

🕷️ A node crawler for github trending.

핑퐁에서 만든 채팅체랑 잘 맞는 띄어쓰기 모델!

Android video listing with swipe view tabs based on mvp design pattern with complete functionalities like search and sort

Hangulize transcribes non-Korean words into Hangul

Polite, slim and concurrent web crawler.

A lite distributed Java spider framework :-)

用 node.js 爬你自己的 leetcode 解题源码

Package providing helper functions for a Laravel REST-API

Python爬虫代理IP池(proxy pool)

Chooses correct Korean particle morphs for arbitrary words.