Ant nestSimple, clear and fast Web Crawler framework build on python3.6+, powered by asyncio.
Stars: ✭ 90 (-55.67%)
Goclone Website Cloner - Utilizes powerful Go routines to clone websites to your computer within seconds.
Stars: ✭ 134 (-33.99%)
UdtUDT spec, reference library and related packages
Stars: ✭ 89 (-56.16%)
Php Mf2php-mf2 is a pure, generic microformats-2 parser for PHP. It makes HTML as easy to consume as JSON.
Stars: ✭ 165 (-18.72%)
DiffsitterA tree-sitter based AST difftool to get meaningful semantic diffs
Stars: ✭ 89 (-56.16%)
EntrypointComposable CLI Argument Parser for all modern .Net platforms.
Stars: ✭ 136 (-33%)
Spider简简单单spider
Stars: ✭ 88 (-56.65%)
LinereaderReading a text file line by line aka block wise.
Stars: ✭ 87 (-57.14%)
NewspaperNews, full-text, and article metadata extraction in Python 3. Advanced docs:
Stars: ✭ 11,545 (+5587.19%)
DaftlistingsA library that enables programmatic interaction with daft.ie. Daft.ie has nationwide coverage and contains about 80% of the total available properties in Ireland.
Stars: ✭ 86 (-57.64%)
Query TranslatorQuery Translator is a search query translator with AST representation
Stars: ✭ 165 (-18.72%)
Redrun✨🐌 🐎✨ fastest npm scripts runner
Stars: ✭ 85 (-58.13%)
Go Vimlparser⚡️ Vim Script Parser written in Go
Stars: ✭ 132 (-34.98%)
Email addressThe EmailAddress Gem to work with and validate email addresses.
Stars: ✭ 199 (-1.97%)
React Json SchemaConfigure and build views using JSON schemas mapped to React components
Stars: ✭ 131 (-35.47%)
MimekitA .NET MIME creation and parser library with support for S/MIME, PGP, DKIM, TNEF and Unix mbox spools.
Stars: ✭ 1,214 (+498.03%)
Mooc Dl👨🎓 中国大学MOOC全课件(视频、文档、附件)下载器
Stars: ✭ 163 (-19.7%)
Cslya C# embeddable lexer and parser generator (.Net core)
Stars: ✭ 129 (-36.45%)
Lang CLightweight C parser for Rust
Stars: ✭ 77 (-62.07%)
Is GoogleVerify that a request is from Google crawlers using Google's DNS verification steps
Stars: ✭ 82 (-59.61%)
CatPlain C library for parsing AT commands for use in host devices.
Stars: ✭ 77 (-62.07%)
Vue StyleguidistCreated from react styleguidist for Vue Components with a living style guide
Stars: ✭ 2,133 (+950.74%)
SdkLibrary for using Grafana' structures in Go programs and client for Grafana REST API.
Stars: ✭ 193 (-4.93%)
Crawler illegal cases in chinaCollection of China illegal cases about web crawler 本项目用来整理所有中国大陆爬虫开发者涉诉与违规相关的新闻、资料与法律法规。致力于帮助在中国大陆工作的爬虫行业从业者了解我国相关法律,避免触碰数据合规红线。 [AD]中文知识图谱门户
Stars: ✭ 2,448 (+1105.91%)
Datmusic ApiAlternative for VK Audio API
Stars: ✭ 160 (-21.18%)
Baba CoreMini-language for creating random text generators.
Stars: ✭ 127 (-37.44%)
Gutenberg Parser RsAn experimental Rust parser for WordPress Gutenberg post format
Stars: ✭ 76 (-62.56%)
UnmixUndo the so-called mix lingo, a code-mixing style (Bahasa Jaksel)
Stars: ✭ 81 (-60.1%)
Php Zephir ParserThe Zephir Parser delivered as a C extension for the PHP language.
Stars: ✭ 129 (-36.45%)
ExpostalElixir binding for Libpostal - a library for parsing/normalizing street addresses around the world. Powered by statistical NLP and open geo data.
Stars: ✭ 80 (-60.59%)
JvppeteerHeadless Chrome For Java (Java 爬虫)
Stars: ✭ 193 (-4.93%)
WombatLightweight Ruby web crawler/scraper with an elegant DSL which extracts structured data from pages.
Stars: ✭ 1,220 (+500.99%)
Guwen Spider一个完整的nodeJs 串行爬虫 抓取3万多个页面。
Stars: ✭ 129 (-36.45%)
SwiftlinkpreviewIt makes a preview from an URL, grabbing all the information such as title, relevant texts and images.
Stars: ✭ 1,216 (+499.01%)
Scrapy demoall kinds of scrapy demo
Stars: ✭ 128 (-36.95%)
MarkoA markdown parser with high extensibility.
Stars: ✭ 77 (-62.07%)
MdA markdown parser and compiler. Built for speed.
Stars: ✭ 128 (-36.95%)
WebbPython: An all-in-one Web Crawler, Web Parser and Web Scrapping library!
Stars: ✭ 77 (-62.07%)
GocrawlPolite, slim and concurrent web crawler.
Stars: ✭ 1,962 (+866.5%)
AnticrawlersolutionIt covers the blockade principle of most anti-climbing strategies and corresponding solutions.👽👽👽👽(涵盖了大部分的反爬策略的封锁原理以及对应的解决方案。)
Stars: ✭ 77 (-62.07%)
Feapderfeapder是一款支持分布式、批次采集、任务防丢、报警丰富的python爬虫框架
Stars: ✭ 110 (-45.81%)
Capturercapture pictures from website like sina, lofter, huaban and so on
Stars: ✭ 76 (-62.56%)
Laosjgolang light-weight image crawler
Stars: ✭ 199 (-1.97%)
Jetpack.jsA ECMAScript bundler and minifier implemented in C++ aimed at excellent performance.
Stars: ✭ 75 (-63.05%)
PhplrtPHP Language Recognition Tool
Stars: ✭ 127 (-37.44%)
Any23Apache Anything To Triples (Any23) is a library, a web service and a command line tool that extracts structured data in RDF format from a variety of Web documents.
Stars: ✭ 74 (-63.55%)
InkA fast and flexible Markdown parser written in Swift.
Stars: ✭ 2,049 (+909.36%)
TypinDeclarative framework for interactive CLI applications
Stars: ✭ 126 (-37.93%)
SequentialAn environment to visualize JavaScript code execution in a browser
Stars: ✭ 74 (-63.55%)
ParserGenerate a JSON documentation for a SFC Vue component. Contribute: https://gitlab.com/vuedoc/parser#contribute
Stars: ✭ 74 (-63.55%)
Snapdragonsnapdragon is an extremely pluggable, powerful and easy-to-use parser-renderer factory.
Stars: ✭ 180 (-11.33%)
SoupWeb Scraper in Go, similar to BeautifulSoup
Stars: ✭ 1,685 (+730.05%)
Prowide CoreModel and parsers for all SWIFT MT (FIN) messages
Stars: ✭ 125 (-38.42%)