fanslySimply scrape / download all the media from an fansly account
Stars: ✭ 351 (-51.98%)
Awesome CrawlerA collection of awesome web crawler,spider in different languages
Stars: ✭ 4,793 (+555.68%)
Freshonions TorscraperFresh Onions is an open source TOR spider / hidden service onion crawler hosted at zlal32teyptf4tvi.onion
Stars: ✭ 348 (-52.39%)
Php Scoper🔨 Prefixes all PHP namespaces in a file/directory to isolate the code bundled in PHARs.
Stars: ✭ 409 (-44.05%)
GoogledictionaryapiGoogle does not provide Google Dictionary API so I created one.
Stars: ✭ 528 (-27.77%)
Micro Open GraphA tiny Node.js microservice to scrape open graph data with joy.
Stars: ✭ 371 (-49.25%)
Box📦🚀 Fast, zero config application bundler with PHARs.
Stars: ✭ 574 (-21.48%)
ScrapedinLinkedIn Scraper (currently working 2020)
Stars: ✭ 453 (-38.03%)
JavgoJavGo是一个集合影片管理,影片刮削,视频处理,资源搜索等综合一体的全功能影音软件,支持爬取javbus,jav321,javdb,javlibrary进行刮削,支持db,bus的磁力搜索,支持获取library的影片评论。
Stars: ✭ 338 (-53.76%)
SinglefileWeb Extension for Firefox/Chrome/MS Edge and CLI tool to save a faithful copy of an entire web page in a single HTML file
Stars: ✭ 4,417 (+504.24%)
WebscrapbookA browser extension that captures web pages to local device or backend server for future retrieval, organization, annotation, and edit. This project inherits from ScrapBook X.
Stars: ✭ 424 (-42%)
Instagram ScraperScrapes an instagram user's photos and videos
Stars: ✭ 5,664 (+674.83%)
Php GooseReadability / Html Content / Article Extractor & Web Scrapping library written in PHP
Stars: ✭ 392 (-46.37%)
GoblinAn impish, cross-platform binary parsing crate, written in Rust
Stars: ✭ 591 (-19.15%)
Osi.igInformation Gathering Instagram.
Stars: ✭ 377 (-48.43%)
Operative Frameworkoperative framework is a OSINT investigation framework, you can interact with multiple targets, execute multiple modules, create links with target, export rapport to PDF file, add note to target or results, interact with RESTFul API, write your own modules.
Stars: ✭ 511 (-30.1%)
ScrapersA list of scrapers from around the web.
Stars: ✭ 366 (-49.93%)
ScrapyrtHTTP API for Scrapy spiders
Stars: ✭ 637 (-12.86%)
XidelCommand line tool to download and extract data from HTML/XML pages or JSON-APIs, using CSS, XPath 3.0, XQuery 3.0, JSONiq or pattern matching. It can also create new or transformed XML/HTML/JSON documents.
Stars: ✭ 335 (-54.17%)
Github Ranking⭐️Github Ranking⭐️ Github stars and forks ranking list. Github Top100 stars list of different languages. Automatically update daily. | Github仓库排名,每日自动更新
Stars: ✭ 315 (-56.91%)
CrawlyCrawly, a high-level web crawling & scraping framework for Elixir.
Stars: ✭ 440 (-39.81%)
CryptocmdCryptocurrency historical price data library in Python. Data from https://coinmarketcap.com.
Stars: ✭ 299 (-59.1%)
Socialmanagertools Gui🤖 👻 Desktop application for Instagram Bot, Twitter Bot and Facebook Bot
Stars: ✭ 293 (-59.92%)
Narnode.js application archive - create self-contained binary like executable applications that are ready to ship and run
Stars: ✭ 428 (-41.45%)
FbcrawlA Facebook crawler
Stars: ✭ 536 (-26.68%)
Linkedin scraperA library that scrapes Linkedin for user data
Stars: ✭ 413 (-43.5%)
Instagram4j📷 Instagram private API in Java
Stars: ✭ 629 (-13.95%)
GosintOSINT Swiss Army Knife
Stars: ✭ 401 (-45.14%)
JikanUnofficial MyAnimeList PHP+REST API which provides functions other than the official API
Stars: ✭ 531 (-27.36%)
Finance Go📊 Financial markets data library implemented in go.
Stars: ✭ 392 (-46.37%)
Instagram CrawlerGet Instagram posts/profile/hashtag data without using Instagram API
Stars: ✭ 643 (-12.04%)
LibzipA C library for reading, creating, and modifying zip archives.
Stars: ✭ 379 (-48.15%)
RedditdownloaderScrapes Reddit to download media of your choice.
Stars: ✭ 521 (-28.73%)
Scrape It🔮 A Node.js scraper for humans.
Stars: ✭ 3,773 (+416.14%)
KodexplorerA web based file manager,web IDE / browser based code editor
Stars: ✭ 5,490 (+651.03%)
Lovely Forks💚 🍴 Show notable forks of GitHub repositories under their names.
Stars: ✭ 365 (-50.07%)
FinvizUnofficial API for finviz.com
Stars: ✭ 493 (-32.56%)
KatanaA Python Tool For google Hacking
Stars: ✭ 355 (-51.44%)
SpidrA versatile Ruby web spidering library that can spider a site, multiple domains, certain links or infinitely. Spidr is designed to be fast and easy to use.
Stars: ✭ 656 (-10.26%)
Xcrawler快速、简洁且强大的PHP爬虫框架
Stars: ✭ 344 (-52.94%)
FerretDeclarative web scraping
Stars: ✭ 4,837 (+561.7%)
Php ZipPhpZip is a php-library for extended work with ZIP-archives.
Stars: ✭ 336 (-54.04%)
StarchartsPlot your repository stars over time.
Stars: ✭ 560 (-23.39%)
AutoscraperA Smart, Automatic, Fast and Lightweight Web Scraper for Python
Stars: ✭ 4,077 (+457.73%)
DataflowkitExtract structured data from web sites. Web sites scraping.
Stars: ✭ 456 (-37.62%)
LinkedinLinkedin Scraper using Selenium Web Driver, Chromium headless, Docker and Scrapy
Stars: ✭ 309 (-57.73%)
Scala ScraperA Scala library for scraping content from HTML pages
Stars: ✭ 631 (-13.68%)
Git Archive AllA python script wrapper for git-archive that archives a git superproject and its submodules, if it has any. Takes into account .gitattributes
Stars: ✭ 302 (-58.69%)
Hquery.phpAn extremely fast web scraper that parses megabytes of invalid HTML in a blink of an eye. PHP5.3+, no dependencies.
Stars: ✭ 295 (-59.64%)
CheerioFast, flexible, and lean implementation of core jQuery designed specifically for the server.
Stars: ✭ 24,616 (+3267.44%)
WebinspectorRuby gem to inspect completely a web page. It scrapes a given URL, and returns you its meta, links, images more.
Stars: ✭ 288 (-60.6%)
SnscrapeA social networking service scraper in Python
Stars: ✭ 433 (-40.77%)
LinkaceYour self-hosted bookmark archive. Free and open source.
Stars: ✭ 657 (-10.12%)
SurgeonDeclarative DOM extraction expression evaluator. 👨⚕️
Stars: ✭ 653 (-10.67%)
Imagescraper✂️ High performance, multi-threaded image scraper
Stars: ✭ 630 (-13.82%)
2020ncov individual archives"Every individual matters. Every individual has a role to play." This is a repository that archives the individual stories during the COVID19 pandemic. 备份普通人在疫情期间的记录。(持续翻译 & 更新中)
Stars: ✭ 540 (-26.13%)