SqrapeSimple Query Scraping with CSS and Go Reflection (MOVED to Gitlab)
Stars: ✭ 144 (-25.77%)
Artooartoo.js - the client-side scraping companion.
Stars: ✭ 1,029 (+430.41%)
SeleniumcrawlerAn example using Selenium webdrivers for python and Scrapy framework to create a web scraper to crawl an ASP site
Stars: ✭ 117 (-39.69%)
Nase StrategieChceme mít náš stát konečně rádi a být na něj hrdí. Možná je to utopie... ale do 10 let začne upadat automobilový průmysl a naší zemi zbyde jen černý humor a "vyvezení talenti" za hranice. Je třeba nastartovat změnu, která udělá naše společenské a ekonomické prostředí nejatraktivnějším na světě.
Stars: ✭ 43 (-77.84%)
Requests HtmlPythonic HTML Parsing for Humans™
Stars: ✭ 12,268 (+6223.71%)
ConfigsPublic, free to use, repository with diggers configs for scraping / extracting data from various e-commerce websites and online stores
Stars: ✭ 37 (-80.93%)
ScrapyScrapy, a fast high-level web crawling & scraping framework for Python.
Stars: ✭ 42,343 (+21726.29%)
Openpolice PlatformAn open source web publishing platform for police forces.
Stars: ✭ 15 (-92.27%)
Data.govData.gov source code and issue tracker
Stars: ✭ 1,856 (+856.7%)
Scrapy ClusterThis Scrapy project uses Redis and Kafka to create a distributed on demand scraping cluster.
Stars: ✭ 921 (+374.74%)
Laravel Bank StatementsLaravel package to collect your bank statements history. Currently support for parsing statements history from BCA, Mandiri, BNI, and MUAMALAT e-banking websites.
Stars: ✭ 105 (-45.88%)
Atd Data And PerformanceOpen data and performance hub for the City of Austin Transportation Department
Stars: ✭ 17 (-91.24%)
Datasets For GoodList of datasets to apply stats/machine learning/technology to the world of social good.
Stars: ✭ 174 (-10.31%)
WebhereHTML scraping for Objective-C.
Stars: ✭ 16 (-91.75%)
Languagepod101 ScraperPython scraper for Language Pods such as Japanesepod101.com 👹 🗾 🍣 Compatible with Japanese, Chinese, French, German, Italian, Korean, Portuguese, Russian, Spanish and many more! ✨
Stars: ✭ 104 (-46.39%)
Factbook.jsonWorld Factbook Country Profiles in JSON - Free Open Public Domain Data - No API Key Required ;-)
Stars: ✭ 750 (+286.6%)
Osd Bike RoutesOpen source release of bike routes in Chicago.
Stars: ✭ 140 (-27.84%)
DotnetcrawlerDotnetCrawler is a straightforward, lightweight web crawling/scrapying library for Entity Framework Core output based on dotnet core. This library designed like other strong crawler libraries like WebMagic and Scrapy but for enabling extandable your custom requirements. Medium link : https://medium.com/@mehmetozkaya/creating-custom-web-crawler-with-dotnet-core-using-entity-framework-core-ec8d23f0ca7c
Stars: ✭ 100 (-48.45%)
Imagescraper✂️ High performance, multi-threaded image scraper
Stars: ✭ 630 (+224.74%)
XqueryExtract data or evaluate value from HTML/XML documents using XPath
Stars: ✭ 155 (-20.1%)
NewcrawlerFree Web Scraping Tool with Java
Stars: ✭ 589 (+203.61%)
NintendealsLibrary with a set of tools for scraping information about Nintendo games and its prices across all regions (NA, EU and JP).
Stars: ✭ 94 (-51.55%)
TabulaTabula is a tool for liberating data tables trapped inside PDF files
Stars: ✭ 5,420 (+2693.81%)
Gazpacho🥫 The simple, fast, and modern web scraping library
Stars: ✭ 525 (+170.62%)
HumanoidNode.js package to bypass CloudFlare's anti-bot JavaScript challenges
Stars: ✭ 88 (-54.64%)
Facebook data analyzerAnalyze facebook copy of your data with ruby language. Download zip file from facebook and get info about friends ranking by message, vocabulary, contacts, friends added statistics and more
Stars: ✭ 515 (+165.46%)
Anime DlAnime-dl is a command-line program to download anime from CrunchyRoll and Funimation.
Stars: ✭ 190 (-2.06%)
NickjsWeb scraping library made by the Phantombuster team. Modern, simple & works on all websites. (Deprecated)
Stars: ✭ 494 (+154.64%)
FerretDeclarative web scraping
Stars: ✭ 4,837 (+2393.3%)
UdemycoursegrabberYour will to enroll in Udemy course is here, but the money isn't? Search no more! This python program searches for your desired course in more than [insert big number here] websites, compares the last updated date, and gives you the download link of the latest one back, but you also have the choice to see the other ones as well!
Stars: ✭ 137 (-29.38%)
DataflowkitExtract structured data from web sites. Web sites scraping.
Stars: ✭ 456 (+135.05%)
GeziyorGeziyor, a fast web crawling & scraping framework for Go. Supports JS rendering.
Stars: ✭ 1,246 (+542.27%)
MechanizeMechanize is a ruby library that makes automated web interaction easy.
Stars: ✭ 4,158 (+2043.3%)
LookylooLookyloo is a web interface that allows users to capture a website page and then display a tree of domains that call each other.
Stars: ✭ 381 (+96.39%)
Undetected ChromedriverCustom Selenium Chromedriver | Zero-Config | Passes ALL bot mitigation systems (like Distil / Imperva/ Datadadome / CloudFlare IUAM)
Stars: ✭ 365 (+88.14%)
CoronadatascraperCOVID-19 Coronavirus data scraped from government and curated data sources.
Stars: ✭ 372 (+91.75%)
Government.github.comGather, curate, and feature stories of public servants and civic hackers using GitHub as part of their open government innovations
Stars: ✭ 1,223 (+530.41%)
Comic DlComic-dl is a command line tool to download manga and comics from various comic and manga sites. Supported sites : readcomiconline.to, mangafox.me, comic naver and many more.
Stars: ✭ 365 (+88.14%)
SocialreaperSocial media scraping / data collection library for Facebook, Twitter, Reddit, YouTube, Pinterest, and Tumblr APIs
Stars: ✭ 338 (+74.23%)
ViewstateASP.NET View State Decoder
Stars: ✭ 77 (-60.31%)
Tinking🧶 Extract data from any website without code, just clicks.
Stars: ✭ 331 (+70.62%)
SpidermonScrapy Extension for monitoring spiders execution.
Stars: ✭ 309 (+59.28%)
Elixir ScrapeScrape any website, article or RSS/Atom Feed with ease!
Stars: ✭ 306 (+57.73%)
PhpscraperPHP Scraper - an highly opinionated web-interface for PHP
Stars: ✭ 148 (-23.71%)
Api StoreContains all the public APIs listed in Phantombuster's API store. Pull requests welcome!
Stars: ✭ 69 (-64.43%)
Design SystemOpen source design and front-end development resources for creating Section 508 compliant, responsive, and consistent websites.
Stars: ✭ 192 (-1.03%)
RsocrataProvides easier interaction with Socrata open data portals http://dev.socrata.com. Users can provide a 'Socrata' data set resource URL, or a 'Socrata' Open Data API (SoDA) web query, or a 'Socrata' "human-friendly" URL, returns an R data frame. Converts dates to 'POSIX' format. Manages throttling by 'Socrata'.
Stars: ✭ 182 (-6.19%)
Developers.italia.itThe developer community designing and developing public digital services in Italy
Stars: ✭ 158 (-18.56%)
Fantasy Basketball Scraping statistics, predicting NBA player performance with neural networks and boosting algorithms, and optimising lineups for Draft Kings with genetic algorithm. Capstone Project for Machine Learning Engineer Nanodegree by Udacity.
Stars: ✭ 146 (-24.74%)
Awesome PuppeteerA curated list of awesome puppeteer resources.
Stars: ✭ 1,728 (+790.72%)
SaplSistema de Apoio ao Processo Legislativo
Stars: ✭ 63 (-67.53%)