raspagem-de-dados-fatec📓 Minicurso de raspagem de dados web com Python ministrado na Semana de Tecnologia da FATEC Jundiaí
Stars: ✭ 22 (-90.79%)
pluralsight scrapperA course downloader/scrapper for https://www.pluralsight.com
Stars: ✭ 39 (-83.68%)
facebook-discussion-tkA collection of tools to (semi-)automatically collect and analyze data from online discussions on Facebook groups and pages.
Stars: ✭ 33 (-86.19%)
SocialInfo4Jfetch data from Facebook, Instagram and LinkedIn
Stars: ✭ 44 (-81.59%)
The EndorserAn OSINT tool that allows you to draw out relationships between people on LinkedIn via endorsements/skills.
Stars: ✭ 269 (+12.55%)
Apify JsApify SDK — The scalable web scraping and crawling library for JavaScript/Node.js. Enables development of data extraction and web automation jobs (not only) with headless Chrome and Puppeteer.
Stars: ✭ 3,154 (+1219.67%)
Php Curl ClassPHP Curl Class makes it easy to send HTTP requests and integrate with web APIs
Stars: ✭ 2,903 (+1114.64%)
HumanoidNode.js package to bypass CloudFlare's anti-bot JavaScript challenges
Stars: ✭ 88 (-63.18%)
WebdriverextensionsMake your WebDriver based Selenium tests more readable, reusability and maintainable by using WebDriver Extensions!
Stars: ✭ 89 (-62.76%)
Goose ParserUniversal scrapping tool, which allows you to extract data using multiple environments
Stars: ✭ 211 (-11.72%)
ZeiverA Scraper, Downloader, & Recorder for static open directories.
Stars: ✭ 14 (-94.14%)
PulsarTurn large Web sites into tables and charts using simple SQLs.
Stars: ✭ 100 (-58.16%)
CrawlyCrawly, a high-level web crawling & scraping framework for Elixir.
Stars: ✭ 440 (+84.1%)
DataflowkitExtract structured data from web sites. Web sites scraping.
Stars: ✭ 456 (+90.79%)
Undetected ChromedriverCustom Selenium Chromedriver | Zero-Config | Passes ALL bot mitigation systems (like Distil / Imperva/ Datadadome / CloudFlare IUAM)
Stars: ✭ 365 (+52.72%)
GeziyorGeziyor, a fast web crawling & scraping framework for Go. Supports JS rendering.
Stars: ✭ 1,246 (+421.34%)
Hockey ScraperPython Package for scraping NHL Play-by-Play and Shift data
Stars: ✭ 93 (-61.09%)
WhatsappbotSend messages to any person in any time how much you want.
Stars: ✭ 104 (-56.49%)
Scrapysharpreborn of https://bitbucket.org/rflechner/scrapysharp
Stars: ✭ 226 (-5.44%)
Imagescraper✂️ High performance, multi-threaded image scraper
Stars: ✭ 630 (+163.6%)
Gisaid ScrapperScrapping tool for GISAID data regarding SARS-CoV-2
Stars: ✭ 25 (-89.54%)
E2e ExperimentA demo project with Spring Boot / Angular application and e2e tests
Stars: ✭ 9 (-96.23%)
Botvid 19Messenger Bot that scrapes for COVID-19 data and periodically updates subscribers via Facebook Messages. Created using Python/Flask, MYSQL, HTML, Heroku
Stars: ✭ 34 (-85.77%)
TorScrapperA Scraper made 100% in Python using BeautifulSoup and Tor. It can be used to scrape both normal and onion links. Happy Scraping :)
Stars: ✭ 24 (-89.96%)
Scrapy CraigslistWeb Scraping Craigslist's Engineering Jobs in NY with Scrapy
Stars: ✭ 54 (-77.41%)
Wdio Video ReporterReporter for WebdriverIO v6 that makes videos of failed tests and has optional allure integration
Stars: ✭ 53 (-77.82%)
PyleniumioBring the best of Selenium and Cypress into a single Python package
Stars: ✭ 61 (-74.48%)
Project TauroA Router WiFi key recovery/cracking tool with a twist.
Stars: ✭ 52 (-78.24%)
CfseleniumA native Selenium WebDriver binding for ColdFusion
Stars: ✭ 77 (-67.78%)
CabbieWebDriver for the masses
Stars: ✭ 70 (-70.71%)
SelenoidSelenium Hub successor running browsers within containers. Scalable, immutable, self hosted Selenium-Grid on any platform with single binary.
Stars: ✭ 2,065 (+764.02%)
DaftlistingsA library that enables programmatic interaction with daft.ie. Daft.ie has nationwide coverage and contains about 80% of the total available properties in Ireland.
Stars: ✭ 86 (-64.02%)
Web ScrapingDetailed web scraping tutorials for dummies with financial data crawlers on Reddit WallStreetBets, CME (both options and futures), US Treasury, CFTC, LME, SHFE and news data crawlers on BBC, Wall Street Journal, Al Jazeera, Reuters, Financial Times, Bloomberg, CNN, Fortune, The Economist
Stars: ✭ 153 (-35.98%)
InstaloctrackAn Instagram OSINT tool to collect all the geotagged locations available on an Instagram profile in order to plot them on a map, and dump them in a JSON.
Stars: ✭ 85 (-64.44%)
Splashr💦 Tools to Work with the 'Splash' JavaScript Rendering Service in R
Stars: ✭ 93 (-61.09%)
SerpscrapSEO python scraper to extract data from major searchengine result pages. Extract data like url, title, snippet, richsnippet and the type from searchresults for given keywords. Detect Ads or make automated screenshots. You can also fetch text content of urls provided in searchresults or by your own. It's usefull for SEO and business related research tasks.
Stars: ✭ 153 (-35.98%)
MarionetteSelenium alternative for Crystal. Browser manipulation without the Java overhead.
Stars: ✭ 119 (-50.21%)
MoonAn efficient Selenium protocol implementation running everything in Kubernetes or Openshift
Stars: ✭ 116 (-51.46%)
WebdrivermanagerWebDriverManager (Copyright © 2015-2021) is a project created and maintained by Boni Garcia and licensed under the terms of the Apache 2.0 License.
Stars: ✭ 1,808 (+656.49%)
Horn3tPowerful Visual Subdomain Enumeration at the Click of a Mouse
Stars: ✭ 120 (-49.79%)
Csharp.webdriverBrowser test automation using Selenium WebDriver in C#
Stars: ✭ 115 (-51.88%)
AyespyA performant visual regression testing tool
Stars: ✭ 150 (-37.24%)
Java.webdriverBrowser test automation using Selenium WebDriver in Java
Stars: ✭ 135 (-43.51%)
ThirtyfourSelenium WebDriver client for Rust, for automated testing of websites
Stars: ✭ 191 (-20.08%)
Frameworkium CoreFramework for writing maintainable Selenium and REST API tests in Java.
Stars: ✭ 107 (-55.23%)
Html MetadataMetaData html scraper and parser for Node.js (supports Promises and callback style)
Stars: ✭ 129 (-46.03%)
Bet On SibylMachine Learning Model for Sport Predictions (Football, Basketball, Baseball, Hockey, Soccer & Tennis)
Stars: ✭ 190 (-20.5%)
Selenium extensionsTools that will make writing tests, bots and scrapers using Selenium much easier
Stars: ✭ 140 (-41.42%)
SqrapeSimple Query Scraping with CSS and Go Reflection (MOVED to Gitlab)
Stars: ✭ 144 (-39.75%)
Anime DlAnime-dl is a command-line program to download anime from CrunchyRoll and Funimation.
Stars: ✭ 190 (-20.5%)
PWAFPython Webdriver Automation Framework
Stars: ✭ 37 (-84.52%)