AutoscraperA Smart, Automatic, Fast and Lightweight Web Scraper for Python
Stars: ✭ 4,077 (+27080%)
WswpCode for the second edition Web Scraping with Python book by Packt Publications
Stars: ✭ 112 (+646.67%)
ConfigsPublic, free to use, repository with diggers configs for scraping / extracting data from various e-commerce websites and online stores
Stars: ✭ 37 (+146.67%)
anikimiapiA Simple, LightWeight, Statically-Typed Python3 API wrapper for GogoAnime.
Stars: ✭ 15 (+0%)
SoupWeb Scraper in Go, similar to BeautifulSoup
Stars: ✭ 1,685 (+11133.33%)
SuckitSuck the InTernet
Stars: ✭ 429 (+2760%)
Hq bot📲 Bot to help solve HQ trivia
Stars: ✭ 167 (+1013.33%)
Instagram-Scraper-2021Scrape Instagram content and stories anonymously, using a new technique based on the har file (No Token + No public API).
Stars: ✭ 57 (+280%)
Clock可视化任务调度系统,精简到一个二进制文件 (Web visual task scheduler system , yes ! just one binary solve all the problems !)
Stars: ✭ 86 (+473.33%)
allitebooks.comDownload all the ebooks with indexed csv of "allitebooks.com"
Stars: ✭ 24 (+60%)
HuginnCreate agents that monitor and act on your behalf. Your agents are standing by!
Stars: ✭ 33,694 (+224526.67%)
InstascrapePowerful and flexible Instagram scraping library for Python, providing easy-to-use and expressive tools for accessing data programmatically
Stars: ✭ 202 (+1246.67%)
Php CrawlerA php crawler that finds emails on the internets
Stars: ✭ 119 (+693.33%)
Proxy requestsa class that uses scraped proxies to make http GET/POST requests (Python requests)
Stars: ✭ 357 (+2280%)
Nytimes App🗽 A Simple Demonstration of the New York Times App 📱 using Jsoup web crawler with MVVM Architecture 🔥
Stars: ✭ 246 (+1540%)
ImghashPerceptual image hashing for Node.js
Stars: ✭ 98 (+553.33%)
amelia 2.0An Artificial Intelligence Chat Bot and Service Provider written in Python and AIML.
Stars: ✭ 19 (+26.67%)
Youtube ProjectsThis repository contains all the code I use in my YouTube tutorials.
Stars: ✭ 144 (+860%)
InstagoDownload/access photos, videos, stories, story highlights, postlives, following and followers of Instagram
Stars: ✭ 59 (+293.33%)
Sneakerbot AppApp that scrapes the Footlocker website to construct URLs for upcoming sneaker releases and adds the shoe to your cart if it is available. Uses Python and Selenium Webdriver. *Chrome and Chromedriver must be installed and Chromedriver must be on main path
Stars: ✭ 54 (+260%)
OkanimeDownloaderScrape your favorite Anime from Okanime.com without effort
Stars: ✭ 13 (-13.33%)
Ralgerralger makes it easy to scrape a website. Built on the shoulders of titans: rvest, xml2.
Stars: ✭ 130 (+766.67%)
Tradingview Data ScraperExtract price and indicator data from TradingView charts to create ML datasets
Stars: ✭ 203 (+1253.33%)
RedditsfinderArchive a reddit user's post history. Formatted overview of a profile, JSON containing every post, and picture downloads. Uses the pushshift API.
Stars: ✭ 28 (+86.67%)
Anirip🎬 A Crunchyroll show/season ripper
Stars: ✭ 127 (+746.67%)
Sig To GooglecalendarA python script to get class schedules on UFLA's SIG and convert to a .CSV file to use in Google Calendar
Stars: ✭ 14 (-6.67%)
PoliteBe nice on the web
Stars: ✭ 253 (+1586.67%)
DatadoubleconfirmSimple datasets and notebooks for data visualization, statistical analysis and modelling - with write-ups here: http://projectosyo.wix.com/datadoubleconfirm.
Stars: ✭ 24 (+60%)
Gazpacho🥫 The simple, fast, and modern web scraping library
Stars: ✭ 525 (+3400%)
FalkorOpen Source web scraping API. Falkor turns web pages into queryable JSON
Stars: ✭ 184 (+1126.67%)
MorphTake the hassle out of web scraping
Stars: ✭ 421 (+2706.67%)
NytcrosswordAn exploration of New York Times crossword answers from 1994-2017, i.e. the Will Shortz era.
Stars: ✭ 117 (+680%)
XidelCommand line tool to download and extract data from HTML/XML pages or JSON-APIs, using CSS, XPath 3.0, XQuery 3.0, JSONiq or pattern matching. It can also create new or transformed XML/HTML/JSON documents.
Stars: ✭ 335 (+2133.33%)
NordVPN-switcherRotate between different NordVPN servers with ease. Works both on Linux and Windows without any required changes to your code!
Stars: ✭ 143 (+853.33%)
RcrawlerAn R web crawler and scraper
Stars: ✭ 274 (+1726.67%)
DotnetcrawlerDotnetCrawler is a straightforward, lightweight web crawling/scrapying library for Entity Framework Core output based on dotnet core. This library designed like other strong crawler libraries like WebMagic and Scrapy but for enabling extandable your custom requirements. Medium link : https://medium.com/@mehmetozkaya/creating-custom-web-crawler-with-dotnet-core-using-entity-framework-core-ec8d23f0ca7c
Stars: ✭ 100 (+566.67%)
web checkScript for checking changes in webpages
Stars: ✭ 50 (+233.33%)
DecryptrAn extensible API for breaking captchas
Stars: ✭ 154 (+926.67%)
ARGUSARGUS is an easy-to-use web scraping tool. The program is based on the Scrapy Python framework and is able to crawl a broad range of different websites. On the websites, ARGUS is able to perform tasks like scraping texts or collecting hyperlinks between websites. See: https://link.springer.com/article/10.1007/s11192-020-03726-9
Stars: ✭ 68 (+353.33%)
Udemy botAn automation bot for free Udemy courses
Stars: ✭ 91 (+506.67%)
covid19-apiCovid19 Data API (JSON) - LIVE
Stars: ✭ 20 (+33.33%)
CrosslinkedLinkedIn enumeration tool to extract valid employee names from an organization through search engine scraping
Stars: ✭ 223 (+1386.67%)
Utlyz-CLILet's you to access your FB account from the command line and returns various things number of unread notifications, messages or friend requests you have.
Stars: ✭ 30 (+100%)
Covid 19 jhu data web scrap and cleaningThis repository contains data and code used to get and clean data from https://github.com/CSSEGISandData/COVID-19 and https://www.worldometers.info/coronavirus/
Stars: ✭ 80 (+433.33%)
zimitMake a ZIM file from any Web site and surf offline!
Stars: ✭ 67 (+346.67%)
StardoxGithub stargazers information gathering tool
Stars: ✭ 130 (+766.67%)
GoodReadsScraper📚 A GoodReads.com Scraper script to get books reviews including text and rating.
Stars: ✭ 36 (+140%)
aws-pdf-textract-pipeline🔍 Data pipeline for crawling PDFs from the Web and transforming their contents into structured data using AWS textract. Built with AWS CDK + TypeScript
Stars: ✭ 141 (+840%)
TiktokbotA TikTokBot that downloads trending tiktok videos and compiles them using FFmpeg
Stars: ✭ 126 (+740%)
Fifa Fut DataWeb-scraping script that writes the data of all players from FutHead and FutBin to a CSV file or a DB
Stars: ✭ 55 (+266.67%)