Languagepod101 ScraperPython scraper for Language Pods such as Japanesepod101.com πΉ πΎ π£ Compatible with Japanese, Chinese, French, German, Italian, Korean, Portuguese, Russian, Spanish and many more! β¨
Stars: β 104 (+92.59%)
TorScrapperA Scraper made 100% in Python using BeautifulSoup and Tor. It can be used to scrape both normal and onion links. Happy Scraping :)
Stars: β 24 (-55.56%)
chopperChopper is a tool to extract elements from HTML by preserving ancestors and CSS rules
Stars: β 22 (-59.26%)
ScrappleA framework for creating semi-automatic web content extractors
Stars: β 464 (+759.26%)
Scraper-ProjectsπΈ List of mini projects that involve web scraping πΈ
Stars: β 25 (-53.7%)
Requests HtmlPythonic HTML Parsing for Humansβ’
Stars: β 12,268 (+22618.52%)
SoccerLeagueViewAn Android lib that display a league table
Stars: β 18 (-66.67%)
SouqscraperSimple scriptes for Level UP your scraping Skills, and source code for Level UP playlist on Youtube
Stars: β 118 (+118.52%)
google-scraperThis class can retrieve search results from Google.
Stars: β 33 (-38.89%)
Search Engine ParserLightweight package to query popular search engines and scrape for result titles, links and descriptions
Stars: β 216 (+300%)
CollyElegant Scraper and Crawler Framework for Golang
Stars: β 15,535 (+28668.52%)
TransistorTransistor, a Python web scraping framework for intelligent use cases.
Stars: β 205 (+279.63%)
node-express-reddit-cloneBuild a Node, Express and MySQL-based clone of Reddit for DecodeMTL web development bootcamp
Stars: β 28 (-48.15%)
ChampA Telegram bot combined with python to serve some basic functions like weather, music charts, cricket score and much more.
Stars: β 22 (-59.26%)
GooglescraperA Python module to scrape several search engines (like Google, Yandex, Bing, Duckduckgo, ...). Including asynchronous networking support.
Stars: β 2,363 (+4275.93%)
IdtImage Dataset Tool (idt) is a cli tool designed to make the otherwise repetitive and slow task of creating image datasets into a fast and intuitive process.
Stars: β 202 (+274.07%)
kirby-highlighterπ Server-side syntax highlighting for the Kirby code block & KirbyText
Stars: β 18 (-66.67%)
Jsonframe Cheeriosimple multi-level scraper json input/output for Cheerio
Stars: β 196 (+262.96%)
Anime DlAnime-dl is a command-line program to download anime from CrunchyRoll and Funimation.
Stars: β 190 (+251.85%)
PythonScrapyBasicSetupBasic setup with random user agents and IP addresses for Python Scrapy Framework.
Stars: β 57 (+5.56%)
Pahe.ph-ScraperPahe.ph [Pahe.in] Movies Website Scraper
Stars: β 57 (+5.56%)
Linkedin Profile Scraperπ΅οΈββοΈ LinkedIn profile scraper returning structured profile data in JSON. Works in 2020.
Stars: β 171 (+216.67%)
ArachnidCrawl all unique internal links found on a given website, and extract SEO related information - supports javascript based sites
Stars: β 224 (+314.81%)
Whatsapp-NetGenerate a network graph of connections from your WhatsApp groups data
Stars: β 75 (+38.89%)
Goose ParserUniversal scrapping tool, which allows you to extract data using multiple environments
Stars: β 211 (+290.74%)
reddit-image-fetcherA JavaScript package for fetching reddit images, memes, wallpapers and more.
Stars: β 40 (-25.93%)
ThalGetting started with Puppeteer and Chrome Headless for Web Scraping
Stars: β 2,345 (+4242.59%)
crypto-subreddits-cliπ½ Track Cryptocurrency Subreddits On The Command Line π½
Stars: β 24 (-55.56%)
PantherA browser testing and web crawling library for PHP and Symfony
Stars: β 2,480 (+4492.59%)
Base2Tone-iterm2Syntax highlighting colorschemes for iTerm2
Stars: β 29 (-46.3%)
Jikan RestThe REST API for Jikan
Stars: β 200 (+270.37%)
HighlightTranslatorHighlight Translator can help you to translate the words quickly and accurately. By only highlighting, copying, or screenshoting the content you want to translate anywhere on your computer (ex. PDF, PPT, WORD etc.), the translated results will then be automatically displayed before you.
Stars: β 54 (+0%)
AntchAntch, a fast, powerful and extensible web crawling & scraping framework for Go
Stars: β 198 (+266.67%)
guideA new feature guide component by react π§
Stars: β 597 (+1005.56%)
JuriscraperAn API to scrape American court websites for metadata.
Stars: β 194 (+259.26%)
ChromaTermColor your Terminal with RegEx!
Stars: β 149 (+175.93%)
kickoffOpen Kick-Off is a fun rewriting attempt of the cult football game Kick Off 2 designed by Dino Dini and released in 1990 by Anco for the Atari ST and the Commodore Amiga. It is written in Java with the help of libGDX.
Stars: β 32 (-40.74%)
Secret AgentThe web browser that's built for scraping.
Stars: β 151 (+179.63%)
MusoqUse SQL on various data sources
Stars: β 252 (+366.67%)
SerpscrapSEO python scraper to extract data from major searchengine result pages. Extract data like url, title, snippet, richsnippet and the type from searchresults for given keywords. Detect Ads or make automated screenshots. You can also fetch text content of urls provided in searchresults or by your own. It's usefull for SEO and business related research tasks.
Stars: β 153 (+183.33%)
List Of User AgentsList of major web + mobile browser user agent strings. +1 Bonus script to scrape :)
Stars: β 247 (+357.41%)
XqueryExtract data or evaluate value from HTML/XML documents using XPath
Stars: β 155 (+187.04%)
Shadow UseragentPick the most common user-agents on the Internet π»
Stars: β 147 (+172.22%)
MemoriousDistributed crawling framework for documents and structured data.
Stars: β 248 (+359.26%)
PhpscraperPHP Scraper - an highly opinionated web-interface for PHP
Stars: β 148 (+174.07%)
Fantasy Basketball Scraping statistics, predicting NBA player performance with neural networks and boosting algorithms, and optimising lineups for Draft Kings with genetic algorithm. Capstone Project for Machine Learning Engineer Nanodegree by Udacity.
Stars: β 146 (+170.37%)
ARGoalGet more goals. | Virtual Goals & Goal Distance | App Doctor Hu
Stars: β 14 (-74.07%)
pickall.NET agile and extensible web searching API
Stars: β 25 (-53.7%)
Loconotionπ Python tool to turn Notion.so pages into lightweight, customizable static websites
Stars: β 237 (+338.89%)
SqrapeSimple Query Scraping with CSS and Go Reflection (MOVED to Gitlab)
Stars: β 144 (+166.67%)
EmbedGet info from any web service or page
Stars: β 1,808 (+3248.15%)
Educative.io Downloaderπ This tool is to download course from educative.io for offline usage. It uses your login credentials and download the course.
Stars: β 139 (+157.41%)
github-languagesTiny little ruby on rails website that crawls though your public github repos to find out what your favourite languages are.
Stars: β 23 (-57.41%)