Trump LiesTutorial: Web scraping in Python with Beautiful Soup
Stars: ✭ 201 (+229.51%)
Web ScrapingDetailed web scraping tutorials for dummies with financial data crawlers on Reddit WallStreetBets, CME (both options and futures), US Treasury, CFTC, LME, SHFE and news data crawlers on BBC, Wall Street Journal, Al Jazeera, Reuters, Financial Times, Bloomberg, CNN, Fortune, The Economist
Stars: ✭ 153 (+150.82%)
wayback⏪ Tools to Work with the Various Internet Archive Wayback Machine APIs
Stars: ✭ 52 (-14.75%)
City ScrapersScrape, standardize and share public meetings from local government websites
Stars: ✭ 220 (+260.66%)
30 Days Of PythonLearn Python for the next 30 (or so) Days.
Stars: ✭ 1,748 (+2765.57%)
lopezCrawling and scraping the Web for fun and profit
Stars: ✭ 20 (-67.21%)
SqrapeSimple Query Scraping with CSS and Go Reflection (MOVED to Gitlab)
Stars: ✭ 144 (+136.07%)
YiffSpotA real-time web chat for "yiffing" randomly with other furries anonymously.
Stars: ✭ 18 (-70.49%)
Wayback Machine ScraperA command-line utility and Scrapy middleware for scraping time series data from Archive.org's Wayback Machine.
Stars: ✭ 230 (+277.05%)
Scrapyd Cluster On HerokuSet up free and scalable Scrapyd cluster for distributed web-crawling with just a few clicks. DEMO 👉
Stars: ✭ 106 (+73.77%)
crawlzoneCrawlzone is a fast asynchronous internet crawling framework for PHP.
Stars: ✭ 70 (+14.75%)
Short Jokes DatasetPython scripts for building 'Short Jokes' dataset, featured on Kaggle
Stars: ✭ 215 (+252.46%)
actor-content-checkerYou can use this act to monitor any page's content and get a notification when content changes.
Stars: ✭ 16 (-73.77%)
Twitter IntelligenceTwitter Intelligence OSINT project performs tracking and analysis of the Twitter
Stars: ✭ 179 (+193.44%)
HiA Programming language for Web Scraping
Stars: ✭ 14 (-77.05%)
iowebWeb Scraping Framework
Stars: ✭ 31 (-49.18%)
Juno crawlerScrapy crawler to collect data on the back catalog of songs listed for sale.
Stars: ✭ 150 (+145.9%)
appAn e621/e926 client, fetch and download posts and pools!
Stars: ✭ 14 (-77.05%)
Html MetadataMetaData html scraper and parser for Node.js (supports Promises and callback style)
Stars: ✭ 129 (+111.48%)
Neural-Scam-ArtistWeb Scraping, Document Deduplication & GPT-2 Fine-tuning with a newly created scam dataset.
Stars: ✭ 18 (-70.49%)
Dat8General Assembly's 2015 Data Science course in Washington, DC
Stars: ✭ 1,516 (+2385.25%)
fuzzysearchA site that allows you to reverse image search millions of furry images in under a second
Stars: ✭ 34 (-44.26%)
Scrape Linkedin Selenium`scrape_linkedin` is a python package that allows you to scrape personal LinkedIn profiles & company pages - turning the data into structured json.
Stars: ✭ 239 (+291.8%)
RodA Devtools driver for web automation and scraping
Stars: ✭ 1,392 (+2181.97%)
coreThe complete web scraping toolkit for PHP.
Stars: ✭ 1,110 (+1719.67%)
DocbaoCông cụ quét và phân tích từ khoá các trang báo mạng Việt Nam
Stars: ✭ 230 (+277.05%)
tanukaiFurry imageboard / Manga/anime image search engine
Stars: ✭ 25 (-59.02%)
Selenium Python HeliumSelenium-python but lighter: Helium is the best Python library for web automation.
Stars: ✭ 2,732 (+4378.69%)
2017-summer-workshopExercises, data, and more for our 2017 summer workshop (funded by the Estes Fund and in partnership with Project Jupyter and Berkeley's D-Lab)
Stars: ✭ 33 (-45.9%)
R Web Scraping Cheat SheetGuide, reference and cheatsheet on web scraping using rvest, httr and Rselenium.
Stars: ✭ 207 (+239.34%)
FurryBotFurry Bot for Discord
Stars: ✭ 17 (-72.13%)
Bet On SibylMachine Learning Model for Sport Predictions (Football, Basketball, Baseball, Hockey, Soccer & Tennis)
Stars: ✭ 190 (+211.48%)
PythonScrapyBasicSetupBasic setup with random user agents and IP addresses for Python Scrapy Framework.
Stars: ✭ 57 (-6.56%)
GrabWeb Scraping Framework
Stars: ✭ 2,147 (+3419.67%)
scrapy-wayback-machineA Scrapy middleware for scraping time series data from Archive.org's Wayback Machine.
Stars: ✭ 92 (+50.82%)
LearnpythonforresearchThis repository provides everything you need to get started with Python for (social science) research.
Stars: ✭ 163 (+167.21%)
Netflix CloneNetflix like full-stack application with SPA client and backend implemented in service oriented architecture
Stars: ✭ 156 (+155.74%)
TikTokDownloader PyWebIO🚀「Douyin_TikTok_Download_API」是一个开箱即用的高性能异步抖音|TikTok数据爬取工具,支持API调用,在线批量解析及下载。
Stars: ✭ 919 (+1406.56%)
HelenaA Chrome extension for writing custom web scraping programs and web automation programs. Just demonstrate how to collect the first row of data, then let the extension write the program for collecting all rows.
Stars: ✭ 151 (+147.54%)
UofT-Timetable-GeneratorA web application that generates timetables for university students at the University of Toronto
Stars: ✭ 34 (-44.26%)
PhpscraperPHP Scraper - an highly opinionated web-interface for PHP
Stars: ✭ 148 (+142.62%)
trafilaturaPython & command-line tool to gather text on the Web: web crawling/scraping, extraction of text, metadata, comments
Stars: ✭ 711 (+1065.57%)
ZillowZillow Scraper for Python using Selenium
Stars: ✭ 141 (+131.15%)
foxbotTelegram bot for finding furry image sources and inline mirroring
Stars: ✭ 25 (-59.02%)
Actor Page AnalyzerApify actor that opens a web page in headless Chrome and analyzes the HTML and JavaScript objects, looks for schema.org microdata and JSON-LD metadata, analyzes AJAX requests, etc.
Stars: ✭ 124 (+103.28%)
savedditBulk Downloader for Reddit
Stars: ✭ 130 (+113.11%)
Ayakashi⚡️ Ayakashi.io - The next generation web scraping framework
Stars: ✭ 117 (+91.8%)
e621-api-docsDocumentation library for the e621's API
Stars: ✭ 34 (-44.26%)
Save For OfflineAndroid app for saving webpages for offline reading.
Stars: ✭ 114 (+86.89%)
codepen-puppeteerUse Puppeteer to download pens from Codepen.io as single html pages
Stars: ✭ 22 (-63.93%)
rawr-x3dhTypeScript Implementation of X3DH
Stars: ✭ 51 (-16.39%)
Pythoncovers python basic to advance topics, practice questions, logical problems in python, web development using html, css, bootstrap, jquery, DOM, Django 🚀🚀. 💥 🌈
Stars: ✭ 29 (-52.46%)
reapr🕸→ℹ️ Reap Information from Websites
Stars: ✭ 14 (-77.05%)
Stock-Market-PredictorStock Market Predictor with LSTM network. Web scraping and analyzing tools (ohlc, mean)
Stars: ✭ 28 (-54.1%)
web-poetWeb scraping Page Objects core library
Stars: ✭ 67 (+9.84%)
Quora ApiAn unofficial API for Quora.
Stars: ✭ 250 (+309.84%)