chopperChopper is a tool to extract elements from HTML by preserving ancestors and CSS rules
Stars: ✭ 22 (-99.82%)
Languagepod101 ScraperPython scraper for Language Pods such as Japanesepod101.com 👹 🗾 🍣 Compatible with Japanese, Chinese, French, German, Italian, Korean, Portuguese, Russian, Spanish and many more! ✨
Stars: ✭ 104 (-99.15%)
SD-streamsAnime streaming without ads using Beautifulsoup and requests Python
Stars: ✭ 18 (-99.85%)
MechanicalsoupA Python library for automating interaction with websites.
Stars: ✭ 3,863 (-68.51%)
dnevnikrudnevnik.ru parser
Stars: ✭ 20 (-99.84%)
TransistorTransistor, a Python web scraping framework for intelligent use cases.
Stars: ✭ 205 (-98.33%)
TorScrapperA Scraper made 100% in Python using BeautifulSoup and Tor. It can be used to scrape both normal and onion links. Happy Scraping :)
Stars: ✭ 24 (-99.8%)
tiktok-downloaderTiktok Downloader/Scraper using requests & bs4
Stars: ✭ 47 (-99.62%)
info-bot🤖 A Versatile Telegram Bot
Stars: ✭ 37 (-99.7%)
crawlerrequests+lxml爬虫,简单爬虫架构
Stars: ✭ 72 (-99.41%)
Turkce Python KaynaklariTürkçe olarak hazırlanmış Python programlama dili ile ilgili içeriklerin derlendiği sayfa.
Stars: ✭ 295 (-97.6%)
SouqscraperSimple scriptes for Level UP your scraping Skills, and source code for Level UP playlist on Youtube
Stars: ✭ 118 (-99.04%)
Euro2016 TerminalApp⚽ Instantly find 🏆EURO 2016 live-streams & highlights, now a Web App!
Stars: ✭ 54 (-99.56%)
iHealth crawleriHealth 项目的内容爬虫(一个基于 python 和 MongoDB 的医疗咨询爬虫)
Stars: ✭ 24 (-99.8%)
Scraper-Projects🕸 List of mini projects that involve web scraping 🕸
Stars: ✭ 25 (-99.8%)
Sasila一个灵活、友好的爬虫框架
Stars: ✭ 286 (-97.67%)
SJS DROPSScript using requests module to register accounts to Slam Jam Socialism raffles.
Stars: ✭ 21 (-99.83%)
ScrappleA framework for creating semi-automatic web content extractors
Stars: ✭ 464 (-96.22%)
Pitchfork🎶 Unofficial python API for pitchfork.com reviews.
Stars: ✭ 67 (-99.45%)
UdemycoursegrabberYour will to enroll in Udemy course is here, but the money isn't? Search no more! This python program searches for your desired course in more than [insert big number here] websites, compares the last updated date, and gives you the download link of the latest one back, but you also have the choice to see the other ones as well!
Stars: ✭ 137 (-98.88%)
Examples Of Web Crawlers一些非常有趣的python爬虫例子,对新手比较友好,主要爬取淘宝、天猫、微信、豆瓣、QQ等网站。(Some interesting examples of python crawlers that are friendly to beginners. )
Stars: ✭ 10,724 (-12.59%)
Ni PytMateriály k předmětu NI-PYT na FIT ČVUT
Stars: ✭ 112 (-99.09%)
Fantasy Basketball Scraping statistics, predicting NBA player performance with neural networks and boosting algorithms, and optimising lineups for Draft Kings with genetic algorithm. Capstone Project for Machine Learning Engineer Nanodegree by Udacity.
Stars: ✭ 146 (-98.81%)
Incapsula Cracker Py3Python3 compatible way to bypass sites guarded with Incapsula
Stars: ✭ 132 (-98.92%)
JobfunnelScrape job websites into a single spreadsheet with no duplicates.
Stars: ✭ 1,528 (-87.54%)
FlokiFloki is a simple HTML parser that enables search for nodes using CSS selectors.
Stars: ✭ 1,642 (-86.62%)
AutolinkAutoLink是一个开源Web IDE自动化测试集成解决方案
Stars: ✭ 129 (-98.95%)
Hivelots of spider (很多爬虫)
Stars: ✭ 110 (-99.1%)
SerpscrapSEO python scraper to extract data from major searchengine result pages. Extract data like url, title, snippet, richsnippet and the type from searchresults for given keywords. Detect Ads or make automated screenshots. You can also fetch text content of urls provided in searchresults or by your own. It's usefull for SEO and business related research tasks.
Stars: ✭ 153 (-98.75%)
GrequestsA Go "clone" of the great and famous Requests library
Stars: ✭ 1,843 (-84.98%)
Torchbear🔥🐻 The Speakeasy Scripting Engine Which Combines Speed, Safety, and Simplicity
Stars: ✭ 128 (-98.96%)
SnugWrite reusable web API interactions
Stars: ✭ 108 (-99.12%)
RequestsA simple, yet elegant, HTTP library.
Stars: ✭ 46,558 (+279.51%)
ScrapyScrapy, a fast high-level web crawling & scraping framework for Python.
Stars: ✭ 42,343 (+245.15%)
WebmagicA scalable web crawler framework for Java.
Stars: ✭ 10,186 (-16.97%)
SqrapeSimple Query Scraping with CSS and Go Reflection (MOVED to Gitlab)
Stars: ✭ 144 (-98.83%)
SoupWeb Scraper in Go, similar to BeautifulSoup
Stars: ✭ 1,685 (-86.27%)
Laravel Bank StatementsLaravel package to collect your bank statements history. Currently support for parsing statements history from BCA, Mandiri, BNI, and MUAMALAT e-banking websites.
Stars: ✭ 105 (-99.14%)
D4n155OWASP D4N155 - Intelligent and dynamic wordlist using OSINT
Stars: ✭ 105 (-99.14%)
RequestiumIntegration layer between Requests and Selenium for automation of web actions.
Stars: ✭ 1,618 (-86.81%)
PudzuVarious python scripts, mostly geared towards dataviz.
Stars: ✭ 104 (-99.15%)
XqueryExtract data or evaluate value from HTML/XML documents using XPath
Stars: ✭ 155 (-98.74%)
Request MigrationsHTTP Request Migrations for API Versioning like Stripe
Stars: ✭ 149 (-98.79%)
HtmlsqlhtmlSQL is a experimental PHP library which allows you to access HTML values by an SQL like syntax.
Stars: ✭ 120 (-99.02%)
DotnetcrawlerDotnetCrawler is a straightforward, lightweight web crawling/scrapying library for Entity Framework Core output based on dotnet core. This library designed like other strong crawler libraries like WebMagic and Scrapy but for enabling extandable your custom requirements. Medium link : https://medium.com/@mehmetozkaya/creating-custom-web-crawler-with-dotnet-core-using-entity-framework-core-ec8d23f0ca7c
Stars: ✭ 100 (-99.18%)
GrawlerGrawler is a tool written in PHP which comes with a web interface that automates the task of using google dorks, scrapes the results, and stores them in a file.
Stars: ✭ 98 (-99.2%)
SoupsieveA modern CSS selector implementation for BeautifulSoup
Stars: ✭ 95 (-99.23%)
JustSwift HTTP for Humans
Stars: ✭ 1,335 (-89.12%)
EmbedGet info from any web service or page
Stars: ✭ 1,808 (-85.26%)