All Projects → not-kennethreitz → pysoundcloud

not-kennethreitz / pysoundcloud

Licence: other
Scraping the Un–scrapable™

Programming Languages

python
139335 projects - #7 most used programming language

Projects that are alternatives of or similar to pysoundcloud

covid-19
Current and historical coronavirus covid-19 confirmed, recovered, deaths and active case counts segmented by country and region. Includes csv, json and sqlite data along with an interactive website explorer.
Stars: ✭ 15 (-76.19%)
Mutual labels:  scraper
kick-off-web-scraping-python-selenium-beautifulsoup
A tutorial-based introduction to web scraping with Python.
Stars: ✭ 18 (-71.43%)
Mutual labels:  scraper
fb-page-chat-download
Python script to download messages from a Facebook page to a CSV file
Stars: ✭ 51 (-19.05%)
Mutual labels:  scraper
peeling-onions
A repository to store Deep Web (onion domain) crawler, scraper, and NLP tools for Tor network.
Stars: ✭ 18 (-71.43%)
Mutual labels:  scraper
JJMumbleBot
A plugin-based All-In-One mumble bot solution in python 3.7+ with extensive features and support for custom plugins.
Stars: ✭ 40 (-36.51%)
Mutual labels:  soundcloud
genius-lyrics-api
A library for fetching song lyrics & album art from genius.com 🎶🌈
Stars: ✭ 129 (+104.76%)
Mutual labels:  scraper
Coinsta
A Python package for acquiring both historical and current data of cryptocurrencies
Stars: ✭ 47 (-25.4%)
Mutual labels:  scraper
scoopi-scraper
Scoopi Web Scraper is a heavy duty tool to extract data from HTML pages.
Stars: ✭ 18 (-71.43%)
Mutual labels:  scraper
patreon-scraper
WIP Patreon attachment download written in TypeScript
Stars: ✭ 25 (-60.32%)
Mutual labels:  scraper
metafetch
NodeJS package that fetches a given URL's title, description, images, links etc.
Stars: ✭ 21 (-66.67%)
Mutual labels:  scraper
Scraper-Projects
🕸 List of mini projects that involve web scraping 🕸
Stars: ✭ 25 (-60.32%)
Mutual labels:  scraper
youtube-dlc
Command-line program to download various media from YouTube.com and other sites
Stars: ✭ 1,225 (+1844.44%)
Mutual labels:  soundcloud
scrapy facebooker
Collection of scrapy spiders which can scrape posts, images, and so on from public Facebook Pages.
Stars: ✭ 22 (-65.08%)
Mutual labels:  scraper
metacritic api
PHP Metacritic API - Mirrored by my GitLab
Stars: ✭ 31 (-50.79%)
Mutual labels:  scraper
sound-on-fire
🔊☁️ 🔥📺 A Flutter based SoundCloud App for your Fire TV
Stars: ✭ 46 (-26.98%)
Mutual labels:  soundcloud
wishlist
Read an Amazon wishlist programmatically with Python
Stars: ✭ 44 (-30.16%)
Mutual labels:  scraper
evine
Interactive CLI Web Crawler
Stars: ✭ 140 (+122.22%)
Mutual labels:  scraper
bing-ip2hosts
bingip2hosts is a Bing.com web scraper that discovers websites by IP address
Stars: ✭ 99 (+57.14%)
Mutual labels:  scraper
django-instagram
Instagram application for Django.
Stars: ✭ 73 (+15.87%)
Mutual labels:  scraper
Eolian
Eolian is a Discord music bot that aims to be easy to use and provide a very powerful API for queuing songs from a variety of sources such as entire albums, playlists, artist discography and more.
Stars: ✭ 20 (-68.25%)
Mutual labels:  soundcloud

PySoundCloud

SoundCloud is a single–page webapp (all content served via JavaScript).

This repo serves as an experiment to see how to scrape and parse a website like this using requests-html, which features a full web browser for scraping such websites.

Usage

>>> from pysoundcloud import SoundCloud
>>> sc = SoundCloud()

>>> kenneth = sc.get_user('infinitestate')
>>> kenneth.meta
{'username': 'Infinite State (Kenneth Reitz)Monthly Pro Unlimited plan', 'additional': 'Kenneth Reitz', 'bio': 'Wandering musician, idealist, and moral fallibilist. Simplicity is always better than functionality.\nkennethreitz.org/music', 'followers': 1323, 'following': 250, 'tracks': 485, 'likes': 81}

>>> kenneth.following
[<User 'squadpack'>, <User 'thenoiseunion'>, <User 'theartistunion'>, <User 'user-515843919'>, <User 'user-509329189'>, <User 'jnicolaisen'>, <User 'doug-reitz'>, <User 'paintingfishes'>, <User 'mdzcloud'>, <User 'wingsofsunshine'>, <User 'nasa'>, <User 'rplktr'>, <User 'ywcbropher'>, <User 'hamburgerhelper'>, <User 'funka7ron'>, <User 'kanyewest'>, <User 'sasha-rosser'>, <User 'middle-room'>, <User 'madonna'>, <User 'greenday'>, <User 'aerosmith'>, <User 'qotsa'>, <User 'radiohead'>, <User 'jimihendrix'>, <User 'foofighters'>, <User 'tenaciousd'>, <User 'matt-lawless-3'>, <User 'syntheticreality'>, <User 'heddle317'>, <User 'lemonjuice91'>, <User 'nihiti'>, <User 'eva_jade'>, <User 'octobersveryown'>, <User 'obamawhitehouse'>, <User 'ramdass'>, <User 'demianson'>, <User 'kimthera4444'>, <User 'henry-campbell-7'>, <User 'stephanie-moran-mangino'>, <User 'nrrb'>, <User 'geraldrich'>, <User 'jasonamyers'>, <User 'lance-roggendorff'>, <User 'import-this'>, <User 'umemusic'>, <User 'buddhify'>, <User 'rob-dehaven'>, <User 'beshr'>, <User 'montylounge'>, <User 'kay-louise-2'>, <User 'cody-soyland'>, <User 'moby'>, <User 'johnmangino'>, <User 'tetelestaiband'>, <User 'justinabrahms'>, <User 'enneff'>, <User 'dkeithrobinson'>, <User 'lindseystomp'>, <User 'erik'>, <User 'audreyrg'>, <User 'kevnull'>, <User 'podcastmaster'>, <User 'swillison'>, <User 'bjarni-ingimar-j-l-usson'>, <User 'bryon-roche'>, <User 'nate-aune'>, <User 'timoni-west'>, <User 'florian-le-goff'>, <User 'austin-bales'>, <User 'ola-sitarska'>, <User 'tsykoduk'>, <User 'regebro'>, <User 'lukasz-langa'>, <User 'mtrifiro-duplicate'>, <User 'mtrifiro'>, <User 'amrithap'>, <User 'pythonchelle'>, <User 'timoni'>, <User 'rsms'>, <User 'jonathanchu'>, <User 'wburnd'>, <User 'teralaser'>, <User 'wayne-werner'>, <User 'taurus-olson'>, <User 'andrew-danger-pennebaker'>, <User 'kyle-boyer-5'>, <User 'nineinchnails'>, <User 'mad-zach'>, <User 'arcseconds'>, <User 'stephentayler'>, <User 'leigh-bauserman'>, <User 'glenn-gillen'>, <User 'brian-stoepker'>, <User 'benjamin-warfield-smith'>, <User 'mtt2p'>, <User 'harold-bonneville'>, <User 'heather-b-duthie'>, <User 'yoav-lurie'>, <User 'jfranusic'>, <User 'evajlandon'>, <User 'evablackmer8902'>, <User 'fivelights'>, <User 'simon-segfault'>, <User 'craig-slusher'>, <User 'gusanlyon'>, <User 'anoemi'>, <User 'kirby-ferguson'>, <User 'elizabeth-russell-5'>, <User 'rydgel'>, <User 'petersonjackiem'>, <User 'mahmoud-kamal-10'>, <User 'meagan-ashley-1'>, <User 'morten-bagai'>, <User 'jeffmacintyre'>, <User 'jmcantrell'>, <User 'dj-lein'>, <User 'leah-culver'>, <User 'therationale'>, <User 'jplproduction'>, <User 'andrew-collie'>, <User 'robspectre'>, <User 'jmsdnns'>, <User 'goshakkk'>, <User 'rkonow'>, <User 'thomas-a-r-woelz'>, <User 'jerom-ray'>, <User 'derrick-mcneill'>, <User 'josh-huff-1'>, <User 'chryslynn-burkhart'>, <User 'josh-k'>, <User 'georgia-andrews-rossiter'>, <User 'schneems'>, <User 'jaely-louise-turner'>, <User 'textfiles'>, <User 'lakshman-prasad-1'>, <User 'fabiokung'>, <User 'snerangis'>, <User 'zain-memon'>, <User 'josh-fraser-4'>, <User 'sarah-berry-4'>, <User 'ltseeley'>, <User 'tswicegood'>, <User 'the_verge'>, <User 'broccolini'>, <User 'tenderlove-1'>, <User 'calebnei'>, <User 'robert-davis-22'>, <User 'createdestroyforget'>, <User 'sreejith-kesavan'>, <User 'bkmontgomery'>, <User 'julian255'>, <User 'yasunori-matsuki'>, <User 'robbyt'>, <User 'atmos-dot-org'>, <User 'bkeepers'>, <User 'bas-verkooijen'>, <User 'paparent'>, <User 'chris-jones-174'>, <User 'rebecca-goldman-1'>, <User 'paulosman'>, <User 'whitmo'>, <User 'thespinachincident'>, <User 'james-labove'>, <User 'jorilallo'>, <User 'jboxer'>, <User 'ajung-1'>, <User '7son75'>, <User 'vegasvalentine'>, <User 'steinhoefel1'>, <User 'entequak'>, <User 'm-todd'>, <User 'josh-crim'>, <User 'oboenerd'>, <User 'courtney-ryan-vance'>, <User 'michelle-greer'>, <User 'tracy-osborn'>, <User 'wayne-chang'>, <User 'gil-hildebrand'>, <User 'mth47'>, <User 'robert-petro'>, <User 'hero-jr'>, <User 'mvz'>, <User 'bleikamp'>, <User 'gulopine'>, <User 'zeeg99'>, <User 'saad-irfan'>, <User 'nathan-vencil'>, <User 'allyson-nichols'>, <User 'miksago'>, <User 'hilary-gerten'>, <User 'aryaevents'>, <User 'anatomyofashane'>, <User 'am2589'>, <User 'veritasbandminneapolis'>, <User 'skeevis'>, <User 'mrgandrews'>, <User 'alex-james-burns'>, <User 'uberjon'>, <User 'rudess'>, <User 'flemmingdoerken'>, <User 'robbyrussell'>, <User 'jamesproud'>, <User 'rob-martino'>, <User 'z-plan'>, <User 'teenageengineering'>, <User 'andrew-seeley'>, <User 'skrillex'>, <User 'ableton'>, <User 'childish-gambino'>, <User 'thebeatles'>, <User 'radiolab'>, <User 'zedd'>, <User 'watchingcars'>, <User 'jeremy-carbaugh'>, <User 'john-dorman'>, <User 'joshnesbitt'>, <User 'adamramadhan'>, <User 'helloitsliam'>, <User 'tmpvar'>, <User 'aviflax'>, <User 'ntlkt'>, <User 'maxfenton'>, <User 'brianmario'>, <User 'mintchaos'>, <User 'jaymichigan'>, <User 'shazow'>, <User 'sitwalkstand'>, <User 'moshgirl'>, <User 'myusuf3'>, <User 'bziade'>, <User 'shazow-1'>, <User 'spaaaaaaaaaaaaaaaaace'>, <User 'bj-rnsackemark'>, <User 'miss-bloody-mew'>, <User 'kevinjohnson-9'>, <User 'bfirsh'>, <User 'reedmunson'>, <User 'rezart'>, <User 'travismills'>, <User 'mattfallek'>, <User 'john-mangino'>, <User 'andrewmbaxley'>, <User 'phiiipdefranco'>]

>>> len(kenneth.tracks)
485

You'll note that these methods are slow, as we are paging down a real web browser to get this data.

But, it's available. Unlike their API.

rimshot.

Note that the project description data, including the texts, logos, images, and/or trademarks, for each open source project belongs to its rightful owner. If you wish to add or remove any projects, please contact us at [email protected].