All Projects → nedlir → Languagepod101 Scraper

nedlir / Languagepod101 Scraper

Licence: mit
Python scraper for Language Pods such as Japanesepod101.com 👹 🗾 🍣 Compatible with Japanese, Chinese, French, German, Italian, Korean, Portuguese, Russian, Spanish and many more! ✨

Programming Languages

python
139335 projects - #7 most used programming language
language
365 projects

Projects that are alternatives of or similar to Languagepod101 Scraper

Easy Scraping Tutorial
Simple but useful Python web scraping tutorial code.
Stars: ✭ 583 (+460.58%)
Mutual labels:  scraping, requests, beautifulsoup
Requests Html
Pythonic HTML Parsing for Humans™
Stars: ✭ 12,268 (+11696.15%)
Mutual labels:  scraping, requests, beautifulsoup
The Tab Of Words
A minimal Chrome / Firefox extension to help you learn Japanese words in each new tab.
Stars: ✭ 94 (-9.62%)
Mutual labels:  japanese, japanese-language
Turkce Python Kaynaklari
Türkçe olarak hazırlanmış Python programlama dili ile ilgili içeriklerin derlendiği sayfa.
Stars: ✭ 295 (+183.65%)
Mutual labels:  requests, beautifulsoup
Scrapple
A framework for creating semi-automatic web content extractors
Stars: ✭ 464 (+346.15%)
Mutual labels:  scraping, beautifulsoup
Flutter Ui Nice
More than 130+ pages in this beautiful app and more than 45 developers has contributed to it.
Stars: ✭ 3,092 (+2873.08%)
Mutual labels:  course, learn
Free Courses
A collection of free courses about programming 📖
Stars: ✭ 281 (+170.19%)
Mutual labels:  course, learn
Bilili
🍻 bilibili video (including bangumi) and danmaku downloader | B站视频(含番剧)、弹幕下载器
Stars: ✭ 379 (+264.42%)
Mutual labels:  download, requests
japanese-pitch-accent-resources
Trying to consolidate japanese phonetic, and in particular pitch accent resources into one list
Stars: ✭ 64 (-38.46%)
Mutual labels:  japanese, japanese-language
Geeksforgeeks.pdf
Topic wise PDFs of Geeks for Geeks articles. (Last updated in October 2018)
Stars: ✭ 489 (+370.19%)
Mutual labels:  scraping, download
Kagome
Self-contained Japanese Morphological Analyzer written in pure Go
Stars: ✭ 554 (+432.69%)
Mutual labels:  japanese, japanese-language
rust-course
<<Rust语言圣经(Book & Course)>>对Rust语言进行全面且深入的讲解,书中辅以生动的示例和习题,带你攻克从入门学习到实践应用的各种难关。 我们的目标是做一门优秀的开源Rust教程(课程)——学Rust就上course.rs。
Stars: ✭ 2,739 (+2533.65%)
Mutual labels:  course, learn
unofficial-jisho-api
Encapsulates the official Jisho.org API and also provides kanji, example, and stroke diagram search.
Stars: ✭ 88 (-15.38%)
Mutual labels:  japanese, japanese-language
Sasila
一个灵活、友好的爬虫框架
Stars: ✭ 286 (+175%)
Mutual labels:  scraping, requests
TorScrapper
A Scraper made 100% in Python using BeautifulSoup and Tor. It can be used to scrape both normal and onion links. Happy Scraping :)
Stars: ✭ 24 (-76.92%)
Mutual labels:  scraping, beautifulsoup
Mechanicalsoup
A Python library for automating interaction with websites.
Stars: ✭ 3,863 (+3614.42%)
Mutual labels:  requests, beautifulsoup
Awesome Python Primer
自学入门 Python 优质中文资源索引,包含 书籍 / 文档 / 视频,适用于 爬虫 / Web / 数据分析 / 机器学习 方向
Stars: ✭ 57 (-45.19%)
Mutual labels:  scraping, learn
tiktok-downloader
Tiktok Downloader/Scraper using requests & bs4
Stars: ✭ 47 (-54.81%)
Mutual labels:  requests, beautifulsoup
KanjiRecognitionDictionary
Perfect for those who forgets kanji pronunciation
Stars: ✭ 14 (-86.54%)
Mutual labels:  japanese, japanese-language
Yomichan
Japanese pop-up dictionary extension for Chrome and Firefox.
Stars: ✭ 464 (+346.15%)
Mutual labels:  japanese, japanese-language
⚡️ languagepod101-scraper ⚡️ ==================================

Languages available

languagepod101-scraper is a resource for dozens of language learning courses and study material for FREE.


🎓 About

languagepod101-scraper helps you download full online language courses and save them on your local folder as MP3/MP4 files. The courses are produced and distributed by Innovative Language, who provides language learning courses from a selection of dozens of languages. Each lesson is usually 10-20 minutes long.

To get started, choose one of the languages courses offered by Innovative Language and create a free account.

📌 Usage

To use the script, fulfill the requirements and follow the example as demonstrated below.

🔌 Requirements

📑 Example

For the sake of example, the process of downloading of a level from Japanese Pod 101 will be demonstrated.

Japanese Pod 101 and all other sites have a similar structure which looks as following:

Japanesepod101
├─ Level 1 - Absolute Beginner
│  ├─ Newbie Season 1
│  │  ├─ lesson 01
│  │  ├─ lesson 02
│  │  ├─ lesson 03
│  │  ├─ ...
│  ├─ Newbie Season 2
│  ├─ ...
├─ Level 2 - Beginner
│  ├─ Lower Beginner Season 1
│  │  ├─ lesson 01
│  │  ├─ lesson 02
│  │  ├─ lesson 03
│  │  ├─ ...
│  ├─ ...
├─ Level 3 - Intermediate
│  ├─ ...
│  │  ├─ ...
│  │  ├─ ...
│  ├─ ...
│  ├─ ...
├─ Level 4 - Upper Intermediate
│  ├─ ...
├─ Level 5 - Advanced
│  ├─ ...
  • To download Level 2 - Beginner we will have to use our web browser to navigate to this course.

    Navigation would look like this: Japanesepod101Level 2 - Beginner.

    Save the URL for the address bar, as you will have to provide it to the script later on.

  • Run the language101_scraper.py script, and follow the instructions. You will have to provide:

    • the email you used to sign up for the course
    • your password for the course
    • the URL for the language study level you have navigated through earlier (something like https://www.japanesepod101.com/lesson-library/beginner).
  • Alternatively, you can pass the data as parameters when invoking the script:

    ./language101_scraper.py -u $USERNAME -p $PASSWORD --url YOUR_LEVEL_URL
    
  • It is again possible to download single lessons with the same syntax as before. However, rather than providing the language study level, the course's lesson URL has to be provided ( for example: lesson 01 of the Lower Beginner Season 1 course).

  • The script will start downloading the MP3/MP4 files into the local navigated folder. Any possible errors would be printed out.

  • Output inside folder should look like this:

    beginner
    ├─level-2-japanese
    | ├─01 - A Formal Japanese Introduction - JapanesePod101 - Dialogue.mp3
    | ├─01 - A Formal Japanese Introduction - JapanesePod101 - Review.mp3
    | ├─01 - A Formal Japanese Introduction - JapanesePod101 - Main Lesson.mp3
    | ├─02 - Which Famous Tokyo Tower is That - JapanesePod101 - Dialogue.mp3
    | └─...
    ├─japanese-grammar-made-easy
    | ├─01 - How to Talk About Your Family - JapanesePod101.mp4
    | ├─02 - How to Express Desire in Japanese Want To - JapanesePod101.mp4
    | └─...
    └─...
    

📋 Disclaimer and known issues

  • Any usage of the script is under user's responsibility only. Users of the script must act according to site's terms.

  • As of today, Innovative Language's terms of use does not forbid usage of crawlers or scrapers on any of their sites. This may change in the future, so be aware.

  • If you like the services Innovative Language provides you should consider a monthly subscription. Basic programs start at around $5 per month and include support from native speaker teachers.

  • As with all websites, the site's structure may change in the future and thus, as often happens with scraping scripts, deprecate it. It is not really a question of if the site's source code will change but rather when (so enjoy it while it's still working 😁).

🔒 License

All of the content presented in the websites belongs to the original creators (Innovative Language) and I have nothing to do with it.

The license below refers only to the script and not to the downloaded content.

License - MIT

Note that the project description data, including the texts, logos, images, and/or trademarks, for each open source project belongs to its rightful owner. If you wish to add or remove any projects, please contact us at [email protected].