All Projects → dlab-berkeley → python-data-from-web

dlab-berkeley / python-data-from-web

Licence: other
API and web scraping workshops

Programming Languages

Jupyter Notebook
11667 projects
HTML
75241 projects

Projects that are alternatives of or similar to python-data-from-web

dnevnik mos ru
Python module to get easy machine access to dnevnik.mos.ru
Stars: ✭ 21 (-34.37%)
Mutual labels:  selenium
selenium-java
This is the sample repository that we use in the Complete Selenium WebDriver with Java Bootcamp
Stars: ✭ 45 (+40.63%)
Mutual labels:  selenium
TwitPy
🕊TwitPy - Follow/Unfollow Automation
Stars: ✭ 92 (+187.5%)
Mutual labels:  selenium
TikTok
Download public videos on TikTok using Python with Selenium
Stars: ✭ 37 (+15.63%)
Mutual labels:  selenium
devtools-proxy
Multiplexing proxy for Chrome DevTools. Fully compatible with Selenium and ChromeDriver
Stars: ✭ 64 (+100%)
Mutual labels:  selenium
facebook-data-extraction
Experiences in extracting data from Facebook with these 3 methods: Facebook Graph API, Automation tools, DevTools Console
Stars: ✭ 81 (+153.13%)
Mutual labels:  selenium
giulius-selenium-tests
A test harness that allows Selenium tests to be run using JUnit and test fixtures to be created and injected by a WebDriver-aware Guice
Stars: ✭ 12 (-62.5%)
Mutual labels:  selenium
nightwatch101
使用 Nightwatch 實現 End-to-End Testing ★
Stars: ✭ 42 (+31.25%)
Mutual labels:  selenium
python-crawler
爬虫学习仓库,适合零基础的人学习,对新手比较友好
Stars: ✭ 37 (+15.63%)
Mutual labels:  selenium
selenium-client
A PHP Selenium client
Stars: ✭ 31 (-3.12%)
Mutual labels:  selenium
google-image-downloader
A script to download images from images.google.com
Stars: ✭ 28 (-12.5%)
Mutual labels:  selenium
throughout
🎪 End-to-end testing made simple (using Jest and Puppeteer)
Stars: ✭ 16 (-50%)
Mutual labels:  selenium
FUTpuppeteer
This is an auto-clicker bot used to trade players and items on FIFA Ultimate Team's Web App.
Stars: ✭ 11 (-65.62%)
Mutual labels:  selenium
automation-for-humans
Converts English statements to automation.
Stars: ✭ 67 (+109.38%)
Mutual labels:  selenium
InstaBot
Simple and friendly Bot for Instagram, using Selenium and Scrapy with Python.
Stars: ✭ 32 (+0%)
Mutual labels:  selenium
resgen
Keep track of jobs you've applied to, automate resume & cover letter creation; generate PDFs from .odt templates on the fly while scraping the job post and tracking employer status.
Stars: ✭ 31 (-3.12%)
Mutual labels:  selenium
qzone-spider
QQ 空间爬虫,基于 selenium 模拟登录空间,破解滑动验证码,拿到 cookies,然后使用 requests 抓取好友留言板的所有留言与回复,并生成词图。只抓了留言,本来还想抓说说,不过因为我已经好多年不玩 QQ 空间,感觉它对我已经没什么意义了,遂作罢。
Stars: ✭ 23 (-28.12%)
Mutual labels:  selenium
webdriverio-zap-proxy
Demo - how to easily build security testing for Web App, using Zap and Glue
Stars: ✭ 58 (+81.25%)
Mutual labels:  selenium
Spider
Spider项目将会不断更新本人学习使用过的爬虫方法!!!
Stars: ✭ 16 (-50%)
Mutual labels:  selenium
weibo topic
微博话题关键词,个人微博采集, 微博博文一键删除 selenium获取cookie,requests处理
Stars: ✭ 28 (-12.5%)
Mutual labels:  selenium

python-data-from-web

API and web scraping workshops

These workshops were originally developed by Rochelle Terman.

Binder

Extracting Data from the Internet in Python

This workshop will cover how to extract data from the web using Python. We'll be covering both APIs and webscraping.

Topics Covered

  • How the web works
  • Accessing databases via RESTful APIs
  • HTML / CSS
  • Manipulating a webpage with Google DevTools
  • Webscraping with Beautiful Soup
  • Scraping javascript-heavy sites and interactive sites with Selenium

Requirements

This workshop will be using the Python programming language. See the software requirements here.

We will assume a basic knowledge of Python. If you've taken the D-Lab's Python Intensive, that should be sufficient.

Please note that these materials are updating.

Note that the project description data, including the texts, logos, images, and/or trademarks, for each open source project belongs to its rightful owner. If you wish to add or remove any projects, please contact us at [email protected].