All Projects → abresler → requestsR

abresler / requestsR

Licence: other
R interface to Python requests module

Programming Languages

r
7636 projects

Projects that are alternatives of or similar to requestsR

Email-Crawler-Lead-Generator
This email crawler will visit all pages of a provided website and parse and save emails found to a csv file.
Stars: ✭ 47 (+291.67%)
Mutual labels:  requests, webscraping
image-crawler
An image scraper that scraps images from unsplash.com
Stars: ✭ 12 (+0%)
Mutual labels:  requests, webscraping
Proxy requests
a class that uses scraped proxies to make http GET/POST requests (Python requests)
Stars: ✭ 357 (+2875%)
Mutual labels:  requests, webscraping
mkm-sdk
Python SDK for Magickartenmarkt API
Stars: ✭ 33 (+175%)
Mutual labels:  requests
covid-19
Data ETL & Analysis on the global and Mexican datasets of the COVID-19 pandemic.
Stars: ✭ 14 (+16.67%)
Mutual labels:  requests
Geolocator-2
Learn how to find and work with locations in Django, the Yelp API, and Google Maps api.
Stars: ✭ 24 (+100%)
Mutual labels:  requests
angular-http-cache
Speed up your remote requests by automatically caching them on client and add support for offline navigation.
Stars: ✭ 25 (+108.33%)
Mutual labels:  requests
robotstxt
robots.txt file parsing and checking for R
Stars: ✭ 65 (+441.67%)
Mutual labels:  webscraping
weibo topic
微博话题关键词,个人微博采集, 微博博文一键删除 selenium获取cookie,requests处理
Stars: ✭ 28 (+133.33%)
Mutual labels:  requests
ebayMarketAnalyzer
Scrape all eBay sold listings to determine average/median pricing, plot listings over time with trend lines, and extract to excel
Stars: ✭ 116 (+866.67%)
Mutual labels:  webscraping
gotor
This program provides efficient web scraping services for Tor and non-Tor sites. The program has both a CLI and REST API.
Stars: ✭ 97 (+708.33%)
Mutual labels:  webscraping
gists
Methods for working with the GitHub Gist API. Node.js/JavaScript
Stars: ✭ 96 (+700%)
Mutual labels:  requests
crawler
requests+lxml爬虫,简单爬虫架构
Stars: ✭ 72 (+500%)
Mutual labels:  requests
cpr
C++ Requests: Curl for People, a spiritual port of Python Requests.
Stars: ✭ 5,005 (+41608.33%)
Mutual labels:  requests
PacPaw
Pawn package manager for SA-MP
Stars: ✭ 14 (+16.67%)
Mutual labels:  webscraping
youtube-audio
extract videos from youtube in audio format using webscraping techniques 🎶
Stars: ✭ 68 (+466.67%)
Mutual labels:  webscraping
browser-automation-api
Browser automation API for repetitive web-based tasks, with a friendly user interface. You can use it to scrape content or do many other things like capture a screenshot, generate pdf, extract content or execute custom Puppeteer, Playwright functions.
Stars: ✭ 24 (+100%)
Mutual labels:  webscraping
python-crawler
爬虫学习仓库,适合零基础的人学习,对新手比较友好
Stars: ✭ 37 (+208.33%)
Mutual labels:  requests
python3-concurrency
Python3爬虫系列的理论验证,首先研究I/O模型,分别用Python实现了blocking I/O、nonblocking I/O、I/O multiplexing各模型下的TCP服务端和客户端。然后,研究同步I/O操作(依序下载、多进程并发、多线程并发)和异步I/O(asyncio)之间的效率差别
Stars: ✭ 49 (+308.33%)
Mutual labels:  requests
premeStock
Monitors for restocks
Stars: ✭ 53 (+341.67%)
Mutual labels:  requests

requestsR

requestsR : Python’s Requests module for R

Ref: http://docs.python-requests.org/

Ref: https://asbcllc.com/r_packages/requestsR/docs/index.html

“Requests is an elegant and simple HTTP library for Python {and now R}, built for human beings. You are currently looking at the documentation of the development release..”

Background

R has a number of great packages for interacting with web data but it still lags behind Python in large part because of the power and ease of use of the Requests module.

This package aims to port those powers to R, I like to think of this package as the Bo Jackson of web interaction tools.

requestsR Logo

It is fast, agile, powerful, clean and now it plays 2 languages!

Caveats

. This is not intended to replace httr, curl, rvest, or whatever package you use to interact with web data. In fact, in many cases you will want to use requestsR in concert with those packages, especially curl and rvest. I have found that requestsR comes in most handy for very complex web scraping tasks that require multiple headers, parameters and cookies.

Installation

This package requires Python and the requests module.

To install Requests in R you can run:

system("pip install requests")

Work-horse functions

  • import_requests: imports requests module for full use in R
  • Get: mimics python get request
  • Post: mimics python post request

Other functions

  • Head: mimics python head request
  • Delete: mimcs python delete request
  • Put: mimics python put request

Mungers

  • convert_dictionary_to_list: converts dictionary to list
  • parse_response_html: parses html from response object
  • parse_response_json: parses JSON from response object

Installation

devtools::install_github("abresler/requestsR")
options(width=120)

Usage

Please feel free to take a look at this blog post demonstrating how to use the package.

Note that the project description data, including the texts, logos, images, and/or trademarks, for each open source project belongs to its rightful owner. If you wish to add or remove any projects, please contact us at [email protected].