GitPlanet

Cheap and reliable Node.js hosting starts at $3/month, and $1/month static HTML hosting

Created with love in Canada, visit hostnodejs.com today

Feel like to post an Ad? Learn Details
All Projects → gladchinda → scotch-scraping-node

gladchinda / scotch-scraping-node

Licence: other
Simple app for scraping author profiles and tutorials from Scotch.io - https://scotch.io.

Programming Languages

javascript
184084 projects - #8 most used programming language
HTML
75241 projects

Labels

nodejsscrapingexpress-jsscotch

Projects that are alternatives of or similar to scotch-scraping-node

Scrape Linkedin Selenium
`scrape_linkedin` is a python package that allows you to scrape personal LinkedIn profiles & company pages - turning the data into structured json.
Stars: ✭ 239 (+1493.33%)
Mutual labels:  scraping
Champ
A Telegram bot combined with python to serve some basic functions like weather, music charts, cricket score and much more.
Stars: ✭ 22 (+46.67%)
Mutual labels:  scraping
HIMS
Hospital Information Management System create using Node Js
Stars: ✭ 41 (+173.33%)
Mutual labels:  express-js
Jsoup Annotations
Jsoup Annotations POJO
Stars: ✭ 242 (+1513.33%)
Mutual labels:  scraping
List Of User Agents
List of major web + mobile browser user agent strings. +1 Bonus script to scrape :)
Stars: ✭ 247 (+1546.67%)
Mutual labels:  scraping
Whatsapp-Net
Generate a network graph of connections from your WhatsApp groups data
Stars: ✭ 75 (+400%)
Mutual labels:  scraping
Arachnid
Crawl all unique internal links found on a given website, and extract SEO related information - supports javascript based sites
Stars: ✭ 224 (+1393.33%)
Mutual labels:  scraping
MachineLearning
Machine learning for beginner(Data Science enthusiast)
Stars: ✭ 104 (+593.33%)
Mutual labels:  scraping
MyAPI
A template to create awesome APIs easily ⚡️
Stars: ✭ 117 (+680%)
Mutual labels:  express-js
pickall
.NET agile and extensible web searching API
Stars: ✭ 25 (+66.67%)
Mutual labels:  scraping
Loconotion
📄 Python tool to turn Notion.so pages into lightweight, customizable static websites
Stars: ✭ 237 (+1480%)
Mutual labels:  scraping
Musoq
Use SQL on various data sources
Stars: ✭ 252 (+1580%)
Mutual labels:  scraping
tvseries
TV Series is a tool that scrapes Episode Synopsis' of popular TV Series' from websites like Wikipedia / IMDb and show in one place with a user-friendly navigation UI.
Stars: ✭ 37 (+146.67%)
Mutual labels:  scraping
Reaper
Social media scraping / data collection tool for the Facebook, Twitter, Reddit, YouTube, Pinterest, and Tumblr APIs
Stars: ✭ 240 (+1500%)
Mutual labels:  scraping
Pahe.ph-Scraper
Pahe.ph [Pahe.in] Movies Website Scraper
Stars: ✭ 57 (+280%)
Mutual labels:  scraping
Scrapysharp
reborn of https://bitbucket.org/rflechner/scrapysharp
Stars: ✭ 226 (+1406.67%)
Mutual labels:  scraping
google-scraper
This class can retrieve search results from Google.
Stars: ✭ 33 (+120%)
Mutual labels:  scraping
PythonScrapyBasicSetup
Basic setup with random user agents and IP addresses for Python Scrapy Framework.
Stars: ✭ 57 (+280%)
Mutual labels:  scraping
shopify-node-express-app
Simple Shopify app with Express and Node.js that connects to a Shopify store via OAuth.
Stars: ✭ 20 (+33.33%)
Mutual labels:  express-js
github-languages
Tiny little ruby on rails website that crawls though your public github repos to find out what your favourite languages are.
Stars: ✭ 23 (+53.33%)
Mutual labels:  scraping
View All Similar Projects ➔

scotch-scraping-node

You can checkout the complete tutorial on Scotch: Web Scraping Scotch: The Node Way.

Simple app for scraping author profiles from Scotch.io. To get started, follow the following steps:

  1. Install dependencies

The app source code contains a lot of modern JavaScript syntax and uses the following engine versions: node 8.9.4 and npm 5.6.0. You should consider using recent versions of node and npm to run this app successfully.

npm install
  1. Start the server
npm start
  1. Load author profile

Visit your browser or any other HTTP tool of choice (e.g Postman) and make a GET request to the endpoint /scotch/{author} to fetch the profile of the author as a JSON response.

To fetch my Scotch profile for example, use the author name gladchinda as shown in the following cURL command.

curl -X GET http://localhost:3000/scotch/gladchinda

Happy Scraping!!!
Remember to hit the Star button to star this repository.

Note that the project description data, including the texts, logos, images, and/or trademarks, for each open source project belongs to its rightful owner. If you wish to add or remove any projects, please contact us at [email protected].