Jayin / Goods Crawling
爬取amazon/bestbuy/costco/6pm 的商品详情
Programming Languages
javascript
184084 projects - #8 most used programming language
Projects that are alternatives of or similar to Goods Crawling
Amazonbigspider
😱Full Automatic Amazon Distributed Spider | 亚马逊分布式四国际站采集选款产品|账号admin,密码adminadmin
Stars: ✭ 140 (+1455.56%)
Mutual labels: amazon, crawler
Symfony Crawler Bundle
Implements the crawler package into Symfony
Stars: ✭ 8 (-11.11%)
Mutual labels: crawler
Zhihu Crawler
zhihu-crawler是一个基于Java的高性能、支持免费http代理池、支持横向扩展、分布式爬虫项目
Stars: ✭ 890 (+9788.89%)
Mutual labels: crawler
Aws Toolkit Vscode
AWS Toolkit for Visual Studio Code, an extension for working with AWS services including AWS Lambda.
Stars: ✭ 823 (+9044.44%)
Mutual labels: amazon
Instagram Profilecrawl
📝 quickly crawl the information (e.g. followers, tags etc...) of an instagram profile.
Stars: ✭ 816 (+8966.67%)
Mutual labels: crawler
Lulu
[Unmaintained] A simple and clean video/music/image downloader 👾
Stars: ✭ 789 (+8666.67%)
Mutual labels: crawler
Psi Report
Crawls a website, gets PageSpeed Insights data for each page, and exports an HTML report.
Stars: ✭ 6 (-33.33%)
Mutual labels: crawler
Fscrawler
Elasticsearch File System Crawler (FS Crawler)
Stars: ✭ 906 (+9966.67%)
Mutual labels: crawler
goods-crawling 
爬取amazon/bestbuy/costco/6pm 的商品详情
Setup
$ npm install
Test
- amazon.com
$ node ./test/amazon.js
- bestbuy.com
$ node ./test/bestbuy.js
- 6pm.com
$ node ./test/sixpm.js
- costco.com
$ node ./test/costco.js
- function testing
$ node ./test/test.js
Usage
const {fetchGoodsData} = require('goods-crawling');
let url = 'https://www.amazon.com/Nike-Rosherun-Black-Anthracite-Running/dp/B00BOR6I68/ref=sr_1_2?ie=UTF8&qid=1472541714&sr=8-2&keywords=nike';
fetchGoodsData(url, {}, function(err, data){
if(err){
console.err("Error:" + err)
return
}
console.log(data)
});
Note that the project description data, including the texts, logos, images, and/or trademarks,
for each open source project belongs to its rightful owner.
If you wish to add or remove any projects, please contact us at [email protected].