HackerDesignerNews
This is an aggregator for LayerVault's Designer News and Y Combinator's Hacker News.
The cron.js script handles fetching data from HN and DN, normalizing and storing it in MongoDB.
The server.js script runs an express server serving the following endpoints:
- /top - Loads all current top posts
- /top/hn - Loads all current top Hacker News posts
- /top/dn - Loads all current top Designer News posts
Example response
[{
"author": "Sean H.",
"authorLink": "https://news.layervault.com/u/3582/sean-hendrickson",
"comments": 1,
"commentsLink": "https://news.layervault.com/stories/11137-medium-10--a-new-storytelling-experience",
"createdAt": "2013-12-04T22:12:09.143Z",
"link": "https://medium.com/beautiful-stories/8d615d86ac04",
"points": 35,
"position": 1,
"source": "designer_news",
"title": "Medium 1.0 — A New Storytelling Experience",
"updatedAt": "2013-12-05T14:10:15.138Z"
}, {
"author": "evilpie",
"authorLink": "https://news.ycombinator.com/user?id=evilpie",
"comments": 29,
"commentsLink": "https://news.ycombinator.com/item?id=6853811",
"createdAt": "2013-12-05T11:41:41.454Z",
"link": "http://billmccloskey.wordpress.com/2013/12/05/multiprocess-firefox/",
"points": 121,
"position": 1,
"source": "hacker_news",
"title": "Multiprocess Firefox",
"updatedAt": "2013-12-05T14:10:14.904Z"
}]Scraper
$ node cron.js
[START] running cron
[FINISH] resetTopPosts
[FINISH] createOrUpdatePosts
[FINISH] running cron
Server
$ node server.js