Anonyfox / Elixir Scrape
Licence: lgpl-3.0
Scrape any website, article or RSS/Atom Feed with ease!
Stars: ✭ 306
Programming Languages
elixir
2628 projects
Projects that are alternatives of or similar to Elixir Scrape
feedsearch-crawler
Crawl sites for RSS, Atom, and JSON feeds.
Stars: ✭ 23 (-92.48%)
Mutual labels: rss, scraping, feed
Feedly-Export-Save4Later
Working script for latest feedly design. Including title, url, summary, time, sourceTitle & sourceUrl
Stars: ✭ 23 (-92.48%)
Mutual labels: rss, feed
YouTubeFeeds
Get new youtube video notifs, on telegram!
Stars: ✭ 29 (-90.52%)
Mutual labels: rss, feed
awesome-rss-feeds
Awesome RSS feeds - A curated list of RSS feeds (and OPML files) used in Recommended Feeds and local news sections of Plenary - an RSS reader, article downloader and a podcast player app for android
Stars: ✭ 114 (-62.75%)
Mutual labels: rss, feed
overflow-news
📚 Don't waste time searching for good dev blog posts. Get the latest news here.
Stars: ✭ 32 (-89.54%)
Mutual labels: rss, feed
microblog
A very simple PHP app that stores twitter-like status updates in a sqlite database.
Stars: ✭ 30 (-90.2%)
Mutual labels: rss, feed
vuepress-plugin-feed
RSS, Atom, and JSON feeds generator plugin for VuePress 1.x
Stars: ✭ 46 (-84.97%)
Mutual labels: rss, feed
feeds-to-pocket
Sends entries from RSS and Atom feeds to Pocket (https://getpocket.com)
Stars: ✭ 24 (-92.16%)
Mutual labels: rss, feed
actions-readme-feed
Display RSS feed in your GitHub Profile README
Stars: ✭ 26 (-91.5%)
Mutual labels: rss, feed
meta-extractor
Super simple and fast html page meta data extractor with low memory footprint
Stars: ✭ 38 (-87.58%)
Mutual labels: rss, feed
watch-rss
Subscribe your watched GitHub Repository's releases as RSS feeds on Inoreader
Stars: ✭ 24 (-92.16%)
Mutual labels: rss, feed
Infomate.club
RSS feed collections with article summarization
Stars: ✭ 255 (-16.67%)
Mutual labels: rss, feed
awesome-feeds
A curated list of tech, machine learning, biz and etc... feeds
Stars: ✭ 25 (-91.83%)
Mutual labels: rss, feed
html2rss-web
🕸 Generates and delivers RSS feeds via HTTP. Create your own feeds or get started quickly with the included configs.
Stars: ✭ 36 (-88.24%)
Mutual labels: rss, feed
buran
Bidirectional, data-driven RSS/Atom feed consumer, producer and feeds aggregator
Stars: ✭ 27 (-91.18%)
Mutual labels: rss, feed
Scrape
Structured Data extraction from common web resources, using information-retrieval techniques. See the docs
Installation
The package can be installed by adding scrape to your list of dependencies in mix.exs:
def deps do
[
{:scrape, "~> 3.0.0"}
]
end
Known Issues
- This package uses an outdated version of
httpoisonbecause ofkeepcosmos/readability. You can override this in your app withoverride: trueand everything should work. - The current version 3.X is a complete rewrite from scratch, so some new issues might occur and the API has changed. Please provide some URL to a HTML/Feed document when submitting issues, so I can look into it for bugfixing.
Usage
-
Scrape.domain!(url)-> get structured data of a domain-type url (like https://bbc.com) -
Scrape.feed!(url)-> get structured data of a RSS/Atom feed -
Scrape.article!(url)-> get structured data of an article-type url
License
LGPLv3. You can use this package any way you want (including commercially), but I want bugfixes and improvements to flow back into this package for everyone's benefit.
Note that the project description data, including the texts, logos, images, and/or trademarks,
for each open source project belongs to its rightful owner.
If you wish to add or remove any projects, please contact us at [email protected].