All Projects → zenghongtu → General News Extractor Js

zenghongtu / General News Extractor Js

Licence: mit
🤔一个新闻网页正文通用抽取器,包括标题、作者和日期。

Programming Languages

typescript
32286 projects

Projects that are alternatives of or similar to General News Extractor Js

trafilatura
Python & command-line tool to gather text on the Web: web crawling/scraping, extraction of text, metadata, comments
Stars: ✭ 711 (+1192.73%)
Mutual labels:  news, readability
Topnews
一款Android新闻客户端,并提供电视台直播功能
Stars: ✭ 44 (-20%)
Mutual labels:  news
Daily Front End News
前端每日前沿资讯推送
Stars: ✭ 9 (-83.64%)
Mutual labels:  news
Cmd Toutiao
摸鱼神器:在命令行中看今日头条
Stars: ✭ 34 (-38.18%)
Mutual labels:  news
Code Review Tips
🔬 Common problems to look for in a code review
Stars: ✭ 861 (+1465.45%)
Mutual labels:  readability
Opendyslexic Chrome
Offical OpenDyslexic chrome extension
Stars: ✭ 36 (-34.55%)
Mutual labels:  readability
Pygooglenews
If Google News had a Python library
Stars: ✭ 900 (+1536.36%)
Mutual labels:  news
Tennews
MacOS News Collection
Stars: ✭ 49 (-10.91%)
Mutual labels:  news
Enjoylife
😊开源App项目,每天一张精选倩图、一个精选小视频,一篇知乎美文
Stars: ✭ 43 (-21.82%)
Mutual labels:  news
News Please
news-please - an integrated web crawler and information extractor for news that just works.
Stars: ✭ 969 (+1661.82%)
Mutual labels:  news
Census Data Aggregator
Combine U.S. census data responsibly
Stars: ✭ 28 (-49.09%)
Mutual labels:  news
Tf Idf tutorial
計算關鍵詞重要程度(TF-IDF實作)Calculate cosine-similarity between documents using TF-IDF
Stars: ✭ 12 (-78.18%)
Mutual labels:  news
Nerdnews
A free and open source social news website focusing on computer science and FOSS news for Persian community
Stars: ✭ 41 (-25.45%)
Mutual labels:  news
Chir.py
twitter news bot that builds followers, posts, and bitcoin via ppc links
Stars: ✭ 10 (-81.82%)
Mutual labels:  news
Pdfsave
Convert websites into readable PDFs
Stars: ✭ 46 (-16.36%)
Mutual labels:  readability
Summary loop
Codebase for the Summary Loop paper at ACL2020
Stars: ✭ 26 (-52.73%)
Mutual labels:  news
Just Read
A customizable read mode web extension.
Stars: ✭ 874 (+1489.09%)
Mutual labels:  readability
Realtime Newsapi
Financial News Aggregator - Real Time & Query API for Financial News
Stars: ✭ 34 (-38.18%)
Mutual labels:  news
Homeless Arrests Analysis
A Los Angeles Times analysis of arrests of the homeless by the LAPD
Stars: ✭ 53 (-3.64%)
Mutual labels:  news
Readability4j
A Kotlin port of Mozilla‘s Readability. It extracts a website‘s relevant content and removes all clutter from it.
Stars: ✭ 46 (-16.36%)
Mutual labels:  readability

general-news-extractor

一个新闻网页正文通用抽取工具,还有标题、作者和发布日期。

该项目启发自kingname/GeneralNewsExtractor,由 Python 迁移到 Node.js ,并做了一些改动,提高提取准确度。

Online DEMO

https://general-news-extractor-demo.stayin.cn/

Installation

Using npm:

npm i general-news-extractor

Usage

const GeneralNewsExtractor = require('general-news-extractor')

const htmlString = `` // HTML for a news page

const gne = new GeneralNewsExtractor()

// gne.extract( html: string, { titleSelector = '', authorSelector = '', dateTimeSelector = '', noiseNodeList = [] } = {})
const result = gne.extract(htmlString, {})

TODO

  • [ ] Run in browser

Thanks

License

MIT © zenghongtu

Note that the project description data, including the texts, logos, images, and/or trademarks, for each open source project belongs to its rightful owner. If you wish to add or remove any projects, please contact us at [email protected].