All Projects → thomasschmied → Text_summarization_with_tensorflow

thomasschmied / Text_summarization_with_tensorflow

Licence: mit
Implementation of a seq2seq model for summarization of textual data. Demonstrated on amazon reviews, github issues and news articles.

Programming Languages

python
139335 projects - #7 most used programming language

Projects that are alternatives of or similar to Text summarization with tensorflow

Text summurization abstractive methods
Multiple implementations for abstractive text summurization , using google colab
Stars: ✭ 359 (+58.85%)
Mutual labels:  jupyter-notebook, seq2seq, text-summarization, encoder-decoder
Pytorch Seq2seq
Tutorials on implementing a few sequence-to-sequence (seq2seq) models with PyTorch and TorchText.
Stars: ✭ 3,418 (+1412.39%)
Mutual labels:  jupyter-notebook, seq2seq, sequence-to-sequence, encoder-decoder
Tf Seq2seq
Sequence to sequence learning using TensorFlow.
Stars: ✭ 387 (+71.24%)
Mutual labels:  natural-language-processing, seq2seq, sequence-to-sequence, encoder-decoder
Speech recognition with tensorflow
Implementation of a seq2seq model for Speech Recognition using the latest version of TensorFlow. Architecture similar to Listen, Attend and Spell.
Stars: ✭ 253 (+11.95%)
Mutual labels:  jupyter-notebook, seq2seq, sequence-to-sequence, encoder-decoder
Text Summarization Tensorflow
Tensorflow seq2seq Implementation of Text Summarization.
Stars: ✭ 527 (+133.19%)
Mutual labels:  seq2seq, text-summarization, encoder-decoder
Pytextrank
Python implementation of TextRank for phrase extraction and summarization of text documents
Stars: ✭ 1,675 (+641.15%)
Mutual labels:  jupyter-notebook, natural-language-processing, summarization
Practical Pytorch
Go to https://github.com/pytorch/tutorials - this repo is deprecated and no longer maintained
Stars: ✭ 4,329 (+1815.49%)
Mutual labels:  jupyter-notebook, natural-language-processing, seq2seq
Textrank
TextRank implementation for Python 3.
Stars: ✭ 1,008 (+346.02%)
Mutual labels:  natural-language-processing, text-summarization, summarization
Screenshot To Code
A neural network that transforms a design mock-up into a static website.
Stars: ✭ 13,561 (+5900.44%)
Mutual labels:  jupyter-notebook, seq2seq, encoder-decoder
Sockeye
Sequence-to-sequence framework with a focus on Neural Machine Translation based on Apache MXNet
Stars: ✭ 990 (+338.05%)
Mutual labels:  seq2seq, sequence-to-sequence, encoder-decoder
Text Analytics With Python
Learn how to process, classify, cluster, summarize, understand syntax, semantics and sentiment of text data with the power of Python! This repository contains code and datasets used in my book, "Text Analytics with Python" published by Apress/Springer.
Stars: ✭ 1,132 (+400.88%)
Mutual labels:  jupyter-notebook, natural-language-processing, text-summarization
Pythonrouge
Python wrapper for evaluating summarization quality by ROUGE package
Stars: ✭ 155 (-31.42%)
Mutual labels:  natural-language-processing, text-summarization, summarization
Rnn For Joint Nlu
Pytorch implementation of "Attention-Based Recurrent Neural Network Models for Joint Intent Detection and Slot Filling" (https://arxiv.org/abs/1609.01454)
Stars: ✭ 176 (-22.12%)
Mutual labels:  jupyter-notebook, encoder-decoder
Web Database Analytics
Web scrapping and related analytics using Python tools
Stars: ✭ 175 (-22.57%)
Mutual labels:  jupyter-notebook, natural-language-processing
Nel
Entity linking framework
Stars: ✭ 176 (-22.12%)
Mutual labels:  jupyter-notebook, natural-language-processing
Nlp profiler
A simple NLP library allows profiling datasets with one or more text columns. When given a dataset and a column name containing text data, NLP Profiler will return either high-level insights or low-level/granular statistical information about the text in that column.
Stars: ✭ 181 (-19.91%)
Mutual labels:  jupyter-notebook, natural-language-processing
Deep Math Machine Learning.ai
A blog which talks about machine learning, deep learning algorithms and the Math. and Machine learning algorithms written from scratch.
Stars: ✭ 173 (-23.45%)
Mutual labels:  jupyter-notebook, natural-language-processing
Tensorflow Ml Nlp
텐서플로우와 머신러닝으로 시작하는 자연어처리(로지스틱회귀부터 트랜스포머 챗봇까지)
Stars: ✭ 176 (-22.12%)
Mutual labels:  jupyter-notebook, seq2seq
Deeptoxic
top 1% solution to toxic comment classification challenge on Kaggle.
Stars: ✭ 180 (-20.35%)
Mutual labels:  jupyter-notebook, natural-language-processing
Notebooks
Jupyter Notebooks with Deep Learning Tutorials
Stars: ✭ 188 (-16.81%)
Mutual labels:  jupyter-notebook, natural-language-processing

Text_Summarization_with_Tensorflow

Implementation of a seq2seq model for summarization of textual data using the latest version of tensorflow.
Demonstrated on amazon reviews, github issues and news articles.

Prerequisites

  • Tensorflow
  • nltk
  • numpy
  • pandas
  • langdetect

Datasets

I tried the network on three different datasets.

  1. Amazon Fine Food Reviews dataset
  2. Github issues dataset
  3. All the news dataset

All three of them are available on Kaggle:

Code

I uploaded three .py and three .ipynb files. The .py files contain the network implementation and utilities. The notebooks are demos of how to apply the model. Maybe it is useful for someone.

Architecture

Seq2Seq model

  • Encoder-Decoder
  • Bidirectional RNN
  • Bahdanau Attention
  • Adam Optimizer
  • exponential or cyclic learning rate
  • Beam Search or Greedy Decoding
Note that the project description data, including the texts, logos, images, and/or trademarks, for each open source project belongs to its rightful owner. If you wish to add or remove any projects, please contact us at [email protected].