All Projects → distillpub → post--memorization-in-rnns

distillpub / post--memorization-in-rnns

Licence: MIT license
Visualizing memorization in RNNs

Programming Languages

python
139335 projects - #7 most used programming language
javascript
184084 projects - #8 most used programming language
HTML
75241 projects
CSS
56736 projects
Makefile
30231 projects
TeX
3793 projects

Visualizing memorization in RNNs

Visualizing the gradient magnitudes in context, can be a powerful tool to see when recurrent units use short-term or long-term memorization.

  1. Run npm install
  2. Train the models with make train. This will take a very long time :)
  3. Build the data for the article with make build
  4. Bundle the article JavaScript with make bundle
  5. Run the article server with make server

Alternatively, if you just want to render and show the article:

  1. npm install
  2. npm start
Note that the project description data, including the texts, logos, images, and/or trademarks, for each open source project belongs to its rightful owner. If you wish to add or remove any projects, please contact us at [email protected].