All Projects → beringresearch → Ivis

beringresearch / Ivis

Licence: gpl-2.0
Dimensionality reduction in very large datasets using Siamese Networks

Programming Languages

python
139335 projects - #7 most used programming language

Projects that are alternatives of or similar to Ivis

Obscurify
Find out more about your music taste and compare it to others' with Obscurify
Stars: ✭ 200 (-10.71%)
Mutual labels:  data-visualization
Stocksensation
基于情感字典和机器学习的股市舆情情感分类可视化Web
Stars: ✭ 215 (-4.02%)
Mutual labels:  data-visualization
R Ecology Lesson
Data Analysis and Visualization in R for Ecologists
Stars: ✭ 218 (-2.68%)
Mutual labels:  data-visualization
Koolreport
This is an Open Source PHP Reporting Framework which you can use to write perfect data reports or to construct awesome dashboards using PHP
Stars: ✭ 204 (-8.93%)
Mutual labels:  data-visualization
Shifterator
Interpretable data visualizations for understanding how texts differ at the word level
Stars: ✭ 209 (-6.7%)
Mutual labels:  data-visualization
Chartbrew
Open-source web platform for creating charts out of different data sources (databases and APIs) 📈📊
Stars: ✭ 199 (-11.16%)
Mutual labels:  data-visualization
Quark
Quark is a data visualization framework.
Stars: ✭ 198 (-11.61%)
Mutual labels:  data-visualization
React Trend
📈 Simple, elegant spark lines
Stars: ✭ 2,453 (+995.09%)
Mutual labels:  data-visualization
Mprove
Open source Business Intelligence tool 🎉
Stars: ✭ 212 (-5.36%)
Mutual labels:  data-visualization
Gwu data mining
Materials for GWU DNSC 6279 and DNSC 6290.
Stars: ✭ 217 (-3.12%)
Mutual labels:  data-visualization
Ggcharts
Get You to Your Desired Plot Faster
Stars: ✭ 205 (-8.48%)
Mutual labels:  data-visualization
Dexplot
Simple plotting library that wraps Matplotlib and integrated with DataFrames
Stars: ✭ 208 (-7.14%)
Mutual labels:  data-visualization
Keen Dataviz.js
Data Visualization Charting Library
Stars: ✭ 215 (-4.02%)
Mutual labels:  data-visualization
Python Novice Inflammation
Programming with Python
Stars: ✭ 199 (-11.16%)
Mutual labels:  data-visualization
Edaviz
edaviz - Python library for Exploratory Data Analysis and Visualization in Jupyter Notebook or Jupyter Lab
Stars: ✭ 220 (-1.79%)
Mutual labels:  data-visualization
Discovery
Frontend framework for rapid data (JSON) analysis, sharable serverless reports and dashboards
Stars: ✭ 199 (-11.16%)
Mutual labels:  data-visualization
Helicalinsight
Helical Insight software is world’s first Open Source Business Intelligence framework which helps you to make sense out of your data and make well informed decisions.
Stars: ✭ 214 (-4.46%)
Mutual labels:  data-visualization
Reaviz
📊 Data visualization library for React based on D3
Stars: ✭ 215 (-4.02%)
Mutual labels:  data-visualization
Amazing Feature Engineering
Feature engineering is the process of using domain knowledge to extract features from raw data via data mining techniques. These features can be used to improve the performance of machine learning algorithms. Feature engineering can be considered as applied machine learning itself.
Stars: ✭ 218 (-2.68%)
Mutual labels:  data-visualization
Chord
Python package for creating beautiful interactive Chord Diagrams. Pro version available at https://m8.fyi/chord
Stars: ✭ 217 (-3.12%)
Mutual labels:  data-visualization

DOI DOI Documentation Status Downloads Build Status

ivis

Implementation of the ivis algorithm as described in the paper Structure-preserving visualisation of high dimensional single-cell datasets. Ivis is designed to reduce dimensionality of very large datasets using a siamese neural network trained on triplets. Both unsupervised and supervised modes are supported.

ivis 10M data points

Installation

Ivis runs on top of TensorFlow. To install the latest ivis release from PyPi running on the CPU TensorFlow package, run:

# TensorFlow 2 packages require a pip version >19.0.
pip install --upgrade pip
pip install ivis[cpu]

If you have CUDA installed and want ivis to use the tensorflow-gpu package, run

pip install ivis[gpu]

Development version can be installed directly from from github:

git clone https://github.com/beringresearch/ivis
cd ivis
pip install -e '.[cpu]'

The following optional dependencies are needed if using the visualization callbacks while training the Ivis model:

  • matplotlib
  • seaborn

Upgrading

Ivis Python package is updated frequently! To upgrade, run:

pip install ivis --upgrade

Features

  • Scalable: ivis is fast and easily extends to millions of observations and thousands of features.
  • Versatile: numpy arrays, sparse matrices, and hdf5 files are supported out of the box. Additionally, both categorical and continuous features are handled well, making it easy to apply ivis to heterogeneous problems including clustering and anomaly detection.
  • Accurate: ivis excels at preserving both local and global features of a dataset. Often, ivis performs better at preserving global structure of the data than t-SNE, making it easy to visualise and interpret high-dimensional datasets.
  • Generalisable: ivis supports addition of new data points to original embeddings via a transform method, making it easy to incorporate ivis into standard sklearn Pipelines.

And many more! See ivis readme for latest additions and examples.

Examples

from ivis import Ivis
from sklearn.preprocessing import MinMaxScaler
from sklearn import datasets

iris = datasets.load_iris()
X = iris.data
X_scaled = MinMaxScaler().fit_transform(X)

model = Ivis(embedding_dims=2, k=15)

embeddings = model.fit_transform(X_scaled)

Copyright 2021 Bering Limited

Note that the project description data, including the texts, logos, images, and/or trademarks, for each open source project belongs to its rightful owner. If you wish to add or remove any projects, please contact us at [email protected].