All Projects → selimfirat → Pysad

selimfirat / Pysad

Licence: bsd-3-clause
Streaming Anomaly Detection Framework in Python (Outlier Detection for Streaming Data)

Programming Languages

python
139335 projects - #7 most used programming language

Projects that are alternatives of or similar to Pysad

MStream
Anomaly Detection on Time-Evolving Streams in Real-time. Detecting intrusions (DoS and DDoS attacks), frauds, fake rating anomalies.
Stars: ✭ 68 (-21.84%)
Mutual labels:  real-time, intrusion-detection, anomaly-detection
MemStream
MemStream: Memory-Based Streaming Anomaly Detection
Stars: ✭ 58 (-33.33%)
Mutual labels:  real-time, anomaly-detection
CCD
Code for 'Constrained Contrastive Distribution Learning for Unsupervised Anomaly Detection and Localisation in Medical Images' [MICCAI 2021]
Stars: ✭ 30 (-65.52%)
Mutual labels:  unsupervised-learning, anomaly-detection
transit
Massively real-time city transit streaming application
Stars: ✭ 20 (-77.01%)
Mutual labels:  real-time, streaming-data
Hidden Two Stream
Caffe implementation for "Hidden Two-Stream Convolutional Networks for Action Recognition"
Stars: ✭ 179 (+105.75%)
Mutual labels:  unsupervised-learning, real-time
drama
Main component extraction for outlier detection
Stars: ✭ 17 (-80.46%)
Mutual labels:  unsupervised-learning, anomaly-detection
anomalib
An anomaly detection library comprising state-of-the-art algorithms and features such as experiment management, hyper-parameter optimization, and edge inference.
Stars: ✭ 1,210 (+1290.8%)
Mutual labels:  unsupervised-learning, anomaly-detection
Pyod
A Python Toolbox for Scalable Outlier Detection (Anomaly Detection)
Stars: ✭ 5,083 (+5742.53%)
Mutual labels:  unsupervised-learning, anomaly-detection
Swim
Distributed software platform for building stateful, massively real-time streaming applications.
Stars: ✭ 368 (+322.99%)
Mutual labels:  streaming-data, real-time
Rrcf
🌲 Implementation of the Robust Random Cut Forest algorithm for anomaly detection on streams
Stars: ✭ 289 (+232.18%)
Mutual labels:  streaming-data, anomaly-detection
Remixautoml
R package for automation of machine learning, forecasting, feature engineering, model evaluation, model interpretation, data generation, and recommenders.
Stars: ✭ 159 (+82.76%)
Mutual labels:  unsupervised-learning, anomaly-detection
Midas
Anomaly Detection on Dynamic (time-evolving) Graphs in Real-time and Streaming manner. Detecting intrusions (DoS and DDoS attacks), frauds, fake rating anomalies.
Stars: ✭ 591 (+579.31%)
Mutual labels:  anomaly-detection, intrusion-detection
Novelty Detection
Latent space autoregression for novelty detection.
Stars: ✭ 152 (+74.71%)
Mutual labels:  unsupervised-learning, anomaly-detection
pytod
TOD: GPU-accelerated Outlier Detection via Tensor Operations
Stars: ✭ 131 (+50.57%)
Mutual labels:  unsupervised-learning, anomaly-detection
Isolation Forest
A Spark/Scala implementation of the isolation forest unsupervised outlier detection algorithm.
Stars: ✭ 139 (+59.77%)
Mutual labels:  unsupervised-learning, anomaly-detection
Faster-Grad-CAM
Faster and more precisely than Grad-CAM
Stars: ✭ 33 (-62.07%)
Mutual labels:  real-time, anomaly-detection
Sparta
Real Time Analytics and Data Pipelines based on Spark Streaming
Stars: ✭ 513 (+489.66%)
Mutual labels:  streaming-data, real-time
Streamz
Real-time stream processing for python
Stars: ✭ 924 (+962.07%)
Mutual labels:  streaming-data, real-time
Image similarity
PyTorch Blog Post On Image Similarity Search
Stars: ✭ 80 (-8.05%)
Mutual labels:  unsupervised-learning
Teler
Real-time HTTP Intrusion Detection
Stars: ✭ 1,248 (+1334.48%)
Mutual labels:  intrusion-detection

.. image:: docs/logo.png :align: center

Python Streaming Anomaly Detection (PySAD)

.. image:: https://img.shields.io/pypi/v/pysad :target: https://pypi.org/project/pysad/ :alt: PyPI

.. image:: https://img.shields.io/github/v/release/selimfirat/pysad :target: https://github.com/selimfirat/pysad/releases :alt: GitHub release (latest by date)

.. image:: https://readthedocs.org/projects/pysad/badge/?version=latest :target: https://pysad.readthedocs.io/en/latest/?badge=latest :alt: Documentation status

.. image:: https://badges.gitter.im/selimfirat-pysad/community.svg :target: https://gitter.im/selimfirat-pysad/community?utm_source=share-link&utm_medium=link&utm_campaign=share-link :alt: Gitter

.. image:: https://dev.azure.com/selimfirat/pysad/_apis/build/status/selimfirat.pysad?branchName=master :target: https://dev.azure.com/selimfirat/pysad/_build/latest?definitionId=2&branchName=master :alt: Azure Pipelines Build Status

.. image:: https://travis-ci.org/selimfirat/pysad.svg?branch=master :target: https://travis-ci.org/selimfirat/pysad :alt: Travis CI Build Status

.. image:: https://ci.appveyor.com/api/projects/status/ceghuv517ghqgjce/branch/master?svg=true :target: https://ci.appveyor.com/project/selimfirat/pysad/branch/master :alt: Appveyor Build status

.. image:: https://circleci.com/gh/selimfirat/pysad.svg?style=svg :target: https://circleci.com/gh/selimfirat/pysad :alt: Circle CI

.. image:: https://coveralls.io/repos/github/selimfirat/pysad/badge.svg?branch=master :target: https://coveralls.io/github/selimfirat/pysad?branch=master :alt: Coverage Status

.. image:: https://img.shields.io/pypi/pyversions/pysad :target: https://github.com/selimfirat/pysad/ :alt: PyPI - Python Version

.. image:: https://img.shields.io/badge/platforms-linux--64%2Cosx--64%2Cwin--64-green :target: https://github.com/selimfirat/pysad/ :alt: Supported Platforms

.. image:: https://img.shields.io/github/license/selimfirat/pysad.svg :target: https://github.com/selimfirat/pysad/blob/master/LICENSE :alt: License

PySAD is an open-source python framework for anomaly detection on streaming multivariate data.

Documentation <https://pysad.readthedocs.io/en/latest/>_

Features

Online Anomaly Detection ^^^^^^^^^^^^^^^^^^^^^^^^

PySAD provides methods for online/sequential anomaly detection, i.e. anomaly detection on streaming data, where model updates itself as a new instance arrives.

Resource-Efficient ^^^^^^^^^^^^^^^^^^

Streaming methods efficiently handle the limitied memory and processing time requirements of the data streams so that they can be used in near real-time. The methods can only store an instance or a small window of recent instances.

Streaming Anomaly Detection Tools ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^

PySAD contains stream simulators, evaluators, preprocessors, statistic trackers, postprocessors, probability calibrators and more. In addition to streaming models, PySAD also provides integrations for batch anomaly detectors of the PyOD <https://github.com/yzhao062/pyod/>_ so that they can be used in the streaming setting.

Comprehensiveness ^^^^^^^^^^^^^^^^^

PySAD serves models that are specifically designed for both univariate and multivariate data. Furthermore, one can experiment via PySAD in supervised, semi-supervised and unsupervised setting.

User Friendly ^^^^^^^^^^^^^

Users with any experience level can easily use PySAD. One can easily design experiments and combine the tools in the framework. Moreover, the existing methods in PySAD are easy to extend.

Free and Open Source Software (FOSS) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^

PySAD is distributed under BSD License 2.0 <https://github.com/selimfirat/pysad/blob/master/LICENSE>_ and favors FOSS principles.

Installation

The PySAD framework can be installed via:

.. code-block:: bash

pip install -U pysad

Alternatively, you can install the library directly using the source code in Github repository by:

.. code-block:: bash

git clone https://github.com/selimfirat/pysad.git
cd pysad
pip install .

Required Dependencies:

  • numpy>=1.18.5
  • scipy>=1.4.1
  • scikit-learn>=0.23.2
  • pyod>=0.7.7.1

Optional Dependencies:

  • rrcf==0.4.3 (Only required for pysad.models.robust_random_cut_forest.RobustRandomCutForest)
  • PyNomaly==0.3.3 (Only required for pysad.models.loop.StreamLocalOutlierProbability)
  • mmh3==2.5.1 (Only required for pysad.models.xstream.xStream)
  • pandas==1.1.0 (Only required for pysad.utils.pandas_streamer.PandasStreamer)

Quick Links

  • Github Repository <https://github.com/selimfirat/pysad/>_

  • Documentation <http://pysad.readthedocs.io/>_

  • PyPI Package <https://pypi.org/project/pysad>_

  • Travis CI <https://travis-ci.com/github/selimfirat/pysad>_

  • Azure Pipelines <https://dev.azure.com/selimfirat/pysad/>_

  • Circle CI <https://circleci.com/gh/selimfirat/pysad/>_

  • Appveyor <https://ci.appveyor.com/project/selimfirat/pysad/branch/master>_

  • Coveralls <https://coveralls.io/github/selimfirat/pysad?branch=master>_

  • License <https://github.com/selimfirat/pysad/blob/master/LICENSE>_

Versioning

Semantic versioning <http://semver.org/>_ is used for this project.

License

This project is licensed under the BSD License 2.0 <https://github.com/selimfirat/pysad/blob/master/LICENSE>_.

Citing PySAD

If you use PySAD for a scientific publication, we would appreciate citations to the following paper:

.. code-block::

@article{pysad,
  title={PySAD: A Streaming Anomaly Detection Framework in Python},
  author={Yilmaz, Selim F and Kozat, Suleyman S},
  journal={arXiv preprint arXiv:2009.02572},
  year={2020}
}
Note that the project description data, including the texts, logos, images, and/or trademarks, for each open source project belongs to its rightful owner. If you wish to add or remove any projects, please contact us at [email protected].