All Projects → wuyifan18 → Deeplog

wuyifan18 / Deeplog

Licence: mit
Pytorch Implementation of DeepLog.

Programming Languages

python
139335 projects - #7 most used programming language

Projects that are alternatives of or similar to Deeplog

Deep Svdd
Repository for the Deep One-Class Classification ICML 2018 paper
Stars: ✭ 159 (-17.19%)
Mutual labels:  anomaly-detection
Deeplearning4j
Suite of tools for deploying and training deep learning models using the JVM. Highlights include model import for keras, tensorflow, and onnx/pytorch, a modular and tiny c++ library for running math code and a java based math library on top of the core c++ library. Also includes samediff: a pytorch/tensorflow like library for running deep learni…
Stars: ✭ 12,277 (+6294.27%)
Mutual labels:  deeplearning
Deep white balance
Reference code for the paper: Deep White-Balance Editing, CVPR 2020 (Oral). Our method is a deep learning multi-task framework for white-balance editing.
Stars: ✭ 184 (-4.17%)
Mutual labels:  deeplearning
Fixy
Amacımız Türkçe NLP literatüründeki birçok farklı sorunu bir arada çözebilen, eşsiz yaklaşımlar öne süren ve literatürdeki çalışmaların eksiklerini gideren open source bir yazım destekleyicisi/denetleyicisi oluşturmak. Kullanıcıların yazdıkları metinlerdeki yazım yanlışlarını derin öğrenme yaklaşımıyla çözüp aynı zamanda metinlerde anlamsal analizi de gerçekleştirerek bu bağlamda ortaya çıkan yanlışları da fark edip düzeltebilmek.
Stars: ✭ 165 (-14.06%)
Mutual labels:  deeplearning
Speech Emotion Recognition
Speaker independent emotion recognition
Stars: ✭ 169 (-11.98%)
Mutual labels:  deeplearning
Awesome Deep Learning Music
List of articles related to deep learning applied to music
Stars: ✭ 2,195 (+1043.23%)
Mutual labels:  deeplearning
Remixautoml
R package for automation of machine learning, forecasting, feature engineering, model evaluation, model interpretation, data generation, and recommenders.
Stars: ✭ 159 (-17.19%)
Mutual labels:  anomaly-detection
Coral Cnn
Rank Consistent Ordinal Regression for Neural Networks with Application to Age Estimation
Stars: ✭ 186 (-3.12%)
Mutual labels:  deeplearning
Log Anomaly Detector
Log Anomaly Detection - Machine learning to detect abnormal events logs
Stars: ✭ 169 (-11.98%)
Mutual labels:  anomaly-detection
Deeplearning4j Examples
Deeplearning4j Examples (DL4J, DL4J Spark, DataVec)
Stars: ✭ 2,215 (+1053.65%)
Mutual labels:  deeplearning
Hastic Grafana App
Hastic data management server for labeling patterns and anomalies in Grafana
Stars: ✭ 166 (-13.54%)
Mutual labels:  anomaly-detection
Robomaster2018 Seu Opensource
This is the open source project for RoboMaster 2018 contest from Southeast University
Stars: ✭ 169 (-11.98%)
Mutual labels:  deeplearning
Lstm anomaly thesis
Anomaly detection for temporal data using LSTMs
Stars: ✭ 178 (-7.29%)
Mutual labels:  anomaly-detection
Libra
Ergonomic machine learning for everyone.
Stars: ✭ 1,925 (+902.6%)
Mutual labels:  deeplearning
Datastories Semeval2017 Task4
Deep-learning model presented in "DataStories at SemEval-2017 Task 4: Deep LSTM with Attention for Message-level and Topic-based Sentiment Analysis".
Stars: ✭ 184 (-4.17%)
Mutual labels:  deeplearning
Motion Sense
MotionSense Dataset for Human Activity and Attribute Recognition ( time-series data generated by smartphone's sensors: accelerometer and gyroscope)
Stars: ✭ 159 (-17.19%)
Mutual labels:  deeplearning
Ee Outliers
Open-source framework to detect outliers in Elasticsearch events
Stars: ✭ 172 (-10.42%)
Mutual labels:  anomaly-detection
Bilinear Cnn Tensorflow
This is an implementation of Bilinear CNN for fine grained visual recognition using TensorFlow.
Stars: ✭ 187 (-2.6%)
Mutual labels:  deeplearning
Clearml Server
ClearML - Auto-Magical Suite of tools to streamline your ML workflow. Experiment Manager, ML-Ops and Data-Management
Stars: ✭ 186 (-3.12%)
Mutual labels:  deeplearning
Midas
Go implementation of MIDAS: Microcluster-Based Detector of Anomalies in Edge Streams
Stars: ✭ 180 (-6.25%)
Mutual labels:  anomaly-detection

DeepLog

A Pytorch implementation of DeepLog's log key anomaly detection model.

If you are confusing about how to extract log key (i.e. log template), I recommend using Drain which is proposed in this paper. As far as I know, it is the most effective log parsing method. By the way, there is a toolkit and benchmarks for automated log parsing in this repository.

Requirement

  • python>=3.6
  • pytorch==1.4
  • tensorboard==2.0.2

Dataset

The dataset can be downloaded HERE. The website can't accessed now, but you can find the HDFS data in this repository.

The original HDFS logs can be found [HERE] (http://people.iiis.tsinghua.edu.cn/~weixu/sospdata.html).

Visualization

Run the following code in terminal, then navigate to https://localhost:6006.

tensorboard --logdir=log

Reference

Min Du, Feifei Li, Guineng Zheng, Vivek Srikumar. "Deeplog: Anomaly detection and diagnosis from system logs through deep learning." ACM SIGSAC Conference on Computer and Communications Security(CCS), 2017.

Contributing

If you have any questions, please open an issue.

Welcome to pull requests to implement the rest of this paper!

Note that the project description data, including the texts, logos, images, and/or trademarks, for each open source project belongs to its rightful owner. If you wish to add or remove any projects, please contact us at [email protected].