SuperCowPowers / Zat
Licence: apache-2.0
Zeek Analysis Tools (ZAT): Processing and analysis of Zeek network data with Pandas, scikit-learn, Kafka and Spark
Stars: ✭ 303
Programming Languages
python
139335 projects - #7 most used programming language
Projects that are alternatives of or similar to Zat
Dat8
General Assembly's 2015 Data Science course in Washington, DC
Stars: ✭ 1,516 (+400.33%)
Mutual labels: jupyter-notebook, data-analysis, pandas, scikit-learn
Pbpython
Code, Notebooks and Examples from Practical Business Python
Stars: ✭ 1,724 (+468.98%)
Mutual labels: jupyter-notebook, data-analysis, pandas, scikit-learn
Handyspark
HandySpark - bringing pandas-like capabilities to Spark dataframes
Stars: ✭ 158 (-47.85%)
Mutual labels: jupyter-notebook, spark, pandas
Cheatsheets.pdf
📚 Various cheatsheets in PDF
Stars: ✭ 159 (-47.52%)
Mutual labels: jupyter-notebook, pandas, scikit-learn
Data Science Projects With Python
A Case Study Approach to Successful Data Science Projects Using Python, Pandas, and Scikit-Learn
Stars: ✭ 198 (-34.65%)
Mutual labels: jupyter-notebook, pandas, scikit-learn
Data Analysis
主要是爬虫与数据分析项目总结，外加建模与机器学习，模型的评估。
Stars: ✭ 142 (-53.14%)
Mutual labels: jupyter-notebook, data-analysis, pandas
Ml Workspace
🛠 All-in-one web-based IDE specialized for machine learning and data science.
Stars: ✭ 2,337 (+671.29%)
Mutual labels: jupyter-notebook, data-analysis, scikit-learn
Data Science Hacks
Data Science Hacks consists of tips, tricks to help you become a better data scientist. Data science hacks are for all - beginner to advanced. Data science hacks consist of python, jupyter notebook, pandas hacks and so on.
Stars: ✭ 273 (-9.9%)
Mutual labels: jupyter-notebook, data-analysis, pandas
Amazing Feature Engineering
Feature engineering is the process of using domain knowledge to extract features from raw data via data mining techniques. These features can be used to improve the performance of machine learning algorithms. Feature engineering can be considered as applied machine learning itself.
Stars: ✭ 218 (-28.05%)
Mutual labels: jupyter-notebook, data-analysis, scikit-learn
Kagglestruggle
Kaggle Struggle
Stars: ✭ 228 (-24.75%)
Mutual labels: jupyter-notebook, pandas, scikit-learn
Code
Compilation of R and Python programming codes on the Data Professor YouTube channel.
Stars: ✭ 287 (-5.28%)
Mutual labels: jupyter-notebook, pandas, scikit-learn
Practical Machine Learning With Python
Master the essential skills needed to recognize and solve complex real-world problems with Machine Learning and Deep Learning by leveraging the highly popular Python Machine Learning Eco-system.
Stars: ✭ 1,868 (+516.5%)
Mutual labels: jupyter-notebook, pandas, scikit-learn
dataquest-guided-projects-solutions
My dataquest project solutions
Stars: ✭ 35 (-88.45%)
Mutual labels: scikit-learn, pandas, data-analysis
Machine Learning With Python
Practice and tutorial-style notebooks covering wide variety of machine learning techniques
Stars: ✭ 2,197 (+625.08%)
Mutual labels: jupyter-notebook, pandas, scikit-learn
Pandas Videos
Jupyter notebook and datasets from the pandas Q&A video series
Stars: ✭ 1,716 (+466.34%)
Mutual labels: jupyter-notebook, data-analysis, pandas
Dtale
Visualizer for pandas data structures
Stars: ✭ 2,864 (+845.21%)
Mutual labels: jupyter-notebook, data-analysis, pandas
100 Pandas Puzzles
100 data puzzles for pandas, ranging from short and simple to super tricky (60% complete)
Stars: ✭ 1,382 (+356.11%)
Mutual labels: jupyter-notebook, data-analysis, pandas
Seaborn Tutorial
This repository is my attempt to help Data Science aspirants gain necessary Data Visualization skills required to progress in their career. It includes all the types of plot offered by Seaborn, applied on random datasets.
Stars: ✭ 114 (-62.38%)
Mutual labels: jupyter-notebook, data-analysis, pandas
Edaviz
edaviz - Python library for Exploratory Data Analysis and Visualization in Jupyter Notebook or Jupyter Lab
Stars: ✭ 220 (-27.39%)
Mutual labels: jupyter-notebook, data-analysis, pandas
PracticalMachineLearning
A collection of ML related stuff including notebooks, codes and a curated list of various useful resources such as books and softwares. Almost everything mentioned here is free (as speech not free food) or open-source.
Stars: ✭ 60 (-80.2%)
Mutual labels: scikit-learn, pandas, data-analysis
Zeek Analysis Tools (ZAT)
The ZAT Python package supports the processing and analysis of Zeek data with Pandas, scikit-learn, Kafka, and Spark
Install
$ pip install zat
Getting Started
Installing on Raspberry Pi!
Recent Improvements
- Faster/Smaller Pandas Dataframes for large log files: Large Dataframes
- Better Panda Dataframe to Matrix (ndarray) support: Dataframe To Matrix
- Scalable conversion from Zeek logs to Parquet: Zeek to Parquet
- Vastly improved Spark Dataframe Class: Zeek to Spark
- Updated/improved Notebooks: Analysis Notebooks
- Zeek JSON to DataFrame class: Zeek JSON to DataFrame Example
Video Presentation
Why ZAT?
Zeek already has a flexible, powerful scripting language why should I use ZAT?
Offloading: Running complex tasks like statistics, state machines, machine learning, etc.. should be offloaded from Zeek so that Zeek can focus on the efficient processing of high volume network traffic.
Data Analysis: We have a large set of support classes that help bridge from raw Zeek data to packages like Pandas, scikit-learn, Kafka, and Spark. We also have example notebooks that show step-by-step how to get from here to there.
Analysis Notebooks
- Zeek to Scikit-Learn
- Zeek to Parquet
- Zeek to Spark
- Spark Clustering
- Zeek to Kafka
- Zeek to Kafka to Spark
- Clustering: Picking K (or not)
- Anomaly Detection Exploration
- Risky Domains Stats and Deployment
- Zeek to Matplotlib
Documentation
https://supercowpowers.github.io/zat/
About SuperCowPowers
The company was formed so that its developers could follow their passion for Python, streaming data pipelines and having fun with data analysis. We also think cows are cool and should be superheros or at least carry around rayguns and burner phones. Visit SuperCowPowers
Note that the project description data, including the texts, logos, images, and/or trademarks,
for each open source project belongs to its rightful owner.
If you wish to add or remove any projects, please contact us at [email protected].