All Projects → iyaozhen → filebeat.py

iyaozhen / filebeat.py

Licence: MIT license
Python 版 Filebeat

Programming Languages

python
139335 projects - #7 most used programming language

Projects that are alternatives of or similar to filebeat.py

Dockerfile
some personally made dockerfile
Stars: ✭ 2,021 (+4110.42%)
Mutual labels:  logstash, filebeat
docker-elk-stack
The ELK stack Docker containerization (Elasticsearch, Logstash and Kibana)
Stars: ✭ 20 (-58.33%)
Mutual labels:  logstash, filebeat
Synesis lite suricata
Suricata IDS/IPS log analytics using the Elastic Stack.
Stars: ✭ 167 (+247.92%)
Mutual labels:  logstash, filebeat
Vagrant Elastic Stack
Giving the Elastic Stack a try in Vagrant
Stars: ✭ 131 (+172.92%)
Mutual labels:  logstash, filebeat
S1EM
This project is a SIEM with SIRP and Threat Intel, all in one.
Stars: ✭ 270 (+462.5%)
Mutual labels:  logstash, filebeat
Elk Hole
elasticsearch, logstash and kibana configuration for pi-hole visualiziation
Stars: ✭ 136 (+183.33%)
Mutual labels:  logstash, filebeat
tutorials
Tutorials
Stars: ✭ 80 (+66.67%)
Mutual labels:  logstash, filebeat
k8s-log
容器日志搜集套件。
Stars: ✭ 15 (-68.75%)
Mutual labels:  logstash, filebeat
ELK-Hunting
Threat Hunting with ELK Workshop (InfoSecWorld 2017)
Stars: ✭ 58 (+20.83%)
Mutual labels:  logstash, filebeat
MegaDev
Bro IDS + ELK Stack to detect and block data exfiltration
Stars: ✭ 46 (-4.17%)
Mutual labels:  logstash, filebeat
Elkstack
The config files and docker-compose.yml files of Dockerized ELK Stack
Stars: ✭ 96 (+100%)
Mutual labels:  logstash, filebeat
dissect-tester
Simple API/UI for testing filebeat dissect patterns against a collection of sample log lines.
Stars: ✭ 58 (+20.83%)
Mutual labels:  logstash, filebeat
Elk
搭建ELK日志分析平台。
Stars: ✭ 688 (+1333.33%)
Mutual labels:  logstash, filebeat
Filebeat Kubernetes
Filebeat container, alternative to fluentd used to ship kubernetes cluster and pod logs
Stars: ✭ 147 (+206.25%)
Mutual labels:  logstash, filebeat
Aliware Kafka Demos
提供各种客户端接入阿里云 消息队列 Kafka 的demo工程
Stars: ✭ 279 (+481.25%)
Mutual labels:  logstash, filebeat
Docker Elastic
Deploy Elastic stack in a Docker Swarm cluster. Ship application logs and metrics using beats & GELF plugin to Elasticsearch
Stars: ✭ 202 (+320.83%)
Mutual labels:  logstash, filebeat
seahorse
ELKFH - Elastic, Logstash, Kibana, Filebeat and Honeypot (HTTP, HTTPS, SSH, RDP, VNC, Redis, MySQL, MONGO, SMB, LDAP)
Stars: ✭ 31 (-35.42%)
Mutual labels:  logstash, filebeat
elk-stack
ELK Stack (Elasticsearch, Logstash & Kibana)
Stars: ✭ 13 (-72.92%)
Mutual labels:  logstash, filebeat
kafka-elk-docker-compose
Deploy ELK stack and kafka with docker-compose
Stars: ✭ 78 (+62.5%)
Mutual labels:  logstash, filebeat
elastic-stack
A complete documentation on how to install Elastic Stack on Ubuntu 16.04 Server ASAP 😎
Stars: ✭ 12 (-75%)
Mutual labels:  logstash, filebeat

filebeat.py

Python 版 Filebeat(https://www.elastic.co/products/beats/filebeat) 实时收集日志,发送到下游 logstash 集群

运行方法

# 后台运行
nohup python filebeat.py filebeat.json &

配置参数说明

  • filebeat
    • path: 日志文件路径
    • date_ext: 日志的时间后缀,支持 Python 时间格式化,path 参数需包含 %s 格式符。为 null 时日志无时间后缀
    • include_lines: 需要包含行的关键字,null 表示所有行都需要
    • exclude_lines: 需要排除行的关键字,null 没有行需要排除
    • encoding: 文件编码
    • from_head: 是否重头读取当前文件,和原版 filebeat 的 tail_files 配置项功能类似,但是设置为 True(默认)时启停进程会重复读取文件,设置为 False 会丢数据
    • fields: 需要添加的自定义字段
  • logstash
    • hosts: logstash 地址(input=tcp)
Note that the project description data, including the texts, logos, images, and/or trademarks, for each open source project belongs to its rightful owner. If you wish to add or remove any projects, please contact us at [email protected].