All Projects → sematext → Logagent Js

sematext / Logagent Js

Licence: apache-2.0
Extensible log shipper with input/output plugins, buffering, parsing, data masking, and small memory/CPU footprint

Programming Languages

javascript
184084 projects - #8 most used programming language

Projects that are alternatives of or similar to Logagent Js

Json Logging Python
Python logging library to emit JSON log that can be easily indexed and searchable by logging infrastructure such as ELK, EFK, AWS Cloudwatch, GCP Stackdriver
Stars: ✭ 143 (-57.06%)
Mutual labels:  elk, elk-stack, logging
Punt
Punt is a tiny and lightweight daemon which helps ship logs to Elasticsearch.
Stars: ✭ 98 (-70.57%)
Mutual labels:  elk, elk-stack, logging
search-guard-module-kibana-multitenancy
[OUTDATED] Provide multitenancy and other features for kibana
Stars: ✭ 15 (-95.5%)
Mutual labels:  elk, elk-stack
ELK-Hunting
Threat Hunting with ELK Workshop (InfoSecWorld 2017)
Stars: ✭ 58 (-82.58%)
Mutual labels:  elk, elk-stack
data-processing-with-logstash
Contains the configuration files used within the Data Processing with Logstash course.
Stars: ✭ 76 (-77.18%)
Mutual labels:  elk, elk-stack
kiev
A set of tools to do distributed logging for Ruby web applications
Stars: ✭ 46 (-86.19%)
Mutual labels:  elk, elk-stack
rubban
Kibana Automatic Index Pattern Discovery and Other Elastic Stack Curating Tasks
Stars: ✭ 49 (-85.29%)
Mutual labels:  elk, elk-stack
log-generator
Log generator using SLF4J / Java 7 concurrency
Stars: ✭ 11 (-96.7%)
Mutual labels:  logs, elk-stack
Search Guard
Search Guard Plugin - Security for Elasticsearch
Stars: ✭ 56 (-83.18%)
Mutual labels:  elk, elk-stack
docker-repo
A repository stores some dockerfiles or docker-compose files for quickly starting service or service cluster.
Stars: ✭ 26 (-92.19%)
Mutual labels:  elk, elk-stack
elk-in-docker
ELK cluster in docker
Stars: ✭ 23 (-93.09%)
Mutual labels:  elk, elk-stack
elastic-search-analyzer
基于elasticsearch,ik, 分词,全文搜索,使用demo
Stars: ✭ 41 (-87.69%)
Mutual labels:  elk, elk-stack
lgrep
CLI for searching logstash and other elasticsearch based systems
Stars: ✭ 12 (-96.4%)
Mutual labels:  elk, elk-stack
tutorials
Tutorials
Stars: ✭ 80 (-75.98%)
Mutual labels:  logs, elk-stack
Vortex
🌀 Discord Moderation Bot
Stars: ✭ 283 (-15.02%)
Mutual labels:  logging, logs
Mozdef
DEPRECATED - MozDef: Mozilla Enterprise Defense Platform
Stars: ✭ 2,164 (+549.85%)
Mutual labels:  elk, elk-stack
ansible
Ansible playbook automation for pfelk
Stars: ✭ 23 (-93.09%)
Mutual labels:  elk, elk-stack
Helk
The Hunting ELK
Stars: ✭ 3,097 (+830.03%)
Mutual labels:  elk, elk-stack
Search Guard Ssl
Elasticsearch SSL for free. Supports native Open SSL.
Stars: ✭ 159 (-52.25%)
Mutual labels:  elk, elk-stack
eslog tutorial
From Raw Logs to Real Insights - A tutorial for getting started with log analytics using Elastic Stack.
Stars: ✭ 28 (-91.59%)
Mutual labels:  elk, elk-stack

Build Status Deploy - read more

What is Logagent

Logagent is a modern, open-source, light-weight log shipper. It is like Filebeat and Logstash in one, without the JVM memory footprint. It comes with out of the box and extensible log parsing, on-disk buffering, secure transport, and bulk indexing to Elasticsearch, Sematext Logs, and other destinations. Its low memory footprint and low CPU overhead make it suitable for deploying on edge nodes and devices, while its ability to parse and structure logs makes it a great Logstash alternative.

Docker

Details about the the Logagent Docker image are described in the Docker Hub Readme

Installation

1) Install Node.js

Official Node.js downloads and instructions. E.g. for Debian/Ubuntu:

curl -sL https://deb.nodesource.com/setup_10.x | sudo -E bash -
sudo apt-get install -y nodejs
Install Logagent with npm
sudo npm i -g @sematext/logagent

2) Run logagent command line tool

logagent --help

3) Example: Index your log files in Elasticsearch

logagent -e http://localhost:9200 -i logs -g ‘/var/log/**/*.log’

4) Optional: Install service & config

Install service for Logagent using systemd, upstart, launchd To quickly create a config file for indexing into Elasticsearch without having to edit it run something like this:

sudo logagent-setup -u http://localhost:9200 -i INDEX_NAME -g '/var/log/**/*.log'
# Logsene US: use -u https://logsene-receiver.sematext.com and your Logsene App Token as index name.
# Logsene EU: use -u https://logsene-receiver.eu.sematext.com and your Logsene App Token as index name.

Configuration

To configure different inputs, different event processing, or different outputs (e.g. your own Elasticsearch) edit /etc/sematext/logagent.conf, e.g.:

output:
  logsene:
    module: elasticsearch
    url: http://elasticsearch-server:9200
    index: logs

Then restart the service with sudo service logagent restart. Troubleshooting & Logs Logagent’s own logs:

  • Upstart: /var/log/upstart/logagent.log
  • Systemd: journalctl -u logagent
  • Launchd: /Library/Logs/logagent.log

Location of service scripts:

  • Upstart: /etc/init/logagent.conf
  • Systemd: /etc/systemd/system/logagent.service
  • Launchd: /Library/LaunchDaemons/com.sematext.logagent.plist

Start/stop service:

  • Upstart: service logagent stop/start
  • Systemd: systemctl stop/start logagent
  • Launchd: launchctl start/stop com.sematext.logagent

Documentation & Support

Development

  • Update to the last node version
  • From root folder node type: node ./bin/logagent -h
  • To test from root folder type: node test
Note that the project description data, including the texts, logos, images, and/or trademarks, for each open source project belongs to its rightful owner. If you wish to add or remove any projects, please contact us at [email protected].