All Projects → ypenglyn → Locktail

ypenglyn / Locktail

Licence: mit
Lock tailing on your rotating files

Programming Languages

shell
77523 projects

Labels

Projects that are alternatives of or similar to Locktail

Gofluent
(Not Maintained) Something acting like fluentd rewritten in Go.
Stars: ✭ 174 (+2075%)
Mutual labels:  tail
KTail
Kubernetes log viewer
Stars: ✭ 32 (+300%)
Mutual labels:  tail
Honeypot
Low interaction honeypot that displays real time attacks
Stars: ✭ 348 (+4250%)
Mutual labels:  tail
Utern
Multi group and stream log tailing for AWS CloudWatch Logs.
Stars: ✭ 241 (+2912.5%)
Mutual labels:  tail
pushover-cli
pushover-cli is a command line client for https://pushover.net to send pushover notifications. Moreover it is possible with this client to pipe streams directly to your cellphone like tail -f /var/log/my.log | pushover-cli -
Stars: ✭ 38 (+375%)
Mutual labels:  tail
fdlinecombine
Read multiple fds and print data to stdout linewise.
Stars: ✭ 40 (+400%)
Mutual labels:  tail
Tailon
Webapp for looking at and searching through files and streams
Stars: ✭ 155 (+1837.5%)
Mutual labels:  tail
Laravel Tail
An artisan command to tail your application logs
Stars: ✭ 587 (+7237.5%)
Mutual labels:  tail
tailf
tail -f written in Scala
Stars: ✭ 28 (+250%)
Mutual labels:  tail
Node Tail
The zero dependency Node.js module for tailing a file
Stars: ✭ 335 (+4087.5%)
Mutual labels:  tail
logtail
logtail is a log tailing utility, support tailing multiple commands output stream, transferring matching content to file/webhook(like dingtalk)
Stars: ✭ 33 (+312.5%)
Mutual labels:  tail
logs-monitor
An application like Linux tail for Windows. Using Windows FindFirstChangeNotification API to monitoring file changes.
Stars: ✭ 43 (+437.5%)
Mutual labels:  tail
Snaketail Net
Tail utility for monitoring text log files and Windows EventLog
Stars: ✭ 260 (+3150%)
Mutual labels:  tail
Kubetail
Bash script to tail Kubernetes logs from multiple pods at the same time
Stars: ✭ 2,468 (+30750%)
Mutual labels:  tail
Cw
The best way to tail AWS CloudWatch Logs from your terminal
Stars: ✭ 368 (+4500%)
Mutual labels:  tail
Remote Tail
RemoteTail用于同步监控多台服务器日志文件变更,一句话说就是多主机的远程tail。
Stars: ✭ 166 (+1975%)
Mutual labels:  tail
TailLog
实时日志(tail log)查看监控客户端工具
Stars: ✭ 79 (+887.5%)
Mutual labels:  tail
Monstache
a go daemon that syncs MongoDB to Elasticsearch in realtime
Stars: ✭ 736 (+9100%)
Mutual labels:  tail
Stern
⎈ Multi pod and container log tailing for Kubernetes
Stars: ✭ 5,614 (+70075%)
Mutual labels:  tail
Stern
⎈ Multi pod and container log tailing for Kubernetes -- Friendly fork of https://github.com/wercker/stern
Stars: ✭ 268 (+3250%)
Mutual labels:  tail

Locktail

Tailing on a file whose is rotated and its name changes daily like test-'date +"%Y%m%d".log.

  • locktail.sh: Tailing on rotated files with static file names
  • locktail_rotate.sh: Tailing on rotated files with rotated file names

Version

1.0

Excemple

# Origin log stream configuration for flume 
# 1. Load balancing
# 2. Event header modifying in-flight

originAgent.sources = originSource1 originSource2
originAgent.channels = originChannel
originAgent.sinks = originSink1 originSink2 originSink3

#-------------------------------------------
#               SOURCE
#-------------------------------------------
originAgent.sources.originSource1.type = exec
originAgent.sources.originSource1.command = /path/to/locktail.sh /path/to/your.log
originAgent.sources.originSource1.channels = originChannel

# data interceptors
originAgent.sources.originSource1.interceptors = addTopic addTimestamp addOriginLabel
originAgent.sources.originSource1.interceptors.addTopic.type = static
originAgent.sources.originSource1.interceptors.addTopic.key = topic
originAgent.sources.originSource1.interceptors.addTopic.value = log
originAgent.sources.originSource1.interceptors.addTimestamp.type = timestamp
originAgent.sources.originSource1.interceptors.addOriginLabel.type = static
originAgent.sources.originSource1.interceptors.addOriginLabel.key = origin
originAgent.sources.originSource1.interceptors.addOriginLabel.value = static_log


originAgent.sources.originSource2.type = exec
originAgent.sources.originSource2.command = /path/to/locktail_rotate.sh /path/to/your.DATE_ROTATE.log 'date +"%Y%m%d"'
originAgent.sources.originSource2.channels = originChannel

# data interceptors
originAgent.sources.originSource2.interceptors = addTopic addTimestamp addOriginLabel
originAgent.sources.originSource2.interceptors.addTopic.type = static
originAgent.sources.originSource2.interceptors.addTopic.key = topic
originAgent.sources.originSource2.interceptors.addTopic.value = log
originAgent.sources.originSource2.interceptors.addTimestamp.type = timestamp
originAgent.sources.originSource2.interceptors.addOriginLabel.type = static
originAgent.sources.originSource2.interceptors.addOriginLabel.key = origin
originAgent.sources.originSource2.interceptors.addOriginLabel.value = rotate_log

#-------------------------------------------
#               CHANNEL
#-------------------------------------------
# Each channel's type is defined.
originAgent.channels.originChannel.type = memory
originAgent.channels.originChannel.capacity = 20000
originAgent.channels.originChannel.transactionCapacity = 1000

#-------------------------------------------
#               SINK
#-------------------------------------------
#Specify the channel the sink should use
originAgent.sinks.originSink1.channel = originChannel
originAgent.sinks.originSink1.type = avro
originAgent.sinks.originSink1.hostname = host_1
originAgent.sinks.originSink1.port = 32120

originAgent.sinks.originSink2.channel = originChannel
originAgent.sinks.originSink2.type = avro
originAgent.sinks.originSink2.hostname = host_2
originAgent.sinks.originSink2.port = 32120

originAgent.sinks.originSink3.channel = originChannel
originAgent.sinks.originSink3.type = avro
originAgent.sinks.originSink3.hostname = host_3
originAgent.sinks.originSink3.port = 32120

originAgent.sinkgroups = originSinkGroup
originAgent.sinkgroups.originSinkGroup.sinks = originSink1 originSink2 originSink3
originAgent.sinkgroups.originSinkGroup.processor.type = load_balance
originAgent.sinkgroups.originSinkGroup.backoff = true
originAgent.sinkgroups.originSinkGroup.selector = round_robin
Note that the project description data, including the texts, logos, images, and/or trademarks, for each open source project belongs to its rightful owner. If you wish to add or remove any projects, please contact us at [email protected].