All Projects → googlearchive → pubsubbeat

googlearchive / pubsubbeat

Licence: other
An Elastic Beat to ingest data from Google Pub/Sub

Programming Languages

go
31211 projects - #10 most used programming language
shell
77523 projects
python
139335 projects - #7 most used programming language
Makefile
30231 projects
Dockerfile
14818 projects

Projects that are alternatives of or similar to pubsubbeat

emulator-tools
Google Cloud BigTable and PubSub emulator tools to make development a breeze
Stars: ✭ 16 (-60%)
Mutual labels:  pubsub, google-cloud-platform
awesome-elastic-stack
Awesome Elastic Stack
Stars: ✭ 29 (-27.5%)
Mutual labels:  beats, elastic
cloudenvoy
Cross-application messaging for Ruby and Rails using Google Cloud Pub/Sub
Stars: ✭ 31 (-22.5%)
Mutual labels:  pubsub, google-cloud-platform
mqttbeat
Elasticsearch beat to save messages received with the MQTT protocol.
Stars: ✭ 18 (-55%)
Mutual labels:  beats, elasticbeats
cloudwatchmetricbeat
A beat for AWS CloudWatch Metrics. Located in NYC? We are hiring: https://www.narmi.com/careers/
Stars: ✭ 17 (-57.5%)
Mutual labels:  beats, elastic
iris3
An upgraded and improved version of the Iris automatic GCP-labeling project
Stars: ✭ 38 (-5%)
Mutual labels:  pubsub, google-cloud-platform
kafkabeat
Kafka event forwarder build on top of Elastic Beats platform
Stars: ✭ 13 (-67.5%)
Mutual labels:  beats, elastic
kane
Google Pub/Sub client for Elixir
Stars: ✭ 92 (+130%)
Mutual labels:  pubsub, google-cloud-platform
terraform-splunk-log-export
Deploy Google Cloud log export to Splunk using Terraform
Stars: ✭ 26 (-35%)
Mutual labels:  pubsub, google-cloud-platform
icingabeat
Elastic Beat fetching events & status from Icinga 2
Stars: ✭ 36 (-10%)
Mutual labels:  beats, elastic
elastic-adapter
Elastic remote storage adapter for prometheus.
Stars: ✭ 17 (-57.5%)
Mutual labels:  elastic
react-bus
A global event emitter for react.
Stars: ✭ 34 (-15%)
Mutual labels:  pubsub
elasty
A research-oriented elastic body simulator
Stars: ✭ 173 (+332.5%)
Mutual labels:  elastic
gcp-firewall-enforcer
A toolbox to enforce firewall rules across multiple GCP projects.
Stars: ✭ 77 (+92.5%)
Mutual labels:  google-cloud-platform
app-search-flask-app
This is an example of a Python Flask app with Elasticsearch/ Elastic App Search with respective Python Clients
Stars: ✭ 17 (-57.5%)
Mutual labels:  elastic
actionizer
Simple pub/sub for data flow like Redux.
Stars: ✭ 21 (-47.5%)
Mutual labels:  pubsub
mlops-with-vertex-ai
An end-to-end example of MLOps on Google Cloud using TensorFlow, TFX, and Vertex AI
Stars: ✭ 155 (+287.5%)
Mutual labels:  google-cloud-platform
restme
Template to bootstrap a fully functional, multi-region, REST service on GCP with a developer release pipeline.
Stars: ✭ 19 (-52.5%)
Mutual labels:  google-cloud-platform
elastic-certified-engineer
No description or website provided.
Stars: ✭ 23 (-42.5%)
Mutual labels:  elastic
rowy
Open-source Airtable-like experience for your database (Firestore) with GCP's scalability. Build any automation or cloud functions for your product. ⚡️✨
Stars: ✭ 2,676 (+6590%)
Mutual labels:  google-cloud-platform

Status: Archived

This project is no longer actively maintained by Google.


Pubsubbeat

Pubsubbeat is an elastic Beat for Google Cloud Pub/Sub. This Beat subscribes to a topic and ingest messages.

The main motivation behind the development of this plugin is to ingest Stackdriver Logs via the Exported Logs feature and send them directly to Elasticsearch ingest nodes.

This is not an officially supported Google product.

Getting Started with Pubsubbeat

Requirements

Build

To build the binary for Pubsubbeat run the command below. This will generate a binary in the same directory with the name pubsubbeat.

make

Run

To run Pubsubbeat with debugging output enabled, run:

./pubsubbeat -c pubsubbeat.yml -e -d "*"

Test

To test Pubsubbeat, run the following command:

make test

Cleanup

To clean Pubsubbeat source code, run the following commands:

make pre-commit

To clean up the build directory and generated artifacts, run:

make clean

Packaging

To build releases for available platforms:

make release

This will fetch and create binaries for all Linux, Windows and OSX

Note that the project description data, including the texts, logos, images, and/or trademarks, for each open source project belongs to its rightful owner. If you wish to add or remove any projects, please contact us at [email protected].