All Projects → gchq → Stroom

gchq / Stroom

Licence: apache-2.0
Stroom is a highly scalable data storage, processing and analysis platform.

Programming Languages

java
68154 projects - #9 most used programming language

Projects that are alternatives of or similar to Stroom

Traildb
TrailDB is an efficient tool for storing and querying series of events
Stars: ✭ 1,029 (+199.13%)
Mutual labels:  big-data, data-analytics
Nsdb
Natural Series Database
Stars: ✭ 49 (-85.76%)
Mutual labels:  lucene, data-analytics
vxquery
Mirror of Apache VXQuery
Stars: ✭ 19 (-94.48%)
Mutual labels:  big-data, xml
Dremio Oss
Dremio - the missing link in modern data
Stars: ✭ 862 (+150.58%)
Mutual labels:  big-data, data-analytics
Trck
Query engine for TrailDB
Stars: ✭ 48 (-86.05%)
Mutual labels:  big-data, data-analytics
Countly Sdk Cordova
Countly Product Analytics SDK for Cordova, Icenium and Phonegap
Stars: ✭ 69 (-79.94%)
Mutual labels:  big-data, data-analytics
Smooks
An extensible Java framework for building XML and non-XML streaming applications
Stars: ✭ 293 (-14.83%)
Mutual labels:  xml, big-data
Ofbiz Framework
Apache OFBiz is an open source product for the automation of enterprise processes. It includes framework components and business applications for ERP, CRM, E-Business/E-Commerce, Supply Chain Management and Manufacturing Resource Planning. OFBiz provides a foundation and starting point for reliable, secure and scalable enterprise solutions.
Stars: ✭ 315 (-8.43%)
Mutual labels:  xml
Ssm
💕 build SSM from 0 👉🏽👉🏽 distributed micro service.
Stars: ✭ 3,383 (+883.43%)
Mutual labels:  lucene
Grabana
User-friendly Go library for building Grafana dashboards
Stars: ✭ 313 (-9.01%)
Mutual labels:  dashboards
Uproot3
ROOT I/O in pure Python and NumPy.
Stars: ✭ 312 (-9.3%)
Mutual labels:  big-data
Tez
Apache Tez
Stars: ✭ 313 (-9.01%)
Mutual labels:  big-data
Getsimplecms
GetSimple CMS
Stars: ✭ 333 (-3.2%)
Mutual labels:  xml
Mmark
Mmark: a powerful markdown processor in Go geared towards the IETF
Stars: ✭ 313 (-9.01%)
Mutual labels:  xml
Spectralizer
Audio visualizer plugin for obs-studio
Stars: ✭ 332 (-3.49%)
Mutual labels:  visualisation
Webmarkupmin
The Web Markup Minifier (abbreviated WebMarkupMin) - a .NET library that contains a set of markup minifiers. The objective of this project is to improve the performance of web applications by reducing the size of HTML, XHTML and XML code.
Stars: ✭ 312 (-9.3%)
Mutual labels:  xml
Parquet Cpp
Apache Parquet
Stars: ✭ 339 (-1.45%)
Mutual labels:  big-data
Ozone
Scalable, redundant, and distributed object store for Apache Hadoop
Stars: ✭ 330 (-4.07%)
Mutual labels:  big-data
Underscore Java
java port of Underscore.js
Stars: ✭ 327 (-4.94%)
Mutual labels:  xml
Fluentdom
A fluent api for working with XML in PHP
Stars: ✭ 327 (-4.94%)
Mutual labels:  xml

Stroom

Stroom is a data processing, storage and analysis platform. It is scalable - just add more CPUs / servers for greater throughput. It is suitable for processing high volume data such as system logs, to provide valuable insights into IT performance and usage.

Stroom provides a number of powerful capabilities:

  • Data ingest. Receive and store large volumes of data such as native format logs. Ingested data is always available in its raw form.
  • Data transformation pipelines. Create sequences of XSL and text operations, in order to normalise or export data in any format. It is possible to enrich data using lookups and reference data.
  • Integrated transformation development. Easily add new data formats and debug the transformations if they don't work as expected.
  • Scalable Search. Create multiple indexes with different retention periods. These can be sharded across your cluster.
  • Dashboards. Run queries against your indexes or statistics and view the results within custom visualisations.
  • Statistics. Record counts or values of items over time, providing answers to questions such as "how many times has a specific machine provided data in the last hour/day/month?"

Get Stroom

To run Stroom in docker do the following:

# Download and extract the latest Stroom v6 stack
bash <(curl -s https://gchq.github.io/stroom-resources/get_stroom.sh)

# Navigate into the new stack directory
cd stroom_core_test/stroom_core_test*

# Start the stack
./start.sh

For more details on the commands above and any prerequisites see Running Stroom in Docker Containers.

For the releases of the core Stroom product, see Stroom releases. For the releases of the docker application stacks, see Stroom-Resources releases.

Documentation

The Stroom application spans several repositories but we've bundled all the documentation into the stroom-docs repository. That's where to look if you want any of these:

Contributing

If you'd like to make a contribution then the details for doing all of that are in CONTRIBUTING.md.

Repositories

Stroom and its associated libraries, services and content span several repositories:

  • stroom - The core Stroom application.
  • stroom-agent - An application for capturing and sending log files to Stroom.
  • stroom-auth - The OAuth2 authentication service used by Stroom.
  • stroom-clients - Various client libraries for sending logs to Stroom.
  • stroom-content - Packaged content packs for import into Stroom.
  • stroom-docs - Documentation for the Stroom family of products.
  • stroom-expression - An expression library used in Stroom's dashboards and query API.
  • stroom-headless - An example of how to run Stroom in headless mode from the command line.
  • stroom-proxy - An application that acts as a data receipt proxy for Stroom (Legacy v5 only).
  • stroom-query - A library for querying Stroom's data sources.
  • stroom-resources - Configuration for orchestrating stroom in docker containers and released docker stacks.
  • stroom-stats - An application for storing and querying aggregates of event data.
  • stroom-visualisations-dev - A set of visualisations for use in Stroom.
  • event-logging-schema - An XML Schema for describing auditable events.
  • event-logging - A JAXB API for the event-logging XML Schema.

Build Status

Stroom

Stroom Authentication

Stroom Resources

Note that the project description data, including the texts, logos, images, and/or trademarks, for each open source project belongs to its rightful owner. If you wish to add or remove any projects, please contact us at [email protected].