This project aim is to provide free software to fetch data from plcs (Siemens S7-300/400/1200/1500) and store it. Used stack is completly opensource. I used InfluDB as data storage, so application principle is following Big Data paradigm.

Stars: ✭ 26 (-99.79%)

Mutual labels: big-data

scarf

Toolkit for highly memory efficient analysis of single-cell RNA-Seq, scATAC-Seq and CITE-Seq data. Analyze atlas scale datasets with millions of cells on laptop.

Stars: ✭ 54 (-99.57%)

Mutual labels: big-data

arrow-datafusion

Apache Arrow DataFusion SQL Query Engine

Stars: ✭ 2,360 (-81.14%)

Mutual labels: big-data

MLBD

Materials for "Machine Learning on Big Data" course

Stars: ✭ 20 (-99.84%)

Mutual labels: big-data

spark-root

Apache Spark Data Source for ROOT File Format

Stars: ✭ 28 (-99.78%)

Mutual labels: big-data

SGDLibrary

MATLAB/Octave library for stochastic optimization algorithms: Version 1.0.20

Stars: ✭ 165 (-98.68%)

Mutual labels: big-data

nebula

A distributed, fast open-source graph database featuring horizontal scalability and high availability

Stars: ✭ 8,196 (-34.48%)

Mutual labels: big-data

Real Time Social Media Mining

DevOps pipeline for Real Time Social/Web Mining

Stars: ✭ 22 (-99.82%)

Mutual labels: big-data

cloudberry

Big Data Visualization

Stars: ✭ 89 (-99.29%)

Mutual labels: big-data

airavata-django-portal

Mirror of Apache Airavata Django Portal

Stars: ✭ 20 (-99.84%)

Mutual labels: big-data

datalake-etl-pipeline

Simplified ETL process in Hadoop using Apache Spark. Has complete ETL pipeline for datalake. SparkSession extensions, DataFrame validation, Column extensions, SQL functions, and DataFrame transformations

Stars: ✭ 39 (-99.69%)

Mutual labels: big-data

subsemble

subsemble R package for ensemble learning on subsets of data

Stars: ✭ 40 (-99.68%)

Mutual labels: big-data

Big-Data-Demo

基于Vue、three.js、echarts，数据可视化展示项目，包含三维模型导入交互、三维模型标注等功能

Stars: ✭ 146 (-98.83%)

Mutual labels: big-data

nebula

A distributed block-based data storage and compute engine

Stars: ✭ 127 (-98.98%)

Mutual labels: big-data

automile-php

Automile offers a simple, smart, cutting-edge telematics solution for businesses to track and manage their business vehicles.

Stars: ✭ 28 (-99.78%)

Mutual labels: big-data

lubeck

High level linear algebra library for Dlang

Stars: ✭ 57 (-99.54%)

Mutual labels: big-data

spark-records

Bulletproof Apache Spark jobs with fast root cause analysis of failures.

Stars: ✭ 67 (-99.46%)

Mutual labels: big-data

bigquery-kafka-connect

☁️ nodejs kafka connect connector for Google BigQuery

Stars: ✭ 17 (-99.86%)

Mutual labels: big-data

RemoteShuffleService

Celeborn provides an elastic and high-performance service for shuffle and spilled data.

Stars: ✭ 262 (-97.91%)

Mutual labels: big-data

OnlineStatsBase.jl

Base types for OnlineStats.

Stars: ✭ 26 (-99.79%)

Mutual labels: big-data

terraform-aws-kinesis-firehose

This code creates a Kinesis Firehose in AWS to send CloudWatch log data to S3.

Stars: ✭ 25 (-99.8%)

Mutual labels: big-data

LoL-Match-Prediction

Win probability predictions for League of Legends matches using neural networks

Stars: ✭ 34 (-99.73%)

Mutual labels: big-data

dxram

A distributed in-memory key-value storage for billions of small objects.

Stars: ✭ 25 (-99.8%)

Mutual labels: big-data

classifai

🔥 One of the most comprehensive open-source data annotation platform.

Stars: ✭ 99 (-99.21%)

Mutual labels: big-data

img2dataset

Easily turn large sets of image urls to an image dataset. Can download, resize and package 100M urls in 20h on one machine.

Stars: ✭ 1,173 (-90.62%)

Mutual labels: big-data

insightedge

InsightEdge Core

Stars: ✭ 22 (-99.82%)

Mutual labels: big-data

GDLibrary

Matlab library for gradient descent algorithms: Version 1.0.1

Stars: ✭ 50 (-99.6%)

Mutual labels: big-data

ByteSlice

"Byteslice: Pushing the envelop of main memory data processing with a new storage layout" (SIGMOD'15)

Stars: ✭ 24 (-99.81%)

Mutual labels: big-data

lcbo-api

A crawler and API server for Liquor Control Board of Ontario retail data

Stars: ✭ 152 (-98.78%)

Mutual labels: big-data

incubator-liminal

Apache Liminals goal is to operationalise the machine learning process, allowing data scientists to quickly transition from a successful experiment to an automated pipeline of model training, validation, deployment and inference in production. Liminal provides a Domain Specific Language to build ML workflows on top of Apache Airflow.

Stars: ✭ 117 (-99.06%)

Mutual labels: big-data

gan deeplearning4j

Automatic feature engineering using Generative Adversarial Networks using Deeplearning4j and Apache Spark.

Stars: ✭ 19 (-99.85%)

Mutual labels: big-data

check-engine

Data validation library for PySpark 3.0.0

Stars: ✭ 29 (-99.77%)

Mutual labels: big-data

FlameStream

Distributed stream processing model and its implementation

Stars: ✭ 14 (-99.89%)

Mutual labels: big-data

beekeeper

Service for automatically managing and cleaning up unreferenced data

Stars: ✭ 43 (-99.66%)

Mutual labels: big-data

Movies-Analytics-in-Spark-and-Scala

Data cleaning, pre-processing, and Analytics on a million movies using Spark and Scala.

Stars: ✭ 47 (-99.62%)

Mutual labels: big-data

ngm

swissgeol.ch gives you insight in geoscientific data - above and below the surface.

Stars: ✭ 23 (-99.82%)

Mutual labels: big-data

sparkucx

A high-performance, scalable and efficient ShuffleManager plugin for Apache Spark, utilizing UCX communication layer

Stars: ✭ 32 (-99.74%)

Mutual labels: big-data

nifi

Deploy a secured, clustered, auto-scaling NiFi service in AWS.

Stars: ✭ 37 (-99.7%)

Mutual labels: big-data

automile-net

Automile offers a simple, smart, cutting-edge telematics solution for businesses to track and manage their business vehicles.

Stars: ✭ 24 (-99.81%)

Mutual labels: big-data

siembol

An open-source, real-time Security Information & Event Management tool based on big data technologies, providing a scalable, advanced security analytics framework.

Stars: ✭ 153 (-98.78%)

Mutual labels: big-data

big-data-upf

RECSM-UPF Summer School: Social Media and Big Data Research

Stars: ✭ 21 (-99.83%)

Mutual labels: big-data

storm-ml

an online learning algorithm library for Storm

Stars: ✭ 18 (-99.86%)

Mutual labels: big-data

talaria

TalariaDB is a distributed, highly available, and low latency time-series database for Presto

Stars: ✭ 148 (-98.82%)

Mutual labels: big-data

rastercube

rastercube is a python library for big data analysis of georeferenced time series data (e.g. MODIS NDVI)

Stars: ✭ 15 (-99.88%)

Mutual labels: big-data

iis

Information Inference Service of the OpenAIRE system

Stars: ✭ 16 (-99.87%)

Mutual labels: big-data

airavata-php-gateway

Mirror of Apache Airavata PHP Gateway

Stars: ✭ 15 (-99.88%)

Mutual labels: big-data

FIW KRT

Families In the WIld: A Kinship Recogntion Toolbox.

Stars: ✭ 18 (-99.86%)

Mutual labels: big-data

shifting

A privacy-focused list of alternatives to mainstream services to help the competition.

Stars: ✭ 31 (-99.75%)

Mutual labels: big-data

meetups-archivos

Ppts, códigos y videos de las meetups, data science days, videollamadas y workshops. Data Science Research es una organización sin fines de lucro que busca difundir, descentralizar y difundir los conocimientos en Ciencia de Datos e Inteligencia Artificial en el Perú, dando oportunidades a nuevos talentos mediante MeetUps, Workshops y Semilleros …

Stars: ✭ 60 (-99.52%)

Mutual labels: big-data

azure-big-data-starter

A boilerplate project for Azure Big Data PaaS services

Stars: ✭ 13 (-99.9%)

Mutual labels: big-data

1-60 of 369 similar projects

›

next*5