1118 Open source projects that are alternatives of or similar to Smart_open

Real Time Analytics and Data Pipelines based on Spark Streaming

Kafka Connect FileSystem Connector

StorageTapper is a scalable realtime MySQL change data streaming, logical backup and logical replication service

Source code for the Kafka Streams in Action Book

Window-Based Hybrid CPU/GPU Stream Processing Engine

The Universal Storage Engine

Ruby server for tus resumable upload protocol

SeaweedFS is a fast distributed storage system for blobs, objects, files, and data lake, for billions of files! Blob store has O(1) disk seek, cloud tiering. Filer supports Cloud Drive, cross-DC active-active replication, Kubernetes, POSIX FUSE mount, S3 API, S3 Gateway, Hadoop, WebDAV, encryption, Erasure Coding.

Implements a lightweight, high-performance, non-allocating advanced-record-based wrapper around the SysUtils file handling routines as an alternative to Classes.TFileStream.

Data Accelerator for Apache Spark simplifies onboarding to Streaming of Big Data. It offers a rich, easy to use experience to help with creation, editing and management of Spark jobs on Azure HDInsights or Databricks while enabling the full power of the Spark engine.

Web tool for Kafka Connect |

JuiceFS is a distributed POSIX file system built on top of Redis and S3.

A self-hosted file backup server which bridges WebDAV protocol with @minio written in @totoval. Webdav ❤️ Minio

Pravega is 100% open source and community-driven. All components are available under Apache 2 License on GitHub.

A library that allows you to easily mock out tests based on AWS infrastructure.

A library on top of either pex or conda-pack to make your Python code easily available on a cluster

Python interface to the TileDB storage manager

Intelligently render media files in the browser

⛈️ Rumble 1.11.0 "Banyan Tree"🌳 for Apache Spark | Run queries on your large-scale, messy JSON-like data (JSON, text, CSV, Parquet, ROOT, AVRO, SVM...) | No install required (just a jar to download) | Declarative Machine Learning and more

Kafka Connect HDFS connector

kafka-connect-s3 : Ingest data from Kafka to Object Stores(s3)

🌊 Online machine learning in Python

How to implement a streaming at scale solution in Azure

Compare eventual consistency of object stores

StreamLine - Streaming Analytics

Stream your applications with Parsec and AWS on the cheap.

Anomaly detection for streaming time series, featuring automated model selection.

Plain text file based note taking and knowledge base building tool, markdown editor, simple browser IDE.

Race Control is a standalone, open source F1TV client for Windows, written in C# on the .NET 5 platform.

Terraform module to easily provision CloudFront CDN backed by an S3 origin

File Loader

Big Data Ecosystem Docker

Build highly concurrent, distributed, and resilient message-driven applications on the JVM

FileSystem is an application that allows you to browse the content of your iPhone disk, displaying file and folders, files contents, and detailed informations about file and folder permissions.

Fundamentals of Spark with Python (using PySpark), code examples

[Tutorial] Asynchronous Flutter chat client with Go chat server which are powered by gRPC (simple and streaming)

Cloud ready pure-python streaming data pipeline library

C++ Library for ISO/IEC 14496-12 - ISO Base Media File Format (QuickTime, MPEG-4, HEIF, etc)

Cloud-native distributed data streaming platform, written in Rust

Streaming Histograms for Clojure/Java

DC/OS SDK is a collection of tools, libraries, and documentation for easy integration of technologies such as Kafka, Cassandra, HDFS, Spark, and TensorFlow with DC/OS.

DownZemAll! is a download manager for Windows, MacOS and Linux

Free and open-source music streaming Android client for Subsonic API compatible servers

Pin, Discover and Share Resources

浏览器RTMP推流SDK (A javascript rtmp streamer library)

c++ LINQ -like library of higher-order functions for data manipulation

Golang Cache component - Multiple drivers

BitTorrent library and client with DHT, magnet links, encryption and more

FestIn - S3 Bucket Weakness Discovery

An easy-to-use, high-performance Interledger implementation written in Rust

🔥 Python file and zip operations made easy

OTT/ABR streaming encoder (H264/HEVC) and packager for DASH and HLS

Push and pull git repos to/from an s3 bucket, encrypted using gpg.

r/freemediaheckyeah

Aerial Apple TV screen saver for Windows

A tiny library to send file descriptors across processes

Redpanda is the real-time engine for modern apps. Kafka API Compatible; 10x faster 🚀 See more at vectorized.io/redpanda

Python API for TIDAL music streaming service

SRS is a simple, high efficiency and realtime video server, supports RTMP, WebRTC, HLS, HTTP-FLV, SRT and GB28181.

A community AWS SDK for Perl Programmers