107 Open source projects that are alternatives of or similar to auto-data-tokenize

Reference implementation for real-time Data Lineage tracking for BigQuery using Audit Logs, ZetaSQL and Dataflow.

Speech Analysis Framework, a collection of components and code from Google Cloud that you can use to transcribe audio files to create analytics.

[LREC 2022] An off-the-shelf pre-trained Tweet NLP Toolkit (NER, tokenization, lemmatization, POS tagging, dependency parsing) + Tweebank-NER dataset

Multilingual tokenizer that automatically tags each token with its type

Arabic Tokenization Library. It provides many tokenization algorithms.

A Python framework for data processing on GCP.

Deploy Google Cloud log export to Splunk using Terraform

LunaSec - Dependency Security Scanner that automatically notifies you about vulnerabilities like Log4Shell or node-ipc in your Pull Requests and Builds. Protect yourself in 30 seconds with the LunaTrace GitHub App: https://github.com/marketplace/lunatrace-by-lunasec/

A boilerplate solution for processing image and PDF documents for regulated industries, with lineage and pipeline operations metadata services.

Creative apps to use, build, share, and hack in the browser.

Go Taint CHeck Analyser

A visual representation and reference to Azure services

Convenient Dataflow pipelines for transforming data between cloud data sources

GitHub Data Loss Prevention (DLP) Action: Scan Pull Requests for sensitive data, like credentials & secrets, PII, credit card numbers, and more.

Get identifiers, paths, URLs and words from the previous command output and use them for the next command in xonsh shell.

Simple multilingual lemmatizer for Python, especially useful for speed and efficiency

Monitoring GitHub for sensitive data shared publicly

This is a java version of Chinese tokenization descried in BERT.

The Libre Multilingual Analyzer, a Natural Language Processing (NLP) C++ toolkit.

Generate and Visualize Data Lineage from query history

A visual systems language for beginners compiled using LLVM

Open-source code analysis platform for C/C++/Java/Binary/Javascript/Python/Kotlin based on code property graphs

Live dataflow programming for microcontrollers and embedded

The ultimate open source betting protocol. PolyCash is a P2P blockchain platform for wallets, asset issuance, bonds & gaming.

A Static Analysis Tool for Detecting Security Vulnerabilities in Python Web Applications

Deduce: de-identification method for Dutch medical text

JavaScript dataflow graph editor

Python package to manage Google Cloud Data Catalog tags, loading metadata from external sources -- currently supports the CSV file format

Data-Stash是基于FISCO-BCOS的数据仓库组件，通过解析节点的binlog日志，生成该节点状态的全量备份，从而使节点能够实现冷热数据分离和数据裁剪。

NLP Cheat Sheet, Python, spacy, LexNPL, NLTK, tokenization, stemming, sentence detection, named entity recognition

A general framework for optimizing DNN dataflow on systolic array

Factom Asset Tokens - Open tokenization standards on Factom

Yer another array library

Simulink toolbox to rapidly prototype robot controllers

Communications blocks and support libraries

Cross-platform .NET library for computations whose arguments and results are objects that implement INotifyPropertyChanged and INotifyCollectionChanged (ObservableCollection) interfaces.

SQL Lineage Analysis Tool powered by Python

Embedded Multicore Building Blocks (EMB²): Library for parallel programming of embedded systems. Star us on GitHub? +1

Tools for building reactive user interfaces in ClojureScript.

Flowgraph package for scalable asynchronous system development

Language Modeling and Text Classification in Malayalam Language using ULMFiT

ACT hardware description language and core tools.

Dnai Editor - Visual Scripting (Node Editor)

A browser for Hacker News's Ask HN: Who's Hiring, with Matrix Inside(tm)

The Pothos data-flow framework

an open source dataworks platform

🐍 Dataflow programming for python.

🦜 Containerized HTTP API for industrial-strength NLP via spaCy and sense2vec

Vue2 dataflow graph editor

Build a real-time website analytics dashboard on GCP using Dataflow, Cloud Memorystore (Redis) and Spring Boot

A Scala API for Apache Beam and Google Cloud Dataflow.

Data-Export支持将链上数据导出到MySQL、ES等便于进行大数据处理的存储介质中，解决区块链数据复杂查询、分析、可视化和处理的问题。

A convenient Python wrapper for Apache NiFi

Custom Russian tokenizer for spaCy

Natural Language Processing Toolkit in Golang

Functional dataflow through composable computations

The Refreshingly Simple Cross-Platform C++ Dataflow / Pipelining / Stream Processing / Reactive Programming Framework

Pothos demonstration applications

DTask is a scheduler for statically dependent tasks.

Data-Reconcile是一款基于区块链的对账组件，提供基于区块链智能合约账本的通用化数据对账解决方案，并提供了一套可动态扩展的对账框架，支持定制化开发。