All Projects → nodamu → Sign Language Recogntion

nodamu / Sign Language Recogntion

Licence: apache-2.0
Cross platform sign language translation with mediapipe

Projects that are alternatives of or similar to Sign Language Recogntion

nbtransom
Machines and people collaborating together through Jupyter notebooks.
Stars: ✭ 17 (-29.17%)
Mutual labels:  pipelines
Gitlab Monitor
A web-based monitor dashboard for GitLab CI
Stars: ✭ 343 (+1329.17%)
Mutual labels:  pipelines
Go Streams
A lightweight stream processing library for Go
Stars: ✭ 615 (+2462.5%)
Mutual labels:  pipelines
modules
Repository to host tool-specific module files for the Nextflow DSL2 community!
Stars: ✭ 94 (+291.67%)
Mutual labels:  pipelines
Opus
A framework for pluggable business logic components
Stars: ✭ 300 (+1150%)
Mutual labels:  pipelines
Zerocopy
Zero-copy I/O primitives and pipelines for Go. Linux-specific.
Stars: ✭ 386 (+1508.33%)
Mutual labels:  pipelines
devops-101-workshop
Serves as documentation, starter code, and companion guide for a DevOps 101 workshop using the JFrog platform.
Stars: ✭ 36 (+50%)
Mutual labels:  pipelines
Orchest
A new kind of IDE for Data Science.
Stars: ✭ 694 (+2791.67%)
Mutual labels:  pipelines
Drone Cli
Command Line Tools for Drone CI
Stars: ✭ 302 (+1158.33%)
Mutual labels:  pipelines
Glci
🦊 Test your Gitlab CI Pipelines changes locally using Docker.
Stars: ✭ 471 (+1862.5%)
Mutual labels:  pipelines
Polyaxon
Machine Learning Platform for Kubernetes (MLOps tools for experimentation and automation)
Stars: ✭ 2,966 (+12258.33%)
Mutual labels:  pipelines
Smooks
An extensible Java framework for building XML and non-XML streaming applications
Stars: ✭ 293 (+1120.83%)
Mutual labels:  pipelines
Azure Devops Cli Extension
Azure DevOps Extension for Azure CLI
Stars: ✭ 420 (+1650%)
Mutual labels:  pipelines
MLBlocks
A library for composing end-to-end tunable machine learning pipelines.
Stars: ✭ 94 (+291.67%)
Mutual labels:  pipelines
Rain
Framework for large distributed pipelines
Stars: ✭ 645 (+2587.5%)
Mutual labels:  pipelines
pipeline-editor
Cloud Pipelines Editor is a web app that allows the users to build and run Machine Learning pipelines without having to set up development environment.
Stars: ✭ 22 (-8.33%)
Mutual labels:  pipelines
Pipelines
An experimental programming language for data flow
Stars: ✭ 354 (+1375%)
Mutual labels:  pipelines
Argo Events
Event-driven workflow automation framework
Stars: ✭ 821 (+3320.83%)
Mutual labels:  pipelines
Concourse
Concourse is a container-based continuous thing-doer written in Go.
Stars: ✭ 6,070 (+25191.67%)
Mutual labels:  pipelines
Onepanel
The open and extensible integrated development environment (IDE) for computer vision with built-in modules for model building, automated labeling, data processing, model training, hyperparameter tuning and workflow orchestration.
Stars: ✭ 428 (+1683.33%)
Mutual labels:  pipelines

Build Status

Hand gesture recognition with Mediapipe

MediaPipe is a framework for building multimodal (eg. video, audio, any time series data), cross platform (i.e Android, iOS, web, edge devices) applied ML pipelines. With MediaPipe, a perception pipeline can be built as a graph of modular components, including, for instance, inference models (e.g., TensorFlow, TFLite) and media processing functions.

Installation

  1. To install mediapipe follow these instructions for linux environments(That's what I use, haven't tested on other OS's).
  2. To run the desktop demo via webcam on CPU run
# This compiles and builds the demo
# It should print:
#Target //mediapipe/examples/desktop/hand_tracking:hand_tracking_cpu up-to-date:
# bazel-bin/mediapipe/examples/desktop/hand_tracking/hand_tracking_cpu
#INFO: Build completed successfully, 12517 total actions
$ bazel build -c opt --define MEDIAPIPE_DISABLE_GPU=1 \
    mediapipe/examples/desktop/hand_tracking:hand_tracking_cpu


# This will open up your webcam as long as it is connected and on
# Any errors is likely due to your webcam being not accessible
$ GLOG_logtostderr=1 bazel-bin/mediapipe/examples/desktop/hand_tracking/hand_tracking_cpu \
    --calculator_graph_config_file=mediapipe/graphs/hand_tracking/hand_tracking_desktop_live.pbtxt
  1. To run on GPU on desktop run
# Video from webcam running on desktop GPU
# This works only for linux currently
$ bazel build -c opt --copt -DMESA_EGL_NO_X11_HEADERS \
    mediapipe/examples/desktop/hand_tracking:hand_tracking_gpu

# It should print:
# Target //mediapipe/examples/desktop/hand_tracking:hand_tracking_gpu up-to-date:
#  bazel-bin/mediapipe/examples/desktop/hand_tracking/hand_tracking_gpu
#INFO: Build completed successfully, 22455 total actions

# This will open up your webcam as long as it is connected and on
# Any errors is likely due to your webcam being not accessible,
# or GPU drivers not setup properly.
$ GLOG_logtostderr=1 bazel-bin/mediapipe/examples/desktop/hand_tracking/hand_tracking_gpu \
    --calculator_graph_config_file=mediapipe/graphs/hand_tracking/hand_tracking_mobile.pbtxt

Custom hand gesture recognition calculator built with mediapipe

  • Gesture Calulator
  • GestureRecognizer calulator
  • It currently uses finger state to detect signs i.e bent, straight relative to thumb
  • Currently working on using weighted matching
  • To view graph in visualizer, upload hand_landmark_cpu.pbtxt to MediaPipe Visualizer.

Android

  • Android build can be found here

Roadmap

  • Implement a robust similarity matching function(Working on a weighted matching function)
  • Hook up Travis CI for remote builds and Continuous integration
  • Sign/Gesture preseting and storage
  • Port to mobile platforms(Android and iOS)
Note that the project description data, including the texts, logos, images, and/or trademarks, for each open source project belongs to its rightful owner. If you wish to add or remove any projects, please contact us at [email protected].