GitPlanet

Cheap and reliable Node.js hosting starts at $3/month, and $1/month static HTML hosting

Created with love in Canada, visit hostnodejs.com today

Feel like to post an Ad? Learn Details
All Projects → NeuralAction → Vision

NeuralAction / Vision

Licence: other
Computer Vision And Neural Network with Xamarin

Programming Languages

Jupyter Notebook
11667 projects
C#
18002 projects
HTML
75241 projects

Labels

opencvcomputer-visionneural-networktensorflowcalibrationvisioneye-trackingface-trackinggpu-supporteye-gazeonnx-models

Projects that are alternatives of or similar to Vision

NeuralAction
Neural Action is a real-time CNN-based gaze tracking application providing human-machine interface to improve accessibility.
Stars: ✭ 47 (-12.96%)
Mutual labels:  eye-tracking, eye-gaze
Facelandmarksdetection
Finds facial features such as face contour, eyes, mouth and nose in an image.
Stars: ✭ 130 (+140.74%)
Mutual labels:  vision, face-tracking
mlp-mixer-pytorch
An All-MLP solution for Vision, from Google AI
Stars: ✭ 771 (+1327.78%)
Mutual labels:  vision
Topics-In-Modern-Statistical-Learning
Materials for STAT 991: Topics In Modern Statistical Learning (UPenn, 2022 Spring) - uncertainty quantification, conformal prediction, calibration, etc
Stars: ✭ 74 (+37.04%)
Mutual labels:  calibration
mimic
mimic calibration
Stars: ✭ 18 (-66.67%)
Mutual labels:  calibration
FaceData
A macOS app to parse face landmarks from a video for GANs training
Stars: ✭ 71 (+31.48%)
Mutual labels:  vision
MouseView.js
Attentional mouse tracking. Alternative to online eye tracking. Eye tracking without the eyes!
Stars: ✭ 46 (-14.81%)
Mutual labels:  eye-tracking
edge-computer-vision
Edge Computer Vision Course
Stars: ✭ 41 (-24.07%)
Mutual labels:  vision
Robotlib.jl
Robotics library written in the Julia programming language
Stars: ✭ 32 (-40.74%)
Mutual labels:  calibration
verified calibration
Calibration library and code for the paper: Verified Uncertainty Calibration. Ananya Kumar, Percy Liang, Tengyu Ma. NeurIPS 2019 (Spotlight).
Stars: ✭ 93 (+72.22%)
Mutual labels:  calibration
StructureNet
Markerless volumetric alignment for depth sensors. Contains the code of the work "Deep Soft Procrustes for Markerless Volumetric Sensor Alignment" (IEEE VR 2020).
Stars: ✭ 38 (-29.63%)
Mutual labels:  calibration
ai-serving
Serving AI/ML models in the open standard formats PMML and ONNX with both HTTP (REST API) and gRPC endpoints
Stars: ✭ 122 (+125.93%)
Mutual labels:  onnx-models
FusionMouse
Combines Tobii eye tracking with TrackIR head tracking for a fast hands-free mouse replacement, in Rust!
Stars: ✭ 33 (-38.89%)
Mutual labels:  eye-tracking
pygac
A python package to read and calibrate NOAA and Metop AVHRR GAC and LAC data
Stars: ✭ 14 (-74.07%)
Mutual labels:  calibration
mediapipe plus
The purpose of this project is to apply mediapipe to more AI chips.
Stars: ✭ 38 (-29.63%)
Mutual labels:  vision
eye-tracker-setup
👀 Tobii Eye Tracker 4C Setup
Stars: ✭ 24 (-55.56%)
Mutual labels:  eye-tracking
bsec bme680 linux
Read the BME680 sensor with the BSEC library on Linux (e.g. Raspberry Pi)
Stars: ✭ 78 (+44.44%)
Mutual labels:  calibration
LFToolbox
Light Field Toolbox for MATLAB
Stars: ✭ 74 (+37.04%)
Mutual labels:  calibration
brfv4 android examples
Android Studio project (Java)
Stars: ✭ 43 (-20.37%)
Mutual labels:  face-tracking
FaceAvataaars
Puppeteer Avataaars with your iPhone X (and also test cartoons using BlendShapeRecorder data)
Stars: ✭ 19 (-64.81%)
Mutual labels:  face-tracking
View All Similar Projects ➔

Vision

A eye gaze tracking library based on computer vision and neural network for NeuralAction.

This repository is part of project NeuralAction.

Current gaze tracking model's mean error is 3.2 cm in 50 cm far without any calibration.

With calibration, mean error is ~1.8 cm.

Demo

  • Gaze tracking with calibrations

TODO

NeuralAction 0.2 (2019/10~)

  • Research
    • More accurate eye-gaze tracker
    • More accurate eye-blink classification
    • Being more robust to a person's appearance difference
    • Less calibration tries
  • Develop
    • Support ARM64 (WoA)
    • Support WinML / ONNX models
    • Optimize for low-powered devices (low battery, slow CPU or GPU)
    • Windows eye-tracking accessibility API integration

Eye-gaze Model

  • Channel merged input
  • Neural-net based calibrator
  • MobileNet-v3 training
  • Support IR camera from Windows Hello
  • Auto detect and load calibration data

ARM64(WoA) Support

  • OpenCvSharp native recompile
  • SharpFace native recompile

WinML Features

  • WinML backend
  • ONNX model runner
  • ONNX formatted gaze model
  • ONNX formatted eye blink model
  • GPU support
  • FP16 computation

Data-augmentation

  • Grayscale (for IR camera)
  • StyleAug
  • CycleGAN for race appearance transfer

Eye-blink Modle

  • Apply transfer-learning

Windows Eye-tracking Accessibility API

  • Intergration
  • Chrome UI accessibility expose

NeuralAction 0.1 (~2018/05)

  • Gaze tracking calibration codes
  • Put more various data into gaze tracking model.

Main Features

  • Single camera gaze tracking.
  • Gaze tracking service.
  • Abstractions around OpenCV
  • Abstractions around Tensorflow
  • Platform abstraction layer (Files, Audio, Video, etc...)

OpenCV Features

  • Face tracking (Tadas/OpenFace)
  • Cascade object detection
  • Some examples of openCV
  • Cross platform webcam I/O

Tensorflow Features

  • Data sharing between OpenCV
  • Input image normalization
  • GPU acceleration supports
  • Model imports
Note that the project description data, including the texts, logos, images, and/or trademarks, for each open source project belongs to its rightful owner. If you wish to add or remove any projects, please contact us at [email protected].