[javascript] PoseNet - Eye tracking

I needed a code that tracks eyes.

I got it from my colleague what is called PoseNet.

 

Also, there were many examples and tutorials which helped me a lot.

 

 

1. API

To modify the script, you need to know which modules are included.

 

ml5js.org/reference/api-PoseNet/

ml5js·Friendly Machine Learning For The Web

In the script, ellipses are used to mask eyes, but I wanted rectangles to mask eyes.

 

I found code lines 'ellipse()' and changed to 'rect()' after some research.

 

You may find the lines below.

 

medium.com/@abhiramgp/control-anything-with-arduino-and-posenet-4b4dadf2237

Control anything with Arduino and Posenet

 

해당 자료를 보면 뭐가 엄청 많은데 원형, 선긋기, 숫자 입력 등 많은 예시가 있었다. 그 중 나의 눈에 들어온 것은 rect() 라고 써있던 딱 한 줄 이었다.

 

바로 입력해보니 성공..

 

구글링 실력이 진짜 실력이다.. (원하는 자료를 빨리 찾을 수 있어서 다행이다)

 

 

poseNet 튜토리얼: https://youtu.be/EA3-k9mnLHs

 

2. GitHub

아래 링크에 들어가면 poseNet 뿐만 아니라 자바스크립트로 구현된 다양한 모듈을 확인할 수 있다.

 

github.com/ml5js/ml5-library/tree/main/examples/p5js

ml5js/ml5-library

 

Other references

thenextweb.com/syndication/2020/02/01/machine-learning-for-everyone-how-to-implement-pose-estimation-in-a-browser-using-your-webcam/

Machine learning for everyone: How to implement pose estimation in a browser using your webcam

medium.com/better-programming/machine-learning-for-everyone-pose-estimation-in-a-browser-with-your-webcam-65bb2648c16a#ac60

Machine Learning for Everyone: Pose Estimation in a Browser With Your Webcam

github.com/tensorflow/tfjs/issues/1462

Running posenet on video input · Issue #1462 · tensorflow/tfjs

github.com/ml5js/ml5-library/tree/main/examples/javascript

ml5js/ml5-library

www.twilio.com/blog/pose-detection-video-tensorflow-js

Pose Detection in Twilio Video with JavaScript and TensorFlow

github.com/tensorflow/tfjs-models/blob/master/posenet/demos/coco.js

tensorflow/tfjs-models