Search

Rajath Shetty Phones & Addresses

  • Sunnyvale, CA
  • San Jose, CA
  • Mountain View, CA

Publications

Us Patents

Adaptive Eye Tracking Machine Learning Model Engine

View page
US Patent:
20220366568, Nov 17, 2022
Filed:
May 13, 2021
Appl. No.:
17/319891
Inventors:
- Santa Clara CA, US
Niranjan Avadhanam - Saratoga CA, US
Hairong Jiang - Campbell CA, US
Nishant Puri - San Francisco CA, US
Rajath Shetty - Los Altos CA, US
Shagan Sah - Santa Clara CA, US
International Classification:
G06T 7/20
G06K 9/00
G06K 9/62
G06N 3/08
Abstract:
In various examples, an adaptive eye tracking machine learning model engine (“adaptive-model engine”) for an eye tracking system is described. The adaptive-model engine may include an eye tracking or gaze tracking development pipeline (“adaptive-model training pipeline”) that supports collecting data, training, optimizing, and deploying an adaptive eye tracking model that is a customized eye tracking model based on a set of features of an identified deployment environment. The adaptive-model engine supports ensembling the adaptive eye tracking model that may be trained on gaze vector estimation in surround environments and ensemble based on a plurality of eye tracking variant models and a plurality of facial landmark neural network metrics.

Joint Estimation Of Heart Rate And Respiratory Rate Using Neural Networks

View page
US Patent:
20230091371, Mar 23, 2023
Filed:
Sep 20, 2021
Appl. No.:
17/479648
Inventors:
- Santa Clara CA, US
Niranjan Avadhanam - Saratoga CA, US
Rajath Bellipady Shetty - Sunnyvale CA, US
International Classification:
G06T 7/10
G16H 30/40
A61B 5/024
A61B 5/087
Abstract:
A neural network system leverages dual attention, specifically both spatial attention and channel attention, to jointly estimate heart rate and respiratory rate of a subject by processing images of the subject. A motion neural network receives images of the subject and estimates heart and breath rates of the subject using both spatial and channel domain attention masks to focus processing on particular feature data. An appearance neural network computes a spatial attention mask from the images of the subject and may indicate that features associated with the subject's face (as opposed to the subject's hair or shoulders) to accurately estimate the heart and/or breath rate. Channel-wise domain attention is learned during training and recalibrates channel-wise feature responses to select the most informative features for processing. The channel attention mask is learned during training and can be used for different subjects during deployment.

Neural Network Based Facial Analysis Using Facial Landmarks And Associated Confidence Values

View page
US Patent:
20230078171, Mar 16, 2023
Filed:
Oct 31, 2022
Appl. No.:
18/051296
Inventors:
- Santa Clara CA, US
Niranjan Avadhanam - Saratoga CA, US
Nishant Puri - San Francisco CA, US
Shagan Sah - Santa Clara CA, US
Rajath Shetty - Santa Clara CA, US
Pavlo Molchanov - Mountain View CA, US
International Classification:
G06K 9/62
G06N 20/00
G06V 10/94
G06V 20/59
G06V 20/64
G06V 40/16
G06V 40/18
Abstract:
Systems and methods for more accurate and robust determination of subject characteristics from an image of the subject. One or more machine learning models receive as input an image of a subject, and output both facial landmarks and associated confidence values. Confidence values represent the degrees to which portions of the subject's face corresponding to those landmarks are occluded, i.e., the amount of uncertainty in the position of each landmark location. These landmark points and their associated confidence values, and/or associated information, may then be input to another set of one or more machine learning models which may output any facial analysis quantity or quantities, such as the subject's gaze direction, head pose, drowsiness state, cognitive load, or distraction state.
Rajath Shetty from Sunnyvale, CA Get Report