US Patent:
20230078171, Mar 16, 2023
Inventors:
- Santa Clara CA, US
Niranjan Avadhanam - Saratoga CA, US
Nishant Puri - San Francisco CA, US
Shagan Sah - Santa Clara CA, US
Rajath Shetty - Santa Clara CA, US
Pavlo Molchanov - Mountain View CA, US
International Classification:
G06K 9/62
G06N 20/00
G06V 10/94
G06V 20/59
G06V 20/64
G06V 40/16
G06V 40/18
Abstract:
Systems and methods for more accurate and robust determination of subject characteristics from an image of the subject. One or more machine learning models receive as input an image of a subject, and output both facial landmarks and associated confidence values. Confidence values represent the degrees to which portions of the subject's face corresponding to those landmarks are occluded, i.e., the amount of uncertainty in the position of each landmark location. These landmark points and their associated confidence values, and/or associated information, may then be input to another set of one or more machine learning models which may output any facial analysis quantity or quantities, such as the subject's gaze direction, head pose, drowsiness state, cognitive load, or distraction state.