Sven Emmanuel Koffi Kratz

20230060150, Mar 2, 2023

Aug 15, 2022

17/887891

- Santa Monica CA, US
Timothy Chong - Kirkland WA, US
Sven Kratz - Mercer Island WA, US
Fannie Liu - New York NY, US
Olivia Seow - Cambridge MA, US
Yu Jiang THAM - Seattle WA, US
Rajan Vaish - Beverly Hills CA, US
Lei Zhang - Ann Arbor MI, US

G06F 3/01
G06T 11/00
G06V 20/20
G06F 3/16

Augmented reality (AR) systems, devices, media, and methods are described for sending and receiving AR objects (e.g., customized AR objects) based on/responsive to interactions with the physical world. AR virtual delivery route overlays are generated responsive to selected virtual delivery routes and include the AR object and a delivery mode (air, tunnel, etc.) corresponding to the virtual delivery route. Physical world actions associated with the delivery mode (blowing adjacent an AR device or scratching a surface) result in sending a communication corresponding to the AR object for delivery to a receiver and generating AR sending overlays including the AR object moving in accordance with the delivery mode.

20230060838, Mar 2, 2023

Aug 17, 2022

17/890093

- Santa Monica CA, US
Sven Kratz - Mercer Island WA, US
Joanne Leong - Markham, CA
Xingyu Liu - Los Angeles CA, US
Brian Anthony Smith - New York NY, US
Yu Jiang Tham - Seattle WA, US
Rajan Vaish - Beverly Hills CA, US

H04L 51/10
G06V 20/60
G06V 40/16
G06V 10/40

Systems and methods are described for providing scan based imaging using an electronic eyewear device. The methods include scanning a scene using the electronic eyewear device to capture at least one image in an environment of a first user and identifying at least one physical marker in the scanned scene. Upon identification of the at least one physical marker in the scanned scene, a message (e.g., preselected AR content) is passively sent to at least one of directly to a second user or to at least one physical marker at a remote location for presentation to the second user. The message may be sent without use of the first user's hands to make a selection. The physical markers may be associated with a fixed object, a human face, a pet, a vehicle, a person, a logo, and the like.

20230062366, Mar 2, 2023

Aug 15, 2022

17/887817

- Santa Monica CA, US
Timothy Chong - Kirkland WA, US
Sven Kratz - Mercer Island WA, US
Fannie Liu - New York NY, US
Olivia Seow - Cambridge MA, US
Yu Jiang Tham - Seattle WA, US
Rajan Vaish - Beverly Hills CA, US
Lei Zhang - Ann Arbor MI, US

G06T 19/00
G06T 19/20
G06F 3/04815

Augmented reality (AR) systems, devices, media, and methods are described for creating a handcrafted AR experience. The handcrafted AR experiences are created by capturing images of a scene, identifying an object receiving surface and corresponding surface coordinates, identifying a customizable AR primary object associated with at least one set of primary object coordinates, generating AR overlays including the customizable AR primary object for positioning adjacent the object receiving surface, presenting the AR overlays, receiving customization commands, generating handcrafted AR overlays including customizations associated with the customizable AR primary object responsive to the customization commands, presenting the handcrafted AR overlays, recording the handcrafted AR overlays, creating a handcrafted AR file including the recorded overlays, and transmitting the handcrafted AR file.

20230062763, Mar 2, 2023

Aug 29, 2021

17/460243

Yu Jiang Tham - Seattle WA, US
Rajan Vaish - Beverly Hills CA, US
Sven Kratz - Mercer Island WA, US
Ana Maria Cardenas Gasca - Pasadena CA, US

G06T 11/60
G16Y 10/65
H04N 5/232

Systems and methods enable users to build augmented reality (AR) experiences with Internet of Things (IoT) devices. The system includes an AR object studio that includes a list of IoT devices and control signals for the respective IoT devices and a list of AR objects (e.g., an AR lens). The AR object studio receives selections from users and correlates at least one IoT device to at least one AR object in response to the user selections. During use, a server receives an indication that an AR object has been activated and interacted with on a display of an AR camera device and, in response, sends a control signal to a correlated IoT device. Conversely, the server may receive a signal from an IoT device and, in response, present and control a correlated AR object on the display of the AR camera device.

20230063194, Mar 2, 2023

Aug 29, 2021

17/460230

Yu Jiang Tham - Seattle WA, US
Rajan Vaish - Beverly Hills CA, US
Sven Kratz - Mercer Island WA, US
Ana Maria Cardenas Gasca - Pasadena CA, US

G06K 9/00
A63F 13/216
A63F 13/217
H04L 29/08
G16Y 40/30

Systems and methods for controlling an Internet of Things (IoT) device through interaction with an augmented reality (AR) object includes pairing an AR object with an IoT device, presenting the AR object on a display of an AR camera device of a user, receiving an interaction signal indicating that the user has interacted with the AR object on the display of the AR camera device, and sending a control signal to the IoT device paired with the AR object in response to the interaction signal. A second user may request presentation of the AR object to the AR display of the AR camera device of the user when the user's AR camera device is located at particular world coordinates. Also, the control signal may be sent when a particular series of interactions with the AR object have been completed, as during game play.

20230063944, Mar 2, 2023

Aug 29, 2021

17/460233

Yu Jiang Tham - Seattle WA, US
Rajan Vaish - Beverly Hills CA, US
Sven Kratz - Mercer Island WA, US
Ana Maria Cardenas Gasca - Pasadena CA, US

G06K 9/00
G16Y 40/35
G16Y 40/10
H04L 29/08

Systems and methods for controlling Internet of Things (IoT) devices using an augmented reality (AR) camera are provided. The system includes a sensor and a server that receives an input from the sensor and presents an AR object on the display of the AR camera device that corresponds to the input from the sensor. A response to the displayed AR object from a user of the AR camera device is used to select a command to send to one or more IoT devices to perform an action corresponding to the user response to the displayed AR object. In an example, an AR smoke object is overlayed on the AR camera display in response to a smoke detection signal from a smoke detector. In response to the user swiping or gesturing to push away the AR smoke object, a window opening command is sent to one or more IoT enabled windows.

20230066318, Mar 2, 2023

Aug 16, 2022

17/888601

- Santa Monica CA, US
Timothy Chong - Kirkland WA, US
Sven Kratz - Mercer Island WA, US
Fannie Liu - New York NY, US
Olivia Seow - Cambridge MA, US
Yu Jiang THAM - Seattle WA, US
Rajan Vaish - Beverly Hills CA, US
Lei Zhang - Ann Arbor MI, US

G06T 19/00
G06T 19/20

Augmented reality (AR) systems, devices, media, and methods are described for capturing and presenting effort put into generating a handcrafted AR experience. AR object generation data is captured during the generation of a handcrafted AR object. The AR object generation data is then processed to generate proof of effort data for inclusion with the handcrafted AR object. Examples of proof of effort include a time lapse view of the steps taken during generation of the AR object and statistics such as total time spent, number of images or songs considered for selection, number of actions implemented, etc.

20230066686, Mar 2, 2023

Aug 16, 2022

17/888948

- Santa Monica CA, US
Timothy Chong - Kirkland WA, US
Sven Kratz - Mercer Island WA, US
Fannie Liu - New York NY, US
Olivia Seow - Cambridge MA, US
Yu Jiang Tham - Seattle WA, US
Rajan Vaish - Beverly Hills CA, US
Lei Zhang - Ann Arbor MI, US

H04N 13/111
G06V 20/20
G06V 10/764
G06V 10/44
G06T 3/60

Augmented reality (AR) systems, devices, media, and methods are described for generating AR experiences including interactions with virtual or physical prop objects. The AR experiences are generated by capturing images of a scene with a camera system, identifying an object receiving surface and corresponding surface coordinates within the scene, identifying an AR primary object and a prop object (physical or virtual), establishing a logical connection between the AR primary object and the prop object, generating AR overlays including actions associated with the AR primary object responsive to commands received via a user input system that position the AR primary object adjacent the object receiving surface responsive to the primary object coordinates and the surface coordinates within the scene and that position the AR primary object and the prop object with respect to one another in accordance with the logical connection, and presenting the generated AR overlays with a display system.