Timothy T K Au

20230036170, Feb 2, 2023

Aug 30, 2022

17/899202

- Mountain View CA, US
Timothy Chun-Wai Au - San Mateo CA, US

G06Q 30/02

Techniques for preparing datasets for geo experiments and improving accuracy of geo experiments are presented herein. The system can access a dataset of a plurality of geographic pairs. Additionally, the system can calculate a first outcome estimate based on a difference in response data and a difference in input data for a first geographic pair. Moreover, the system can calculate a plurality of experimental uncertainty estimates associated with the plurality of geographic pairs during an experimental time interval. The system can access historical data associated with the plurality of geographic pairs. Furthermore, the system can determine a beta value and a trim rate that reduces a sum of the plurality estimates. Subsequently, the system can remove, based on the first outcome estimate and the beta value, the first geographic pair from the plurality of geographic pairs to generate the first subset of geographic pairs.

20210312221, Oct 7, 2021

Mar 30, 2020

16/834843

- Mountain View CA, US
Timothy C. Au - San Mateo CA, US
Nicolas Remy - Mountain View CA, US
Kevin Benac - Mountain View CA, US

Google LLC - Mountain View CA

G06K 9/62
G06N 20/00
G06F 16/29

Systems, methods and computer-readable storage media utilized to prepare datasets for geo experiments. One method includes receiving one or more input parameters. The method further includes extracting, from the data, training data. The method further includes calculating a difference in input data and a difference in response data of the training data. The method further includes determining a first plurality of geographic pairs. The method further includes extracting, from the data, evaluation data. The method further includes separating each geographic pair of the first plurality of geographic pairs into a treatment region or a control region for a plurality of simulations of a plurality of different simulation subsets for each of a plurality of different subsets of geographic pairs. The method further includes calculating a plurality of uncertainty estimates. The method further includes selecting a first subset of geographic pairs and providing the selected subset of geographic pairs.

20210312497, Oct 7, 2021

Mar 30, 2020

16/834915

- Mountain View CA, US
Timothy C. Au - San Mateo CA, US

Google LLC - Mountain View CA

G06Q 30/02
G06F 16/29
G06F 16/28

Systems, methods and computer-readable storage media utilized to prepare experimental datasets for experimental analysis systems. One method includes identifying, by one or more processing circuits, a dataset of a plurality of geographic pairs associated with a geo experiment. The method further includes calculating, by the one or more processing circuits, a difference in input data and a difference in response data between the first geographic region and the second geographic region of each geographic pair. The method further includes calculating, by the one or more processing circuits, a plurality of outcome estimates. The method further includes selecting, by the one or more processing circuits, a first subset of geographic pairs of the plurality of different subsets of geographic pairs based a first outcome estimate of the plurality of outcome estimates that is about a prespecified value on the outcome estimates and providing the selected subset of geographic pairs.

20210027324, Jan 28, 2021

Jul 11, 2018

16/499906

- Mountain View CA, US
Timothy Chun-Wai Au - Milpitas CA, US

G06Q 30/02

Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for creating an initial treatment group that includes geographic regions; creating a matching control group for the initial treatment group; creating an updated treatment group that includes the geographic regions from the initial treatment group and an additional geographic region that provides a specified level of increase to a model quality metric; iteratively creating each of i) an updated matching control group based on the updated treatment group and ii) an additional updated treatment group based on the updated matching control group until a stop condition occurs; receiving input specifying a treatment group size; and in response to receiving the input, conducting the experiment using i) the updated treatment group that includes a number of geographic regions that matches the treatment group size and ii) the updated matching control group created for that updated treatment group.