Ge Wang

8222507, Jul 17, 2012

Nov 4, 2009

12/612500

Spencer Salazar - San Francisco CA, US
Ge Wang - Palo Alto CA, US
Perry Cook - Applegate OR, US

Smule, Inc. - Palo Alto CA

G10H 7/00

84602

Techniques have been developed for capturing and rendering musical performances on handheld or other portable devices using signal processing techniques suitable given the somewhat limited capabilities of such devices and in ways that facilitate efficient encoding and communication of such captured performances via wireless networks. The developed techniques facilitate the capture, encoding and use of gesture streams for rendering of a musical performance. In some embodiments, a gesture stream encoding facilitates audible rendering of the musical performance locally on the portable device on which the musical performance is captured, typically in real time. In some embodiments, a gesture stream efficiently codes the musical performance for transmission from the portable device on which the musical performance is captured to (or toward) a remote device on which the musical performance is (or can be) rendered. Indeed, is some embodiments, a gesture stream so captured and encoded may be rendered both locally and on remote devices using substantially identical or equivalent instances of a digital synthesis of the musical instrument executing on the local and remote devices.

20110144981, Jun 16, 2011

Sep 4, 2010

12/876131

Spencer Salazar - Palo Alto CA, US
Rebecca A. Fiebrink - Timmins, CA
Ge Wang - Palo Alto CA, US
Mattias Ljungström - Berlin, DE
Jeffrey C. Smith - Atherton CA, US
Perry R. Cook - Applegate OR, US

G10L 11/04

704207, 704E11006

Techniques have been developed to facilitate (1) the capture and pitch correction of vocal performances on handheld or other portable computing devices and (2) the mixing of such pitch-corrected vocal performances with backing tracks for audible rendering on targets that include such portable computing devices and as well as desktops, workstations, gaming stations, even telephony targets. Implementations of the described techniques employ signal processing techniques and allocations of system functionality that are suitable given the generally limited capabilities of such handheld or portable computing devices and that facilitate efficient encoding and communication of the pitch-corrected vocal performances (or precursors or derivatives thereof) via wireless and/or wired bandwidth-limited networks for rendering on portable computing devices or other targets.

20110144982, Jun 16, 2011

Sep 4, 2010

12/876132

Spencer Salazar - Palo Alto CA, US
Rebecca A. Fiebrink - Timmins, CA
Ge Wang - Palo Alto CA, US
Mattias Ljungström - Berlin, DE
Jeffrey C. Smith - Atherton CA, US
Perry R. Cook - Applegate OR, US

G10L 11/04

704207, 704E11006

Vocal musical performances may be captured and continuously pitch-corrected at a mobile device for mixing and rendering with backing tracks in ways that create compelling user experiences. In some cases, the vocal performances of individual users are captured in the context of a karaoke-style presentation of lyrics in correspondence with audible renderings of a backing track. Such performances can be pitch-corrected in real-time at the mobile device in accord with pitch correction settings. In some cases, such pitch correction settings code a particular key or scale for the vocal performance or for portions thereof. In some cases, pitch correction settings include a score-coded melody sequence of note targets supplied with, or for association with, the lyrics and/or backing track. In some cases, pitch correction settings are dynamically variable based on gestures captured at a user interface.

20110144983, Jun 16, 2011

Sep 4, 2010

12/876133

Spencer Salazar - Palo Alto CA, US
Rebecca A. Fiebrink - Timmins, CA
Ge Wang - Palo Alto CA, US
Mattias Ljungström - Berlin, DE
Jeffrey C. Smith - Atherton CA, US
Jeannie Yang - San Jose CA, US

G10L 11/04

704207

Techniques have been developed to facilitate the capture performances on handheld or other portable computing devices and, in some cases, the pitch-correction and mixing of such vocal performances with backing tracks for audible rendering on such devices. Captivating visual animations and/or facilities for listener comment and ranking are provided in association with an audible rendering of a performance, e.g., a vocal performance captured and pitch-corrected at another similarly configured mobile device and mixed with backing instrumentals and/or vocals. Geocoding of captured vocal performances and/or listener feedback may facilitate animations or display artifacts in ways that are suggestive of a performance or endorsement emanating from a particular geographic locale on a user manipulable globe. In this way, implementations of the described functionality can transform otherwise mundane mobile devices into social instruments that foster a unique sense of global connectivity and community.

20120174736, Jul 12, 2012

Nov 9, 2011

13/292773

Ge Wang - Palo Alto CA, US
Jeannie Yang - San Jose CA, US
Jieun Oh - Stanford CA, US
Tom Lieber - Somerville MA, US

SMULE, INC. - Palo Alto CA

G10H 7/00

84622

Synthetic multi-string musical instruments have been developed for capturing and rendering musical performances on handheld or other portable devices in which a multi-touch sensitive display provides one of the input vectors for an expressive performance by a user or musician. Visual cues may be provided on the multi-touch sensitive display to guide the user in a performance based on a musical score. Alternatively, or in addition, uncued freestyle modes of operation may be provided. In either case, it is not the musical score that drives digital synthesis and audible rendering of the synthetic multi-string musical instrument. Rather, it is the stream of user gestures captured at least in part using the multi-touch sensitive display that drives the digital synthesis and audible rendering.

20130180385, Jul 18, 2013

Dec 14, 2012

13/715920

Nick Kruge - San Francisco CA, US
Ge Wang - Palo Alto CA, US

Smule, Inc. - Palo Alto CA

G10H 1/00

84603, 84609

A synthetic multi-string musical instrument captures a stream of expressive gestures indicated on a multi-touch sensitive display for note/chord soundings and associated performance effects and embellishments. Visual cues in accord with a musical score may be revealed/advanced at a current performance tempo, but it is the user's gestures that actually drive the audible performance rendering via digital synthesis. Opportunities for user expression (or variance from score) include onset and duration of note soundings, tempo changes, as well as uncued string bend effects, vibrato, etc. Gesturing mechanism are provide to allow user musicians to sound chords without having to register precisely accurate multi-touch screen contacts. This can be especially helpful for mobile phone, media player and game controller embodiments, where there is generally limited real-estate to display six (6) or more strings, and user fingers are generally too fat to precisely contact such strings.

20210125595, Apr 29, 2021

Jun 11, 2020

16/898891

- San Francisco CA, US
Rebecca A. Fiebrink - Timmins, CA
Ge Wang - Palo Alto CA, US
Mattias Ljungstrom - Berlin, DE
Jeffrey C. Smith - Atherton CA, US
Perry R. Cook - Jacksonville OR, US

G10H 1/36
G10L 21/013
G06F 3/16
G10L 21/0356

Techniques have been developed to facilitate (1) the capture and pitch correction of vocal performances on handheld or other portable computing devices and (2) the mixing of such pitch-corrected vocal performances with backing tracks for audible rendering on targets that include such portable computing devices and as well as desktops, workstations, gaming stations, even telephony targets. Implementations of the described techniques employ signal processing techniques and allocations of system functionality that are suitable given the generally limited capabilities of such handheld or portable computing devices and that facilitate efficient encoding and communication of the pitch-corrected vocal performances (or precursors or derivatives thereof) via wireless and/or wired bandwidth-limited networks for rendering on portable computing devices or other targets.

20180182366, Jun 28, 2018

Sep 1, 2017

15/693946

- San Francisco CA, US
Rebecca A. Fiebrink - Timmins, CA
Ge Wang - Palo Alto CA, US
Mattias Ljungstrom - Berlin, DE
Jeffrey C. Smith - Atherton CA, US
Perry R. Cook - Jacksonville OR, US

G10H 1/36
G06F 3/16
G10L 21/0356
G10L 21/013

Techniques have been developed to facilitate (1) the capture and pitch correction of vocal performances on handheld or other portable computing devices and (2) the mixing of such pitch-corrected vocal performances with backing tracks for audible rendering on targets that include such portable computing devices and as well as desktops, workstations, gaming stations, even telephony targets. Implementations of the described techniques employ signal processing techniques and allocations of system functionality that are suitable given the generally limited capabilities of such handheld or portable computing devices and that facilitate efficient encoding and communication of the pitch-corrected vocal performances (or precursors or derivatives thereof) via wireless and/or wired bandwidth-limited networks for rendering on portable computing devices or other targets.