Dong Ku Yu

7856351, Dec 21, 2010

Jan 19, 2007

11/655703

Sibel Yaman - Atlanta GA, US
Li Deng - Sammamish WA, US
Dong Yu - Kirkland WA, US
Alejandro Acero - Bellevue WA, US

Microsoft Corporation - Redmond WA

G06F 17/27

704 9, 704257, 7042562, 704 4, 704251, 704260

A novel system integrates speech recognition and semantic classification, so that acoustic scores in a speech recognizer that accepts spoken utterances may be taken into account when training both language models and semantic classification models. For example, a joint association score may be defined that is indicative of a correspondence of a semantic class and a word sequence for an acoustic signal. The joint association score may incorporate parameters such as weighting parameters for signal-to-class modeling of the acoustic signal, language model parameters and scores, and acoustic model parameters and scores. The parameters may be revised to raise the joint association score of a target word sequence with a target semantic class relative to the joint association score of a competitor word sequence with the target semantic class. The parameters may be designed so that the semantic classification errors in the training data are minimized.