John Mccarty

US Patent:

20200302159, Sep 24, 2020

Filed:

Jun 11, 2020

Appl. No.:

16/898721

Inventors:

- Norwood MA, US
Kaushal SANGHAI - Brighton MA, US
John Robert McCARTY - Arlington MA, US
Brian C. DONNELLY - Sudbury MA, US
Nicolas Le DORTZ - Cambridge MA, US
Johannes TRAA - Boston MA, US

Assignee:

Analog Devices, Inc. - Norwood MA

International Classification:

G06K 9/00
G06T 7/70
H04S 7/00

Abstract:

Far field devices typically rely on audio only for enabling user interaction and involve only audio processing. Adding a vision-based modality can greatly improve the user interface of far field devices to make them more natural to the user. For instance, users can look at the device to interact with it rather than having to repeatedly utter a wakeword. Vision can also be used to assist audio processing, such as to improve the beamformer. For instance, vision can be used for direction of arrival estimation. Combining vision and audio can greatly enhance the user interface and performance of far field devices.