Philip Moss Robinson

US Patent:

20220327316, Oct 13, 2022

Filed:

Apr 12, 2021

Appl. No.:

17/228112

Inventors:

- Menlo Park CA, US
Senthil Purushwalkam Shiva Prakash - Pittsburgh PA, US
Sebastia Vicenc Amengual Gari - Redmond WA, US
Carl Schissler - Redmond WA, US
Philip Robinson - Seattle WA, US
Abhinav Gupta - Pittsburgh PA, US

International Classification:

G06K 9/00
G06T 11/20
G06K 9/62
G10L 25/57
G06N 3/08

Abstract:

The present disclosure relates to systems, non-transitory computer-readable media, and methods for utilizing multiple modalities to generate accurate two-dimensional floorplans based on sparse digital videos depicting three-dimensional space. In particular, in one or more embodiments, the disclosed systems extract both visual and audio information from sparse digital video coverage of portions of a three-dimensional space and utilize the extracted visual and audio information to generate a two-dimensional floorplan representing both viewed and unviewed portions of the three-dimensional space. For example, the disclosed systems utilize self-attention layers of a specialized machine learning model to maintain and leverage bi-directional relationships among sequences of visual and audio features to generate floorplan predictions associated with the three-dimensional space. The disclosed systems then combine the predictions to generate the two-dimensional floorplan including a geometric layout and one or more semantic room labels.

US Patent:

20220322028, Oct 6, 2022

Filed:

Apr 1, 2021

Appl. No.:

17/220588

Inventors:

- Menlo Park CA, US
Pablo Francisco Faundez Hoffmann - Kenmore WA, US
Philip Robinson - Seattle WA, US

International Classification:

H04S 7/00

Abstract:

An audio system includes a plurality of transducers, one or more acoustic sensors, and a controller. The plurality of transducers transmits an ultrasonic beam towards an ear of a user. The one or more acoustic sensors detect a reflected signal generated by an interaction of the ultrasonic beam with the ear. The controller updates a three-dimensional geometry of the ear based on the reflected signal. The controller determines a head-related transfer function (HRTF) for the user based in part on the three-dimensional geometry of the ear.

US Patent:

20210327453, Oct 21, 2021

Filed:

Jun 28, 2021

Appl. No.:

17/360021

Inventors:

- Menlo Park CA, US
Philip Robinson - Seattle WA, US

International Classification:

G10L 21/0316
G10L 21/0272
H04R 5/04
G02B 27/00
H04R 3/00
G10L 25/87
G06F 3/16

Abstract:

A system includes a headset to capture sound and a visual signal of a local area including one or more sound sources. The system determines a strength of the audio signal and a portion of the visual signal associated with the audio signal, compares the strengths, selects the weaker signal, and augments the weaker signal. The headset accordingly presents augmented audio-visual content to a user, thereby enhancing the user's perception of the weak signal.

US Patent:

20210249031, Aug 12, 2021

Filed:

Apr 20, 2020

Appl. No.:

16/853449

Inventors:

- Menlo Park CA, US
Philip Robinson - Seattle WA, US

International Classification:

G10L 21/0316
G10L 21/0272
G06F 3/16
G10L 25/87
G02B 27/00
H04R 3/00
H04R 5/04

Abstract:

A system includes a headset to capture sound and a visual signal of a local area including one or more sound sources. The system determines a strength of the audio signal and a portion of the visual signal associated with the audio signal, compares the strengths, selects the weaker signal, and augments the weaker signal. The headset accordingly presents augmented audio-visual content to a user, thereby enhancing the user's perception of the weak signal.

US Patent:

20210211819, Jul 8, 2021

Filed:

Jan 6, 2020

Appl. No.:

16/735325

Inventors:

- Menlo Park CA, US
Jacob Ryan Donley - Kirkland WA, US
Philip Robinson - Seattle WA, US

International Classification:

H04R 29/00
G06T 19/00
H04R 1/32
H04R 3/12

Abstract:

An audio-video correspondence system performs a correspondence analysis between audio and video content. The system obtains video content that includes audio content, the video content comprising a plurality of frames. The system identifies a first set of pixels within the video content associated with changes in pixel values over a first set of frames of the video content. The system subsequently identifies, from the audio content, first audio associated with the first set of frames corresponding to changes in pixel values of the first set of pixels. The system finally assigns the first audio over the first set of frames to the first set of pixels.

US Patent:

20210112364, Apr 15, 2021

Filed:

Dec 21, 2020

Appl. No.:

17/129654

Inventors:

- Menlo Park CA, US
Henrik Gert Hassager - Redmond WA, US
Philip Robinson - Seattle WA, US

International Classification:

H04S 7/00
H04R 5/033
H04R 5/04
H04S 3/00

Abstract:

A system for generating individualized HRTFs that are customized to a user of a headset. The system includes a server and an audio system. The server determines the individualized HRTFs based in part on acoustic features data (e.g., image data, anthropometric features, etc.) of the user and a template HRTF. The server provides the individualized HRTFs to the audio system. The audio system presents spatialized audio content to the user using the individualized HRTFs.

US Patent:

20210089260, Mar 25, 2021

Filed:

Sep 24, 2019

Appl. No.:

16/580544

Inventors:

- Menlo Park CA, US
Philip Robinson - Seattle WA, US
Peter Gottlieb - Seattle WA, US

International Classification:

G06F 3/16
G10L 21/02
H04R 29/00
H04R 1/10

Abstract:

An audio system presented herein includes a transducer array, sensor array, and a controller. The controller control tactile content imparted to a user via actuation of at least one transducer in the transducer array while presenting audio content to the user. The transducer array presents the audio content with the tactile content to the user. The audio system can be part of a headset.

US Patent:

20200404445, Dec 24, 2020

Filed:

Mar 31, 2020

Appl. No.:

16/836430

Inventors:

- Menlo Park CA, US
Carl Schissler - Redmond WA, US
Peter Henry Maresh - Seattle WA, US
Andrew Lovitt - Redmond WA, US
Philip Robinson - Seattle WA, US

International Classification:

H04S 7/00
H04S 3/00
H04R 5/04
H04R 3/04
G10L 21/0232
H04R 5/033

Abstract:

An audio system on a headset presents, to a user, audio content simulating a target artificial reality environment. The system receives audio content from an environment and analyzes the audio content to determine a set of acoustic properties associated with the environment. The audio content may be user generated or ambient sound. After receiving a set of target acoustic properties for a target environment, the system determines a transfer function by comparing the set of acoustic properties and the target environment's acoustic properties. The system adjusts the audio content based on the transfer function and presents the adjusted audio content to the user. The presented adjusted audio content includes one or more of the target acoustic properties for the target environment.