David P Harnett

US Patent:

20130095920, Apr 18, 2013

Filed:

Oct 13, 2011

Appl. No.:

13/273213

Inventors:

Kestutis Patiejunas - Sammamish WA, US
Kanchan Mitra - Woodinville WA, US
Patrick Sweeney - Woodinville WA, US
Yaron Eshet - Seattle WA, US
Adam G. Kirk - Renton WA, US
Sing Bing Kang - Redmond WA, US
David Eraker - Seattle WA, US
David Harnett - Seattle WA, US
Amit Mital - Bellevue WA, US
Simon Winder - Seattle WA, US

Assignee:

Microsoft Corporation - Redmond WA

International Classification:

A63F 13/00
H04N 13/02

US Classification:

463 31, 348 48, 348E13074

Abstract:

Methods and systems for generating free viewpoint video using an active infrared (IR) stereo module are provided. The method includes computing a depth map for a scene using an active IR stereo module. The depth map may be computed by projecting an IR dot pattern onto the scene, capturing stereo images from each of two or more synchronized IR cameras, detecting dots within the stereo images, computing feature descriptors corresponding to the dots in the stereo images, computing a disparity map between the stereo images, and generating the depth map using the disparity map. The method also includes generating a point cloud for the scene using the depth map, generating a mesh of the point cloud, and generating a projective texture map for the scene from the mesh of the point cloud. The method further includes generating the video for the scene using the projective texture map.

US Patent:

20130321396, Dec 5, 2013

Filed:

Aug 30, 2012

Appl. No.:

13/599170

Inventors:

Adam Kirk - Renton WA, US
Kanchan Mitra - Woodinville WA, US
Patrick Sweeney - Woodinville WA, US
Don Gillett - Bellevue WA, US
Neil Fishman - Redmond WA, US
Simon Winder - Seattle WA, US
Yaron Eshet - Seattle WA, US
David Harnett - Seattle WA, US
Amit Mital - Bellevue WA, US
David Eraker - Seattle WA, US

Assignee:

MICROSOFT CORPORATION - Redmond WA

International Classification:

G06T 15/00

US Classification:

345419

Abstract:

Free viewpoint video of a scene is generated and presented to a user. An arrangement of sensors generates streams of sensor data each of which represents the scene from a different geometric perspective. The sensor data streams are calibrated. A scene proxy is generated from the calibrated sensor data streams. The scene proxy geometrically describes the scene as a function of time and includes one or more types of geometric proxy data which is matched to a first set of current pipeline conditions in order to maximize the photo-realism of the free viewpoint video resulting from the scene proxy at each point in time. A current synthetic viewpoint of the scene is generated from the scene proxy. This viewpoint generation maximizes the photo-realism of the current synthetic viewpoint based upon a second set of current pipeline conditions. The current synthetic viewpoint is displayed.

US Patent:

20130321586, Dec 5, 2013

Filed:

Aug 17, 2012

Appl. No.:

13/588917

Inventors:

Adam Kirk - Renton WA, US
Patrick Sweeney - Woodinville WA, US
Don Gillett - Bellevue WA, US
Neil Fishman - Redmond WA, US
Kanchan Mitra - Woodinville WA, US
Amit Mital - Bellevue WA, US
David Harnett - Seattle WA, US
Yaron Eshet - Seattle WA, US
Simon Winder - Seattle WA, US
David Eraker - Seattle WA, US

Assignee:

MICROSOFT CORPORATION - Redmond WA

International Classification:

H04N 13/02

US Classification:

348 47, 348E13074

Abstract:

Cloud based FVV streaming technique embodiments presented herein generally employ a cloud based FVV pipeline to create, render and transmit FVV frames depicting a captured scene as would be viewed from a current synthetic viewpoint selected by an end user and received from a client computing device. The FVV frames use a similar level of bandwidth as a conventional streaming movie would consume. To change viewpoints, a new viewpoint is sent from the client to the cloud, and a new streaming movie is initiated from the new viewpoint. Frames associated with that viewpoint are created, rendered and transmitted to the client until a new viewpoint request is received.

US Patent:

20200250254, Aug 6, 2020

Filed:

Feb 4, 2020

Appl. No.:

16/781859

Inventors:

- San Francisco CA, US
Killian Koenig - Seattle WA, US
Darren Remington - Mesa AZ, US
Benjamin Buzbee - Woodinville WA, US
Michael Conrad - Monroe WA, US
David Harnett - Seattle WA, US

International Classification:

G06F 16/957
G06F 16/958

Abstract:

A server receives from a client device that is executing a web browser application a request to initiate a remote application in the server. The server instantiates an instance of the remote application. The server intercepts draw commands associated with the remote application instance. The server provides the draw commands to the client to cause the web browser application to render portion(s) of output based on the draw commands. The server receives an input event from the web browser application. The server provides the client one or more draw commands based on the input event to cause the web browser application to render portion(s) of output based on those draw commands.

US Patent:

20200250372, Aug 6, 2020

Filed:

Feb 4, 2020

Appl. No.:

16/781861

Inventors:

- San Francisco CA, US
Trevor Sundberg - Kirkland WA, US
Killian Koenig - Seattle WA, US
Benjamin Buzbee - Woodinville WA, US
Michael Conrad - Monroe WA, US
David Harnett - Seattle WA, US

International Classification:

G06F 40/14
G06F 9/451
H04L 29/06

Abstract:

A server receives from a client device that is executing a client application a request to initiate a remote application in the server. The server instantiates an instance of the remote application. The server intercepts draw commands associated with the remote application instance. The server provides the draw commands to the client to cause the client application to render portion(s) of output based on the draw commands. The server receives an input event from the client application. The server provides the client one or more draw commands based on the input event to cause the client application to render portion(s) of output based on those draw commands.

US Patent:

20200252413, Aug 6, 2020

Filed:

Feb 4, 2020

Appl. No.:

16/781854

Inventors:

- San Francisco CA, US
Killian Koenig - Seattle WA, US
Trevor Sundberg - Kirkland WA, US
Michael Conrad - Monroe WA, US
Darren Remington - Mesa AZ, US
David Harnett - Seattle WA, US

International Classification:

H04L 29/06
G06F 21/53
G06F 11/36

Abstract:

A client device instantiates an isolator application. A request to instantiate a remote application in a server device is sent by the isolator application instance. The isolator application instance receives, from the remote application instance, draw commands and position information that correspond to the draw commands. The isolator application instance renders one or more portions of output based on the draw commands and the position information.

US Patent:

20140307952, Oct 16, 2014

Filed:

Jun 9, 2013

Appl. No.:

13/913454

Inventors:

- Redmond WA, US
David F. Harnett - Seattle WA, US

International Classification:

G06T 7/00
G01B 11/22

US Classification:

382154

Abstract:

The subject disclosure is directed towards mixing RGB data with infrared data so as to provide depth-related data in regions where infrared data are sparse. Infrared data, such as corresponding to point cloud data, are processed to determine sparse regions therein. For any such sparse regions, RGB data corresponding to a counterpart region in the RGB data are added to a data structure. The data structure, which may include or be concatenated to the IR data, may be used for depth-related data, e.g., with a point cloud.