Adam Jay Jones

US Patent:

20220301195, Sep 22, 2022

Filed:

May 4, 2022

Appl. No.:

17/736485

Inventors:

- Seattle WA, US
James Andrew Youngquist - Seattle WA, US
Adam Gabriel Jones - Seattle WA, US
Thomas Ivan Nonn - Kenmore WA, US
Jay Peterson - Seattle WA, US

International Classification:

G06T 7/292
H04N 5/247
G06T 7/70
H04N 5/232
H04N 5/265
H04N 5/262
G06T 11/00
G06T 7/80
A61B 90/00
A61B 34/20
A61B 90/50
H04N 5/225

Abstract:

Camera arrays for mediated-reality systems and associated methods and systems are disclosed herein. In some embodiments, a camera array includes a support structure having a center, and a depth sensor mounted to the support structure proximate to the center. The camera array can further include a plurality of cameras mounted to the support structure radially outward from the depth sensor, and a plurality of trackers mounted to the support structure radially outward from the cameras. The cameras are configured to capture image data of a scene, and the trackers are configured to capture positional data of a tool within the scene. The image data and the positional data can be processed to generate a virtual perspective of the scene including a graphical representation of the tool at the determined position.

US Patent:

20220265385, Aug 25, 2022

Filed:

May 13, 2022

Appl. No.:

17/744110

Inventors:

- Seattle WA, US
James Andrew Youngquist - Seattle WA, US
Adam Gabriel Jones - Seattle WA, US

International Classification:

A61B 90/00
G06T 7/73
G06T 7/33
G06T 19/20

Abstract:

A mediated-reality system for surgical applications incorporates pre-operative images and real-time captured images of a surgical site into a visualization presented on a head-mounted display worn by a surgeon during a surgical procedure. The mediated-reality system tracks the surgeon's head position and generates real-time images of the surgical site from a virtual camera perspective corresponding to the surgeon's head position to mimic the natural viewpoint of the surgeon. The mediated-reality system furthermore aligns the pre-operative images with the real-time images from the virtual camera perspective and presents a mediated-reality visualization of the surgical site with the aligned pre-operative three-dimensional images or a selected portion thereof overlaid on the real-time images representing the virtual camera perspective.

US Patent:

20230015060, Jan 19, 2023

Filed:

Jul 13, 2022

Appl. No.:

17/864065

Inventors:

- Seattle WA, US
David Lee Fiorella - Seattle WA, US
Camille Cheli Farley - Kirkland WA, US
David Franzi - Seattle WA, US
Nicholas Matthew Miclette - Seattle WA, US
Adam Gabriel Jones - Seattle WA, US

International Classification:

A61B 34/20
A61B 34/00
A61B 90/00

Abstract:

Mediated-reality imaging systems, methods, and devices are disclosed herein. In some embodiments, an imaging system includes a camera array configured to (i) capture intraoperative image data of a surgical scene in substantially real-time and (ii) track a tool through the scene. The imaging system is further configured to receive and/or store preoperative image data, such as medical scan data corresponding to a portion of a patient in the scene. The imaging device can register the preoperative image data to the intraoperative image data, and display the preoperative image data and a representation of the tool on a user interface, such as a head-mounted display.

US Patent:

20210392275, Dec 16, 2021

Filed:

Aug 30, 2021

Appl. No.:

17/461588

Inventors:

- Seattle WA, US
David Julio Colmenares - Seattle WA, US
Adam Gabriel Jones - Seattle WA, US

International Classification:

H04N 5/247
H04N 5/225
G06T 7/521
G06T 7/557
G02B 3/00
G06T 7/50
H04N 13/243
G06T 19/00

Abstract:

A camera array for a mediated-reality system includes a plurality of hexagonal cells arranged in a honeycomb pattern in which a pair of inner cells include respective edges adjacent to each other and a pair of outer cells are separated from each other by the inner cells. A plurality of cameras are mounted within each of the plurality of hexagonal cells. The plurality of cameras include at least one camera of a first type and at least one camera of a second type. The camera of the first type may have a longer focal length than the camera of the second type.

US Patent:

20210358139, Nov 18, 2021

Filed:

Feb 11, 2021

Appl. No.:

17/173614

Inventors:

- Seattle WA, US
James Andrew Youngquist - Seattle WA, US
Adam Gabriel Jones - Seattle WA, US
Thomas Ivan Nonn - Kenmore WA, US
Jay Peterson - Seattle WA, US

International Classification:

G06T 7/292
H04N 5/247
G06T 7/80
A61B 90/00
G06T 7/70
H04N 5/262
G06T 11/00
H04N 5/232
A61B 34/20
H04N 5/225
A61B 90/50
H04N 5/265

Abstract:

Camera arrays for mediated-reality systems and associated methods and systems are disclosed herein. In some embodiments, a camera array includes a support structure having a center, and a depth sensor mounted to the support structure proximate to the center. The camera array can further include a plurality of cameras mounted to the support structure radially outward from the depth sensor, and a plurality of trackers mounted to the support structure radially outward from the cameras. The cameras are configured to capture image data of a scene, and the trackers are configured to capture positional data of a tool within the scene. The image data and the positional data can be processed to generate a virtual perspective of the scene including a graphical representation of the tool at the determined position.

US Patent:

20200375689, Dec 3, 2020

Filed:

Aug 17, 2020

Appl. No.:

16/995756

Inventors:

- Seattle WA, US
James Andrew Youngquist - Seattle WA, US
Adam Gabriel Jones - Seattle WA, US

International Classification:

A61B 90/00
G06T 7/73
G06T 7/33
G06T 19/20

Abstract:

A mediated-reality system for surgical applications incorporates pre-operative images and real-time captured images of a surgical site into a visualization presented on a head-mounted display worn by a surgeon during a surgical procedure. The mediated-reality system tracks the surgeon's head position and generates real-time images of the surgical site from a virtual camera perspective corresponding to the surgeon's head position to mimic the natural viewpoint of the surgeon. The mediated-reality system furthermore aligns the pre-operative images with the real-time images from the virtual camera perspective and presents a mediated-reality visualization of the surgical site with the aligned pre-operative three-dimensional images or a selected portion thereof overlaid on the real-time images representing the virtual camera perspective.

US Patent:

20200229893, Jul 23, 2020

Filed:

Jan 22, 2020

Appl. No.:

16/749963

Inventors:

- Seattle WA, US
James Andrew Youngquist - Seattle WA, US
Adam Gabriel Jones - Seattle WA, US

International Classification:

A61B 90/00
G06T 7/73
G06T 7/33
G06T 19/20

Abstract:

A mediated-reality system for surgical applications incorporates pre-operative images and real-time captured images of a surgical site into a visualization presented on a head-mounted display worn by a surgeon during a surgical procedure. The mediated-reality system tracks the surgeon's head position and generates real-time images of the surgical site from a virtual camera perspective corresponding to the surgeon's head position to mimic the natural viewpoint of the surgeon. The mediated-reality system furthermore aligns the pre-operative images with the real-time images from the virtual camera perspective and presents a mediated-reality visualization of the surgical site with the aligned pre-operative three-dimensional images or a selected portion thereof overlaid on the real-time images representing the virtual camera perspective.

US Patent:

20200226819, Jul 16, 2020

Filed:

Mar 27, 2020

Appl. No.:

16/833481

Inventors:

- Seattle WA, US
David Julio Colmenares - Seattle WA, US
Adam Gabriel Jones - Seattle WA, US

International Classification:

G06T 15/20
G06T 7/55
G06T 15/40
G06T 7/70
G06T 15/06
G06T 7/20

Abstract:

A method assigns weights to physical imager pixels in order to generate photorealistic images for virtual perspectives in real-time. The imagers are arranged in three-dimensional space such that they sparsely sample the light field within a scene of interest. This scene is defined by the overlapping fields of view of all the imagers or for subsets of imagers. The weights assigned to imager pixels are calculated based on the relative poses of the virtual perspective and physical imagers, properties of the scene geometry, and error associated with the measurement of geometry. This method is particularly useful for accurately rendering numerous synthesized perspectives within a digitized scene in real-time in order to create immersive, three-dimensional experiences for applications such as performing surgery, infrastructure inspection, or remote collaboration.