Marc K Robins

US Patent:

20190080498, Mar 14, 2019

Filed:

Oct 31, 2018

Appl. No.:

16/177408

Inventors:

- Cupertino CA, US
Kevin O'Neil - San Francisco CA, US
Zehang Sun - Saratoga CA, US
Xiaohuan Corina Wang - Los Altos CA, US
Joe Weil - Greenbrae CA, US
Omid Khalili - Santa Clara CA, US
Stuart Mark Pomerantz - Stevenson Ranch CA, US
Marc Robins - Minneapolis MN, US
Eric Beale - Los Angeles CA, US
Nathalie Castel - Sunnyvale CA, US
Jean-Michel Berthoud - San Jose CA, US
Brian Walsh - Sunnyvale CA, US
Andy Harding - Portola Valley CA, US
Greg Dudey - Los Gatos CA, US

Assignee:

Apple Inc. - Cupertino CA

International Classification:

G06T 11/60
G06T 5/00
G06T 3/40
G06T 7/194

Abstract:

Systems, methods, apparatuses and non-transitory, computer-readable storage mediums are disclosed for generating AR self-portraits or “AR selfies.” In an embodiment, a method comprises: capturing, by a first camera of a mobile device, image data, the image data including an image of a subject in a physical, real-world environment; receiving, by a depth sensor of the mobile device, depth data indicating a distance of the subject from the camera in the physical, real-world environment; receiving, by one or more motion sensors of the mobile device, motion data indicating at least an orientation of the first camera in the physical, real-world environment; generating a virtual camera transform based on the motion data, the camera transform for determining an orientation of a virtual camera in a virtual environment; and generating a composite image data, using the image data, a matte and virtual background content selected based on the virtual camera orientation.

US Patent:

20190082118, Mar 14, 2019

Filed:

Sep 6, 2018

Appl. No.:

16/124168

Inventors:

- Cupertino CA, US
Zehang Sun - Saratoga CA, US
Joe Weil - Greenbrae CA, US
Omid Khalili - Santa Clara CA, US
Stuart Mark Pomerantz - Stevenson Ranch CA, US
Marc Robins - Minneapolis MN, US
Toshihiro Horie - San Jose CA, US
Eric Beale - Los Angeles CA, US
Nathalie Castel - Sunnyvale CA, US
Jean-Michel Berthoud - San Jose CA, US
Brian Walsh - Sunnyvale CA, US
Kevin O'Neil - San Francisco CA, US
Andy Harding - Portola Valley CA, US
Greg Dudey - Los Gatos CA, US

Assignee:

Apple Inc. - Cupertino CA

International Classification:

H04N 5/265
G06T 13/80
G06T 7/50
G06T 17/20
H04N 5/247
H04N 5/272
H04N 5/445
G06T 7/194
G06T 7/13

Abstract:

Systems, methods, apparatuses and non-transitory, computer-readable storage mediums are disclosed for generating AR self-portraits or “AR selfies.” In an embodiment, a method comprises: capturing, by a first camera of a mobile device, live image data, the live image data including an image of a subject in a physical, real-world environment; receiving, by a depth sensor of the mobile device, depth data indicating a distance of the subject from the camera in the physical, real-world environment; receiving, by one or more motion sensors of the mobile device, motion data indicating at least an orientation of the first camera in the physical, real-world environment; generating a virtual camera transform based on the motion data, the camera transform for determining an orientation of a virtual camera in a virtual environment; and generating a composite image data, using the image data, a matte and virtual background content selected based on the virtual camera orientation.