- Redmond WA, US Michael Edward SAMPLES - Redmond WA, US Alexandru Octavian BALAN - Sammamish WA, US William Douglas GUYMAN - Medina WA, US Vuk JOVANOVIC - Belgrade, RS Taras KHAPKO - Belgrade, RS Ivan RAZUMENIC - Belgrade, RS Vladimir CARAPIC - Belgrade, RS Martin Thomas SHETTER - Bellevue WA, US Jelena MOJASEVIC - Belgrade, RS Andrew C. GORIS - Loveland CO, US Marko BEZULJ - Belgrade, RS
One disclosed example provides a head-mounted device configured to control a plurality of light sources of a handheld object and acquire image data comprising a sequence of environmental tracking exposures in which the plurality of light sources are controlled to have a lower integrated intensity and handheld object tracking exposures in which the plurality of light sources are controlled to have a higher integrated intensity. The instructions are further executable to detect, via an environmental tracking exposure, one or more features of the surrounding environment, determine a pose of the head-mounted device based upon the one or more features of the surrounding environment detected, detect via a handheld object tracking exposure the plurality of light sources of the handheld object, determine a pose of the handheld object relative to the head-mounted device based upon the plurality of light sources detected, and output the pose of the handheld object.
- Redmond WA, US Michael Edward SAMPLES - Redmond WA, US Ivan RAZUMENIC - Belgrade, RS
Assignee:
Microsoft Technology Licensing, LLC - Redmond WA
International Classification:
G06K 9/62 G06T 7/70 G06F 3/01
Abstract:
One disclosed example provides a method for determining a pose of a handheld object in a surrounding environment. Optical pose data is stored in an image queue of a first filter. IMU data is received from an IMU of the handheld object and stored in an IMU queue of the first filter. Using at least a portion of the optical pose data and the IMU data, an initial pose of the handheld object is determined and outputted. The method determines that either the image queue or the IMU queue is empty. A second filter comprising the one empty queue and the other non-empty queue is instantiated as a copy of the first filter. Using the data from the non-empty queue in the second filter, the initial pose of the handheld object is updated to an updated pose, and the updated pose is outputted.
Driving An Image Capture System To Serve Plural Image-Consuming Processes
- Redmond WA, US Raymond Kirk PRICE - Redmond WA, US Denis Claude Pierre DEMANDOLX - Bellevue WA, US Michael SAMPLES - Redmond WA, US
International Classification:
G06T 19/00 G02B 27/01 G06F 3/01 G06T 19/20
Abstract:
A technique is described herein that employs a resource-efficient image capture system. The image capture system includes an active illumination system for emitting electromagnetic radiation within a physical environment. The image capture system also includes a camera system that includes one or more cameras for detecting electromagnetic radiation received from the physical environment, to produce image information. In one implementation, the technique involves using the same image capture system to produce different kinds of image information for consumption by different respective image processing components. The technique can perform this task by allocating timeslots over a span of time for producing the different kinds of image information. In one case, the image processing components include: a pose tracking component; a controller tracking component; and a surface reconstruction component, etc., any subset of which may be active at any given time.
- Redmond WA, US Michael Edward SAMPLES - Redmond WA, US Alexandru Octavian BALAN - Sammamish WA, US William Douglas GUYMAN - Medina WA, US Vuk JOVANOVIC - Belgrade, RS Taras KHAPKO - Belgrade, RS Ivan RAZUMENIC - Belgrade, RS Vladimir CARAPIC - Belgrade, RS Martin Thomas SHETTER - Bellevue WA, US Jelena MOJASEVIC - Belgrade, RS Andrew C. GORIS - Loveland CO, US Marko BEZULJ - Belgrade, RS
One disclosed example provides a head-mounted device configured to control a plurality of light sources of a handheld object and acquire image data comprising a sequence of environmental tracking exposures in which the plurality of light sources are controlled to have a lower integrated intensity and handheld object tracking exposures in which the plurality of light sources are controlled to have a higher integrated intensity. The instructions are further executable to detect, via an environmental tracking exposure, one or more features of the surrounding environment, determine a pose of the head-mounted device based upon the one or more features of the surrounding environment detected, detect via a handheld object tracking exposure the plurality of light sources of the handheld object, determine a pose of the handheld object relative to the head-mounted device based upon the plurality of light sources detected, and output the pose of the handheld object.
Tracking Wearable Device And Handheld Object Poses
- Redmond WA, US Michael Edward SAMPLES - Redmond WA, US Alexandru Octavian BALAN - Sammamish WA, US Salim SIRTKAYA - Redmond WA, US William Douglas GUYMAN - Medina WA, US Vuk JOVANOVIC - Belgrade, RS Filip PANJEVIC - Belgrade, RS
One disclosed example provides a computing device configured to receive from an image sensor of a head-mounted device environmental tracking exposures and handheld object tracking exposures, determine a pose of the handheld object with respect to the head-mounted device based upon the handheld object tracking exposures, determine a pose of the head-mounted device with respect to a surrounding environment based upon the environmental tracking exposures, derive a pose of the handheld object relative to the surrounding environment based upon the pose of the handheld object with respect to the head-mounted device and the pose of the head-mounted device with respect to the surrounding environment, and output the pose of the handheld object relative to the surrounding environment for controlling a user interface displayed on the head-mounted device.
- Redmond WA, US Quentin Simon Charles Miller - Sammamish WA, US Lev Cherkashin - Redmond WA, US Michael Samples - Redmond WA, US Drew Edward Steedly - Woodinville WA, US
International Classification:
G06F 3/01 G06F 3/00 G02B 27/01
Abstract:
An apparatus for dynamically determining a displacement of a target sensor in an electronic system is disclosed. The apparatus can comprise a non-line-of-sight sensor rigidly mounted on or proximate to the target sensor and configured to measure a parameter that varies with the displacement of the target sensor. The apparatus further can comprise at least one processor coupled to the non-line-of-sight sensor and configured to compute the displacement of the target sensor based on the parameter, and to compute an adjustment value based on the computed displacement.
Display Active Alignment System For Waveguide Displays
Steven John Robbins - Redmond WA, US Drew Edward Steedly - Woodinville WA, US Michael Edward Samples - Redmond WA, US Zhiqiang Liu - Redmond WA, US Andrew K. Juenger - Woodinville WA, US
A display system includes a display alignment tracker configured track the position of a first signal and the position of a second signal. The display alignment tracker optically multiplexes a portion of a first signal and a portion of the second signal into a combined optical signal and measures a differential between the first signal and the second signal.
Display Active Alignment Systems Utilizing Test Patterns For Calibrating Signals In Waveguide Displays
Steven John Robbins - Redmond WA, US Drew Edward Steedly - Woodinville WA, US Michael Edward Samples - Redmond WA, US Zhiqiang Liu - Redmond WA, US Andrew K. Juenger - Woodinville WA, US
A display system includes a display alignment tracker configured track the position of a first signal in a first waveguide and the position of a second signal in a second waveguide. The display alignment tracker optically multiplexes a portion of a first signal and a portion of the second signal into a combined optical signal and measures a differential between the first signal and the second signal. The differential is used to adjust the position, dimensions, or a color attribute of the first signal relative to the second signal.
Toyota Technical Center - Ann Arbor, MI since May 2005
AI & Robotics Senior Engineer
Altarum May 2003 - Aug 2004
AI Research Intern
University of Michigan May 2002 - Sep 2002
Undergraduate Research
Education:
University of Michigan 2001 - 2006
B.S., Computer Science & Mathematics
Skills:
C++ Machine Learning Computer Vision Artificial Intelligence Algorithms Data Mining Python Robotics Simulations Computer Science Camera Calibration Slam Probabilistic Models R&D Navigation Optimization Numerical Methods Sensors Autonomous Vehicles Mountain Biking Path Planning R Distributed Systems Mapping Augmented Reality Virtual Reality
Interests:
Kayaking Investing Rock Climbing Snowboarding Soccer Running Coding