Chuang Jun Gu

US Patent:

6400831, Jun 4, 2002

Filed:

Apr 2, 1998

Appl. No.:

09/054280

Inventors:

Ming-Chieh Lee - Bellevue WA
Chuang Gu - Redmond WA

Assignee:

Microsoft Corporation - Redmond WA

International Classification:

G06K 900

US Classification:

382103, 348169

Abstract:

A semantic video object extraction system using mathematical morphology and perspective motion modeling. A user indicates a rough outline around an image feature of interest for a first frame in a video sequence. Without further user assistance, the rough outline is processed by a morphological segmentation tool to snap the rough outline into a precise boundary surrounding the image feature. Motion modeling is performed on the image feature to track its movement into a subsequent video frame. The motion model is applied to the precise boundary to warp the precise outline into a new rough outline for the image feature in the subsequent video frame. This new rough outline is then snapped to locate a new precise boundary. Automatic processing is repeated for subsequent video frames.

US Patent:

6711278, Mar 23, 2004

Filed:

Sep 10, 1998

Appl. No.:

09/151368

Inventors:

Chuang Gu - Redmond WA
Ming-Chieh Lee - Bellevue WA

Assignee:

Microsoft Corporation - Redmond WA

International Classification:

G06K 900

US Classification:

382103, 382199, 382173, 348169, 324284

Abstract:

A semantic object tracking method tracks general semantic objects with multiple non-rigid motion, disconnected components and multiple colors throughout a vector image sequence. The method accurately tracks these general semantic objects by spatially segmenting image regions from a current frame and then classifying these regions as to which semantic object they originated from in the previous frame. To classify each region, the method performs a region based motion estimation between each spatially segmented region and the previous frame to compute the position of a predicted region in the previous frame. The method then classifies each region in the current frame as being part of a semantic object based on which semantic object in the previous frame contains the most overlapping points of the predicted region. Using this method, each region in the current image is tracked to one semantic object from the previous frame, with no gaps or overlaps. The method propagates few or no errors because it projects regions into a frame where the semantic object boundaries are previously computed rather than trying to project and adjust a boundary in a frame where the objects boundary is unknown.

US Patent:

7088845, Aug 8, 2006

Filed:

Jan 28, 2004

Appl. No.:

10/767135

Inventors:

Chuang Gu - Redmond WA, US
Ming-Chieh Lee - Bellevue WA, US

Assignee:

Microsoft Corporation - Redmond WA

International Classification:

G06K 9/00

US Classification:

382103, 382107

Abstract:

A semantic object tracking method tracks general semantic objects with multiple non-rigid motion, disconnected components and multiple colors throughout a vector image sequence. The method accurately tracks these general semantic objects by spatially segmenting image regions from a current frame and then classifying these regions as to which semantic object they originated from in the previous frame. To classify each region, the method perform a region based motion estimation between each spatially segmented region and the previous frame to computed the position of a predicted region in the previous frame. The method then classifies each region in the current frame as being part of a semantic object based on which semantic object in the previous frame contains the most overlapping points of the predicted region. Using this method, each region in the current image is tracked to one semantic object from the previous frame, with no gaps or overlaps. The method propagates few or no errors because it projects regions into a frame where the semantic object boundaries are previously computed rather than trying to project and adjust a boundary in a frame where the object's boundary is unknown.

US Patent:

7162055, Jan 9, 2007

Filed:

Jun 29, 2005

Appl. No.:

11/171448

Inventors:

Chuang Gu - Bothell WA, US
Ming-Chieh Lee - Bellevue WA, US

Assignee:

Microsoft Corporation - Redmond WA

International Classification:

G06K 9/00
G06K 9/34
H04N 5/225

US Classification:

382103, 382173, 348169

Abstract:

A semantic object tracking method tracks general semantic objects with multiple non-rigid motion, disconnected components and multiple colors throughout a vector image sequence. The method accurately tracks these general semantic objects by spatially segmenting image regions from a current frame and then classifying these regions as to which semantic object they originated from in the previous frame. To classify each region, the method performs a region based motion estimation between each spatially segmented region and the previous frame to compute the position of a predicted region in the previous frame. The method then classifies each region in the current frame as being part of a semantic object based on which semantic object in the previous frame contains the most overlapping points of the predicted region. Using this method, each region in the current image is tracked to one semantic object from the previous frame, with no gaps or overlaps. The method propagates few or no errors because it projects regions into a frame where the semantic object boundaries are previously computed rather than trying to project and adjust a boundary in a frame where the object's boundary is unknown.

US Patent:

7710434, May 4, 2010

Filed:

May 30, 2007

Appl. No.:

11/755082

Inventors:

Chuang Gu - Bellevue WA, US

Assignee:

Microsoft Corporation - Redmond WA

International Classification:

G09G 5/02
G09G 5/00
H04N 7/00
H04N 11/06
H04N 9/74
G06K 9/00
G06K 9/32

US Classification:

345589, 345604, 345591, 345649, 345660, 348467, 348488, 348552, 348580, 358518, 382167, 382254, 382296, 382304

Abstract:

Image processing in mobile devices is optimized by combining at least two of the color conversion, rotation, and scaling operations. Received images, such as still images or frames of video stream, are subjected to a combined transformation after decoding, where each pixel is color converted (e. g. from YUV to RGB), rotated, and scaled as needed. By combining two or three of the processes into one, read/write operations consuming significant processing and memory resources are reduced enabling processing of higher resolution images and/or power and processing resource savings.

US Patent:

8270473, Sep 18, 2012

Filed:

Jun 12, 2009

Appl. No.:

12/483577

Inventors:

William Chen - Issaquah WA, US
Chun-Wei Chan - Redmond WA, US
Stacey Spears - Sammamish WA, US
Yaming He - Redmond WA, US
Florin Folta - Redmond WA, US
Chuang Gu - Bellevue WA, US
King Wei Hor - Bellevue WA, US

Assignee:

Microsoft Corporation - Redmond WA

International Classification:

H04B 1/66

US Classification:

37524003, 37524005, 37524016, 37524015, 37524012, 37524024, 382251, 382236, 382238, 382239

Abstract:

A video encoding system encodes video streams for multiple bit rate video streaming using an approach that permits the encoded resolution to vary based, at least in part, on motion complexity. The video encoding system dynamically decides an encoding resolution for segments of the multiple bit rate video streams that varies with video complexity so as to achieve a better visual experience for multiple bit rate streaming. Motion complexity may be considered separately, or along with spatial complexity, in making the resolution decision.

US Patent:

8311115, Nov 13, 2012

Filed:

Jan 29, 2009

Appl. No.:

12/362427

Inventors:

Chuang Gu - Bellevue WA, US
Chun-Wei Chan - Redmond WA, US
William Chen - Issaquah WA, US
Stacey Spears - Sammamish WA, US
Thomas W. Holcomb - Sammamish WA, US

Assignee:

Microsoft Corporation - Redmond WA

International Classification:

H04N 7/12

US Classification:

37524016, 37524001, 37524012, 37524017, 37524029

Abstract:

A video encoder uses previously calculated motion information for inter frame coding to achieve faster computation speed for video compression. In a multi bit rate application, motion information produced by motion estimation for inter frame coding of a compressed video bit stream at one bit rate is passed on to a subsequent encoding of the video at a lower bit rate. The video encoder chooses to use the previously calculated motion information for inter frame coding at the lower bit rate if the video resolution is unchanged. A multi core motion information pre-calculation produces motion information prior to encoding by dividing motion estimation of each inter frame to separate CPU cores.

US Patent:

8396114, Mar 12, 2013

Filed:

Jan 29, 2009

Appl. No.:

12/362420

Inventors:

Chuang Gu - Bellevue WA, US
Chun-Wei Chan - Redmond WA, US
William Chen - Issaquah WA, US
Stacey Spears - Sammamish WA, US
Thomas W. Holcomb - Sammamish WA, US
Chih-Lung Lin - Redmond WA, US
Sanjeev Mehrotra - Kirkland WA, US

Assignee:

Microsoft Corporation - Redmond WA

International Classification:

H04N 7/12
G06K 9/36
G06F 11/00

US Classification:

37524001, 382232, 370235

Abstract:

A video encoding system encodes video streams for multiple bit rate video streaming using an approach that permits the encoded bit rate to vary subject to a peak bit rate and average bit rate constraints for higher quality streams, while a bottom bit rate stream is encoded to achieve a constant chunk rate. The video encoding system also dynamically decides an encoding resolution for segments of the multiple bit rate video streams that varies with video complexity so as to achieve a better visual experience for multiple bit rate streaming.