Sarah Joanne Parker

US Patent:

20220207654, Jun 30, 2022

Filed:

Mar 18, 2022

Appl. No.:

17/698116

Inventors:

- Mountain View CA, US
Yue Chen - Kirkland WA, US
Sarah Parker - San Francisco CA, US

International Classification:

G06T 5/00
G06T 5/50
G06N 3/08
G06N 3/04
G06N 20/20
G06T 3/40
H04N 19/70
H04N 19/176
G06K 9/62
G06T 9/00

Abstract:

Guided restoration is used to restore video data degraded from a video frame. The video frame is divided into restoration units (RUs) which each correspond to one or more blocks of the video frame. Restoration schemes are selected for each RU. The restoration schemes may indicate to use one of a plurality of neural networks trained for the guided restoration. Alternatively, the restoration schemes may indicate to use a neural network and a filter-based restoration tool. The video frame is then restored by processing each RU according to the respective selected restoration scheme. During encoding, the restored video frame is encoded to an output bitstream, and the use of the selected restoration schemes may be signaled within the output bitstream. During decoding, the restored video frame is output to an output video stream.

US Patent:

20200184603, Jun 11, 2020

Filed:

Jul 18, 2019

Appl. No.:

16/515226

Inventors:

- Mountain View CA, US
Yue Chen - Kirkland WA, US
Sarah Parker - San Francisco CA, US

International Classification:

G06T 5/00
G06T 5/50
G06N 3/08
G06N 3/04
G06N 20/20
G06T 9/00
G06T 3/40
H04N 19/70
H04N 19/176
G06K 9/62

Abstract:

Guided restoration is used to restore video data degraded from a video frame. The video frame is divided into restoration units (RUs) which each correspond to one or more blocks of the video frame. Restoration schemes are selected for each RU. The restoration schemes may indicate to use one of a plurality of neural networks trained for the guided restoration. Alternatively, the restoration schemes may indicate to use a neural network and a filter-based restoration tool. The video frame is then restored by processing each RU according to the respective selected restoration scheme. During encoding, the restored video frame is encoded to an output bitstream, and the use of the selected restoration schemes may be signaled within the output bitstream. During decoding, the restored video frame is output to an output video stream.

US Patent:

20200186796, Jun 11, 2020

Filed:

Mar 7, 2019

Appl. No.:

16/295176

Inventors:

- Mountain View CA, US
Yue Chen - Kirkland WA, US
Sarah Parker - San Francisco CA, US

International Classification:

H04N 19/107
H04N 19/105
G06N 20/00
H04N 19/184
H04N 19/154

Abstract:

Video coding may include generating, by a processor, a decoded frame by decoding a current frame from an encoded bitstream and outputting a reconstructed frame based on the decoded frame. Decoding includes identifying a current encoded block from the current frame, identifying a prediction coding model for the current block, wherein the prediction coding model is a machine learning prediction coding model from a plurality of machine learning prediction coding models, identifying reference values for decoding the current block based on the prediction coding model, obtaining prediction values based on the prediction coding model and the reference values, generating a decoded block corresponding to the current encoded block based on the prediction values, and including the decoded block in the decoded frame.

US Patent:

20200186809, Jun 11, 2020

Filed:

Jul 19, 2019

Appl. No.:

16/516784

Inventors:

- Mountain View CA, US
Yue Chen - Kirkland WA, US
Sarah Parker - San Francisco CA, US

International Classification:

H04N 19/147
G06N 3/04
H04N 19/59
H04N 19/184

Abstract:

A hybrid apparatus for coding a video stream includes a first encoder. The first encoder includes a neural network having at least one hidden layer, and the neural network receives source data from the video stream at a first hidden layer of the at least one hidden layer, receives side information correlated with the source data at the first hidden layer, and generates guided information using the source data and the side information. The first encoder outputs the guided information and the side information for a decoder to reconstruct the source data.