Shu Y Kong

US Patent:

20180268535, Sep 20, 2018

Filed:

May 16, 2018

Appl. No.:

15/981166

Inventors:

- San Jose CA, US
Zhe Lin - Fremont CA, US
Shu Kong - Irvine CA, US
Radomir Mech - Mountain View CA, US

International Classification:

G06T 7/00
G06K 9/62

Abstract:

Systems and methods are disclosed for estimating aesthetic quality of digital images using deep learning. In particular, the disclosed systems and methods describe training a neural network to generate an aesthetic quality score digital images. In particular, the neural network includes a training structure that compares relative rankings of pairs of training images to accurately predict a relative ranking of a digital image. Additionally, in training the neural network, an image rating system can utilize content-aware and user-aware sampling techniques to identify pairs of training images that have similar content and/or that have been rated by the same or different users. Using content-aware and user-aware sampling techniques, the neural network can be trained to accurately predict aesthetic quality ratings that reflect subjective opinions of most users as well as provide aesthetic scores for digital images that represent the wide spectrum of aesthetic preferences of various users.

US Patent:

20170294010, Oct 12, 2017

Filed:

Apr 12, 2016

Appl. No.:

15/097113

Inventors:

- San Jose CA, US
Zhe Lin - Fremont CA, US
Shu Kong - Irvine CA, US
Radomir Mech - Mountain View CA, US

International Classification:

G06T 7/00
G06K 9/62

Abstract:

Systems and methods are disclosed for estimating aesthetic quality of digital images using deep learning. In particular, the disclosed systems and methods describe training a neural network to generate an aesthetic quality score digital images. In particular, the neural network includes a training structure that compares relative rankings of pairs of training images to accurately predict a relative ranking of a digital image. Additionally, in training the neural network, an image rating system can utilize content-aware and user-aware sampling techniques to identify pairs of training images that have similar content and/or that have been rated by the same or different users. Using content-aware and user-aware sampling techniques, the neural network can be trained to accurately predict aesthetic quality ratings that reflect subjective opinions of most users as well as provide aesthetic scores for digital images that represent the wide spectrum of aesthetic preferences of various users.