Jongmin Baek

US Patent:

20210264098, Aug 26, 2021

Filed:

May 7, 2021

Appl. No.:

17/315027

Inventors:

- San Francisco CA, US
Peter N. Belhumeur - San Francisco CA, US
Ying Xiong - Sunnyvale CA, US
Jongmin Baek - San Jose CA, US
Simon Kozlov - San Francisco CA, US
Thomas Berg - San Francisco CA, US
David J. Kriegman - San Diego CA, US

International Classification:

G06F 40/166
G06T 7/194
G06T 11/00
G06K 9/00
G06F 16/93
G06T 5/00
G06F 40/106
G06F 40/123
G06F 40/197
G06K 9/46
G06K 9/78

Abstract:

The present disclosure is directed toward systems and methods to quickly and accurately identify boundaries of a displayed document in a live camera image feed, and provide a document boundary indicator within the live camera image feed. For example, systems and methods described herein utilize different display document detection processes in parallel to generate and provide a document boundary indicator that accurately corresponds with a displayed document within a live camera image feed. Thus, a user of the mobile computing device can easily see whether the document identification system has correctly identified the displayed document within the camera viewfinder feed.

US Patent:

20210089963, Mar 25, 2021

Filed:

Nov 12, 2019

Appl. No.:

16/681599

Inventors:

- San Francisco CA, US
Jongmin Baek - Millbrae CA, US

International Classification:

G06N 20/00
G06N 5/04
G06F 16/93
G06F 16/16

Abstract:

Computer-implemented techniques encompass using distinct machine learning sub-models to score respective types of candidate content for the purpose of providing personalized content suggestions to end-users of a content management system. The relevancy scores generated by the distinct sub-models are mapped to expected end-user interaction scores of the candidate content scored. Content suggestions are provided at end-users' computing devices where the suggested content is selected from the candidate content based on the expected end-user interaction scores of the candidate content. For each distinct sub-model, a normalizing mapping function is solved using an optimizer that maps the relevancy scores generated by the sub-model for the candidate content to expected end-user interaction scores for the candidate content. The expected end-user interaction scores are comparable across the distinct sub-models and can be used to rank content suggestions across the distinct sub-models.

US Patent:

20200233999, Jul 23, 2020

Filed:

Mar 25, 2020

Appl. No.:

16/830047

Inventors:

- San Francisco CA, US
Peter N. Belhumeur - San Francisco CA, US
Ying Xiong - Sunnyvale CA, US
Jongmin Baek - San Jose CA, US
Simon Kozlov - San Francisco CA, US
Thomas Berg - San Francisco CA, US
David J. Kriegman - San Diego CA, US

International Classification:

G06F 40/166
G06T 7/194
G06T 11/00
G06K 9/00
G06F 16/93
G06T 5/00
G06F 40/106
G06F 40/123
G06F 40/197
G06K 9/46
G06K 9/78

Abstract:

The present disclosure is directed toward systems and methods that efficiently and effectively generate an enhanced document image of a displayed document in an image frame captured from a live image feed. For example, systems and methods described herein apply a document enhancement process to a displayed document in an image frame that result in an enhanced document image that is cropped, rectified, un-shadowed, and with dark text against a mostly white background. Additionally, systems and method described herein determine whether a stored digital content item includes a displayed document. In response to determining that a stored digital content item does include a displayed document, systems and methods described herein generate an enhanced document image of a displayed document included in the stored digital content item.

US Patent:

20200226319, Jul 16, 2020

Filed:

Mar 25, 2020

Appl. No.:

16/830077

Inventors:

- San Francisco CA, US
Peter N. Belhumeur - San Francisco CA, US
Ying Xiong - Sunnyvale CA, US
Jongmin Baek - San Jose CA, US
Simon Kozlov - San Francisco CA, US
Thomas Berg - San Francisco CA, US
David J. Kriegman - San Diego CA, US

International Classification:

G06F 40/166
G06T 7/194
G06T 11/00
G06K 9/00
G06F 16/93
G06T 5/00
G06F 40/106
G06F 40/123
G06F 40/197
G06K 9/46
G06K 9/78

Abstract:

The present disclosure is directed toward systems and methods that efficiently and effectively generate an enhanced document image of a displayed document in an image frame captured from a live image feed. For example, systems and methods described herein apply a document enhancement process to a displayed document in an image frame that result in an enhanced document image that is cropped, rectified, un-shadowed, and with dark text against a mostly white background. Additionally, systems and method described herein determine whether a stored digital content item includes a displayed document. In response to determining that a stored digital content item does include a displayed document, systems and methods described herein generate an enhanced document image of a displayed document included in the stored digital content item.

US Patent:

20190325013, Oct 24, 2019

Filed:

Jun 28, 2019

Appl. No.:

16/457423

Inventors:

- San Francisco CA, US
Peter N. Belhumeur - San Francisco CA, US
Ying Xiong - Sunnyvale CA, US
Jongmin Baek - San Jose CA, US
Simon Kozlov - San Francisco CA, US
Thomas Berg - San Francisco CA, US
David J. Kriegman - San Diego CA, US

International Classification:

G06F 17/24
G06F 16/93
G06K 9/00
G06F 17/22
G06F 17/21
G06T 11/00
G06T 7/194
G06K 9/78
G06K 9/46
G06T 5/00

Abstract:

The present disclosure is directed toward systems and methods to quickly and accurately identify boundaries of a displayed document in a live camera image feed, and provide a document boundary indicator within the live camera image feed. For example, systems and methods described herein utilize different display document detection processes in parallel to generate and provide a document boundary indicator that accurately corresponds with a displayed document within a live camera image feed. Thus, a user of the mobile computing device can easily see whether the document identification system has correctly identified the displayed document within the camera viewfinder feed.

US Patent:

20180024974, Jan 25, 2018

Filed:

Jul 24, 2017

Appl. No.:

15/658289

Inventors:

- San Francisco CA, US
Peter N. Belhumeur - San Francisco CA, US
Ying Xiong - Sunnyvale CA, US
Jongmin Baek - San Jose CA, US
Simon Kozlov - San Francisco CA, US
Thomas Berg - San Francisco CA, US
David J. Kriegman - San Diego CA, US

International Classification:

G06F 17/24
G06K 9/00
G06T 11/00
G06F 17/22
G06F 17/21
G06T 7/194

Abstract:

The present disclosure is directed toward systems and methods that efficiently and effectively generate an enhanced document image of a displayed document in an image frame captured from a live image feed. For example, systems and methods described herein apply a document enhancement process to a displayed document in an image frame that result in an enhanced document image that is cropped, rectified, un-shadowed, and with dark text against a mostly white background. Additionally, systems and method described herein determine whether a stored digital content item includes a displayed document. In response to determining that a stored digital content item does include a displayed document, systems and methods described herein generate an enhanced document image of a displayed document included in the stored digital content item.

US Patent:

20180025251, Jan 25, 2018

Filed:

Jul 24, 2017

Appl. No.:

15/658291

Inventors:

- San Francisco CA, US
Peter N. Belhumeur - San Francisco CA, US
Ying Xiong - Sunnyvale CA, US
Jongmin Baek - San Jose CA, US
Simon Kozlov - San Francisco CA, US
Thomas Berg - San Francisco CA, US
David J. Kriegman - San Diego CA, US

International Classification:

G06K 9/46
G06K 9/78
G06K 9/00

Abstract:

The present disclosure is directed toward systems and methods to quickly and accurately identify boundaries of a displayed document in a live camera image feed, and provide a document boundary indicator within the live camera image feed. For example, systems and methods described herein utilize different display document detection processes in parallel to generate and provide a document boundary indicator that accurately corresponds with a displayed document within a live camera image feed. Thus, a user of the mobile computing device can easily see whether the document identification system has correctly identified the displayed document within the camera viewfinder feed.