Qiang Chen

US Patent:

20210019892, Jan 21, 2021

Filed:

Jul 15, 2019

Appl. No.:

16/512344

Inventors:

- Mountain View CA, US
Qiang Chen - Verona WI, US
Niklas Enbom - Mountain View CA, US

Assignee:

Google LLC - Mountain View CA

International Classification:

G06T 7/194
G06T 7/11
G06T 7/155
G06K 9/00
G06T 7/162

Abstract:

Implementations described herein relate to methods, systems, and computer-readable media to render a foreground video. In some implementations, a method includes receiving a plurality of video frames that include depth data and color data. The method further includes downsampling the frames of the video. The method further includes, for each frame, generating an initial segmentation mask that categorizes each pixel of the frame as foreground pixel or background pixel. The method further includes determining a trimap that classifies each pixel of the frame as known background, known foreground, or unknown. The method further includes, for each pixel that is classified as unknown, calculating and storing a weight in a weight map. The method further includes performing fine segmentation to obtain a binary mask for each frame. The method further includes upsampling the plurality of frames based on the binary mask for each frame to obtain a foreground video.

Address:

8312 Grand Ave APT 1R, Elmhurst, NY 11373

Phone:

(718)6512785

VIN:

5TDKK3DCXBS117030

Make:

TOYOTA

Model:

SIENNA

Year:

2011

Address:

12 Monroe St APT HF3, New York, NY 10002

VIN:

JHLRE48758C016631

Make:

HONDA

Model:

CR-V

Year:

2008

Address:

8920 55 Ave APT 6T, Elmhurst, NY 11373

Phone:

(718)2710928

VIN:

1GBKG31K081119666

Make:

Chevrolet

Model:

Express Commercial Cutaw

Year:

2008