Jeff Wang

US Patent:

20220189173, Jun 16, 2022

Filed:

Nov 23, 2021

Appl. No.:

17/533769

Inventors:

- Sunnyvale CA, US
Le KANG - Dublin CA, US
Zhiyu CHENG - Sunnyvale CA, US
Hao TIAN - Cupertino CA, US
Daming LU - Dublin CA, US
Dapeng LI - Los Altos CA, US
Jingya XUN - San Jose CA, US
Jeff WANG - San Jose CA, US
Xi CHEN - San Jose CA, US
Xing LI - Santa Clara CA, US

Assignee:

Baidu USA LLC - Sunnyvale CA

International Classification:

G06V 20/40
G06F 40/205
G10L 13/08
G06F 16/783
G06N 3/08
G06F 16/78
G06N 3/04
G06V 30/148

Abstract:

Presented herein are systems, methods, and datasets for automatically and precisely generating highlight or summary videos of content. In one or more embodiments, the inputs comprise a text (e.g., an article) of the key event(s) (e.g., a goal, a player action, etc.) in an activity (e.g., a game, a concert, etc.) and a video or videos of the activity. In one or more embodiments, the output is a short video of an event or events in the text, in which the video may include commentary about the highlighted events and/or other audio (e.g., music), which may also be automatically synthesized.

US Patent:

20200320253, Oct 8, 2020

Filed:

Dec 4, 2019

Appl. No.:

16/703718

Inventors:

- Beijing, CN
- Sunnyvale CA, US
Jeff ChienYu WANG - Sunnyvale CA, US
Daming LU - Sunnyvale CA, US

International Classification:

G06F 40/30
G06K 9/00
G10L 13/04

Abstract:

Embodiments of the present disclosure provide a method and apparatus for generating a commentary. The method may include: acquiring at least one news cluster composed of pieces of news generated within a first preset time length, the pieces of news in the news cluster direct to a given news event; determining a target news cluster based on the at least one news cluster; determining, for each piece of news in the target news cluster, a score of being suitable for generating a commentary for the piece of news; and generating, based on a piece of target news, a commentary for the target news cluster, where the piece of target news is a piece of news having a highest score of being suitable for generating a commentary in the target news cluster.

US Patent:

20200320306, Oct 8, 2020

Filed:

Dec 4, 2019

Appl. No.:

16/702886

Inventors:

- Beijing, CN
- Sunnyvale CA, US
Jeff ChienYu WANG - Sunnyvale CA, US
Daming LU - Sunnyvale CA, US

International Classification:

G06K 9/00
G10L 13/04

Abstract:

Embodiments of the present disclosure provide a method and apparatus for generating information. The method may include: determining at least one video segment obtained by semantically segmenting videos included in a target news cluster as a target video set, where respective pieces of news in the target news cluster directs to a given news event; determining a commentary for the target news cluster; determining, based on the target video set and a target image set, a candidate material resource set corresponding to the commentary, where the target image set is composed of respective images included in the target news cluster; and for each paragraph in the commentary, determining degrees of matching between the paragraph and candidate material resources in the candidate material resource set.

US Patent:

20200320307, Oct 8, 2020

Filed:

Dec 4, 2019

Appl. No.:

16/703716

Inventors:

- Sunnyvale CA, US
- Beijing, CN
Xi CHEN - Sunnyvale CA, US
Jeff ChienYu WANG - Sunnyvale CA, US

International Classification:

G06K 9/00
G10L 13/04
G10L 13/08

Abstract:

Embodiments of the present disclosure provide a method and apparatus for generating a video. The method may include: determining a commentary of a target news cluster, each piece of news in the target news cluster being specific to a given news event; generating a voice corresponding to each paragraph in the commentary using a speech synthesis technology; determining a candidate material resource set corresponding to the commentary based on a video and an image included in the target news cluster, the candidate material resource being a video or image; determining a candidate material resource sequence corresponding to the each paragraph in the commentary; and generating a video corresponding to the commentary based on the voice corresponding to the each paragraph in the commentary and the candidate material resource sequence.

US Patent:

20200321026, Oct 8, 2020

Filed:

Dec 4, 2019

Appl. No.:

16/703717

Inventors:

- Sunnyvale CA, US
- Beijing, CN
Xi CHEN - Sunnyvale CA, US
Jeff ChienYu WANG - Sunnyvale CA, US

International Classification:

G11B 27/031
G06F 40/30
G06F 40/205
G11B 27/00
H04N 9/87
G06F 16/438

Abstract:

Embodiments of the present disclosure provide a method and apparatus for generating a video. The method may include: receiving a query text inputted by a user; querying a material resource set related to the query text, material resources being images, videos, or audios; presenting the material resource set; determining a material resource sequence, in response to receiving a selecting operation and a ranking operation of the user on the material resources in the presented material resource set; and generating the video based on the material resource sequence.

US Patent:

20200322570, Oct 8, 2020

Filed:

Dec 4, 2019

Appl. No.:

16/703075

Inventors:

- Beijing, CN
- Sunnyvale CA, US
Jeff ChienYu WANG - Sunnyvale CA, US
Daming LU - Sunnyvale CA, US

International Classification:

H04N 7/025
G06F 16/45

Abstract:

Embodiments of the present disclosure provide a method and apparatus for aligning a paragraph and a video. The method may include: acquiring a commentary and a candidate material resource set corresponding to the commentary, a candidate material resource being a video or an image; acquiring a matching degree between each paragraph in the commentary and each candidate material resource in the candidate material resource set; and determining a candidate material resource sequence corresponding to the each paragraph in the commentary based on the matching degrees between the paragraphs in the commentary and the candidate material resources, playing durations of the candidate material resources and text lengths of the paragraphs in the commentary, an image playing duration being a preset image playing duration.