Steve D Cheng

US Patent:

20220253277, Aug 11, 2022

Filed:

Dec 13, 2019

Appl. No.:

17/619414

Inventors:

- Mountain View CA, US
Luv Kothari - Sunnyvale CA, US
Behshad Behzadi - Freienbach, CH
Zaheed Sabur - Baar, CH
Domenico Carbotta - Zurich, CH
Akshay Kannan - Fremont CA, US
Qi Wang - Palo Alto CA, US
Gokay Baris Gultekin - Palo Alto CA, US
Angana Ghosh - Mountain View CA, US
Xu Liu - San Jose CA, US
Yang Lu - Los Altos CA, US
Steve Cheng - Los Altos CA, US

International Classification:

G06F 3/16
G06F 3/0481
G06F 40/174
G10L 15/26
G06F 3/0484
G06F 3/04886
G06F 40/30
G06F 40/143
G06F 40/117
G10L 15/22

Abstract:

Implementations set forth herein relate to an automated assistant that can selectively determine whether to incorporate a verbatim interpretation of portions spoken utterances into an entry field and/or incorporate synonymous content into the entry field. For instance, a user can be accessing an interface that provides an entry field (e.g., address field) for receiving user input. In order to provide input for entry field, the user can select the entry field and/or access a GUI keyboard to initialize an automated assistant for assisting with filling the entry field. Should the user provide a spoken utterance, the user can elect to provide a spoken utterance that embodies the intended input (e.g., an actual address) or a reference to the intended input (e.g., a name). In response to the spoken utterance, the automated assistant can fill the entry field with the intended input without necessitating further input from the user.

US Patent:

20230125662, Apr 27, 2023

Filed:

Dec 21, 2022

Appl. No.:

18/086263

Inventors:

- Mountain View CA, US
Sergey Nazarov - Zurich, CH
Behshad Behzadi - Freienbach, CH
Mario Bertschler - Zurich, CH
Bohdan Vlasyuk - Zurich, CH
Daniel Cotting - Islisberg, CH
Michael Golikov - Merlischachen, CH
Lucas Mirelmann - Zurich, CH
Steve Cheng - Los Altos CA, US
Zaheed Sabur - Baar, CH
Okan Kolak - Sunnyvale CA, US
Yan Zhong - Sunnyvale CA, US
Vinh Quoc Ly - Sunnyvale CA, US

International Classification:

G10L 15/22
G06F 3/16

Abstract:

Implementations set forth herein allow a user to access a first application in a foreground of a graphical interface, and simultaneously employ an automated assistant to respond to notifications arising from a second application. The user can provide an input, such as a spoken utterance, while viewing the first application in the foreground in order to respond to notifications from the second application without performing certain intervening steps that can arise under certain circumstances. Such intervening steps can include providing a user confirmation, which can be bypassed, and/or time-limited according to a timer, which can be displayed in response to the user providing a responsive input directed at the notification. A period for the timer can be set according to one or more characteristics that are associated with the notification, the user, and/or any other information that can be associated with the user receiving the notification.

US Patent:

20230041517, Feb 9, 2023

Filed:

Oct 21, 2022

Appl. No.:

17/970894

Inventors:

- Mountain View CA, US
Zaheed Sabur - Baar, CH
Denis Burakov - Zurich, CH
Behshad Behzadi - Freienbach, CH
Sergey Nazarov - Zurich, CH
Daniel Cotting - Islisberg, CH
Mario Bertschler - Zurich, CH
Lucas Mirelmann - Zurich, CH
Steve Cheng - Los Altos CA, US
Bohdan Vlasyuk - Zurich, CH
Jonathan Lee - Brooklyn, CA
Lucia Terrenghi - Zurich, CH
Adrian Zumbrunnen - Zurich, CH

International Classification:

G10L 15/22
G01D 21/02
G06F 3/16
G10L 15/06
G10L 15/18
G10L 15/183
G10L 25/78

Abstract:

Implementations can reduce the time required to obtain responses from an automated assistant by, for example, obviating the need to provide an explicit invocation to the automated assistant, such as by saying a hot-word/phrase or performing a specific user input, prior to speaking a command or query. In addition, the automated assistant can optionally receive, understand, and/or respond to the command or query without communicating with a server, thereby further reducing the time in which a response can be provided. Implementations only selectively initiate on-device speech recognition responsive to determining one or more condition(s) are satisfied. Further, in some implementations, on-device NLU, on-device fulfillment, and/or resulting execution occur only responsive to determining, based on recognized text form the on-device speech recognition, that such further processing should occur. Thus, through selective activation of on-device speech processing, and/or selective activation of on-device NLU and/or on-device fulfillment, various client device resources are conserved.

US Patent:

20210335356, Oct 28, 2021

Filed:

Jun 5, 2019

Appl. No.:

17/045273

Inventors:

- Mountain View CA, US
Sergey Nazarov - Zurich, CH
Behshad Behzadi - Freienbach, CH
Mario Bertschler - Zurich, CH
Bohdan Vlasyuk - Zurich, CH
Daniel Cotting - Islisberg, CH
Michael Golikov - Merlischachen, CH
Lucas Mirelmann - Zurich, CH
Steve Cheng - Los Altos CA, US
Zaheed Sabur - Baar, CH
Okan Kolak - Sunnyvale CA, US
Yan Zhong - Sunnyvale CA, US
Vinh Quoc Ly - Sunnyvale CA, US

International Classification:

G10L 15/22
G06F 3/16

Abstract:

Implementations set forth herein allow a user to access a first application in a foreground of a graphical interface, and simultaneously employ an automated assistant to respond to notifications arising from a second application. The user can provide an input, such as a spoken utterance, while viewing the first application in the foreground in order to respond to notifications from the second application without performing certain intervening steps that can arise under certain circumstances. Such intervening steps can include providing a user confirmation, which can be bypassed, and/or time-limited according to a timer, which can be displayed in response to the user providing a responsive input directed at the notification. A period for the timer can be set according to one or more characteristics that are associated with the notification, the user, and/or any other information that can be associated with the user receiving the notification.

US Patent:

20210124132, Apr 29, 2021

Filed:

Jan 7, 2021

Appl. No.:

17/143921

Inventors:

Steve CHENG - Emerald Hills CA, US

International Classification:

G02B 6/38
G02B 6/44

Abstract:

A method of providing fiber optic connectivity including gripping a rotatable coupler of a fiber optic connector at a grip portion thereof, inserting the rotatable coupler into a bulkhead adapter in a straight direction, turning the rotatable coupler in a clockwise or counterclockwise direction to increase a tension of the spring while pushing the rotatable coupler forward, and releasing the rotatable coupler such that the rotatable coupler rotates in a counter clockwise direction and locks the fiber optic connector into the bulkhead adapter.

US Patent:

20210074285, Mar 11, 2021

Filed:

May 31, 2019

Appl. No.:

16/621540

Inventors:

Zaheed Sabur - Baar, CH
Denis Burakov - Zurich, CH
Behshad Behzadi - Freienbach, CH
Sergey Nazarov - Zurich, CH
Daniel Cotting - Islisberg, CH
Mario Bertschler - Zurich, CH
Lucas Mirelmann - Zurich, CH
Steve Cheng - Los Altos CA, US
Bohdan Vlasyuk - Zurich, CH
Jonathan Lee - Brooklyn NY, US
Lucia Terrenghi - Zurich, CH
Adrian Zumbrunnen - Zurich, CH

International Classification:

G10L 15/22
G10L 15/06
G10L 25/78
G10L 15/18
G10L 15/183
G06F 3/16
G01D 21/02

Abstract:

Implementations can reduce the time required to obtain responses from an automated assistant by, for example, obviating the need to provide an explicit invocation to the automated assistant, such as by saying a hot-word/phrase or performing a specific user input, prior to speaking a command or query. In addition, the automated assistant can optionally receive, understand, and/or respond to the command or query without communicating with a server, thereby further reducing the time in which a response can be provided. Implementations only selectively initiate on-device speech recognition responsive to determining one or more condition(s) are satisfied. Further, in some implementations, on-device NLU, on-device fulfillment, and/or resulting execution occur only responsive to determining, based on recognized text form the on-device speech recognition, that such further processing should occur. Thus, through selective activation of on-device speech processing, and/or selective activation of on-device NLU and/or on-device fulfillment, various client device resources are conserved.

US Patent:

20200395018, Dec 17, 2020

Filed:

Jun 13, 2019

Appl. No.:

16/614224

Inventors:

- Mountain View CA, US
Behshad Behzadi - Freienbach, CH
Mario Bertschler - Zurich, CH
Bohdan Vlasyuk - Zurich, CH
Daniel Cotting - Islisberg, CH
Michael Golikov - Merlischachen, CH
Lucas Mirelmann - Zurich, CH
Steve Cheng - Los Altos CA, US
Sergey NAZAROV - Zurich, CH
Zaheed Sabur - Baar, CH
Marcin Nowak-Przygodzki - Bäch, CH
Mugurel Ionut Andreica - Adliswil, CH
Radu Voroneanu - Zurich, CH

International Classification:

G10L 15/26
G10L 15/22
G06F 3/16

Abstract:

Implementations set forth herein relate to a system that employs an automated assistant to further interactions between a user and another application, which can provide the automated assistant with permission to initialize relevant application actions simultaneous to the user interacting with the other application. Furthermore, the system can allow the automated assistant to initialize actions of different applications, despite being actively operating a particular application. Available actions can be gleaned by the automated assistant using various application-specific schemas, which can be compared with incoming requests from a user to the automated assistant. Additional data, such as context and historical interactions, can also be used to rank and identify a suitable application action to be initialized via the automated assistant.

US Patent:

20200357395, Nov 12, 2020

Filed:

May 31, 2019

Appl. No.:

16/613705

Inventors:

- Mountain View CA, US
Zaheed Sabur - Baar, CH
Bohdan Vlasyuk - Zurich, CH
Marie Patriarche Bledowski - Richterswil, CH
Sergey Nazarov - Zurich, CH
Denis Burakov - Zurich, CH
Behshad Behzadi - Freienbach, CH
Michael Golikov - Merlischachen, CH
Steve Cheng - Los Altos CA, US
Daniel Cotting - Islisberg, CH
Mario Bertschler - Zurich, CH

International Classification:

G10L 15/22
G10L 15/08

Abstract:

Implementations herein relate to pre-caching data, corresponding to predicted interactions between a user and an automated assistant, using data characterizing previous interactions between the user and the automated assistant. An interaction can be predicted based on details of a current interaction between the user and an automated assistant. One or more predicted interactions can be initialized, and/or any corresponding data pre-cached, prior to the user commanding the automated assistant in furtherance of the predicted interaction. Interaction predictions can be generated using a user-parameterized machine learning model, which can be used when processing input(s) that characterize a recent user interaction with the automated assistant. Should the user command the automated assistant in a way that is aligned with a pre-cached, predicted interaction, the automated assistant will exhibit instant fulfillment of the command, thereby eliminating any latency that the user would have otherwise experienced interacting with the automated assistant.