Jeffrey Jim Chao

US Patent:

20190250947, Aug 15, 2019

Filed:

Apr 26, 2019

Appl. No.:

16/396522

Inventors:

- San Francisco CA, US
Jeffrey Chao - San Francisco CA, US

International Classification:

G06F 9/48
G06F 9/455
G06F 9/445
G06F 8/71
G06F 9/50

Abstract:

The technology disclosed provides a novel and innovative technique for compact deployment of application code to stream processing systems. In particular, the technology disclosed relates to obviating the need of accompanying application code with its dependencies during deployment (i.e., creating fat jars) by operating a stream processing system within a container defined over worker nodes of whole machines and initializing the worker nodes with precompiled dependency libraries having precompiled classes. Accordingly, the application code is deployed to the container without its dependencies, and, once deployed, the application code is linked with the locally stored precompiled dependencies at runtime. In implementations, the application code is deployed to the container running the stream processing system between 300 milliseconds and 6 seconds. This is drastically faster than existing deployment techniques that take anywhere between 5 to 15 minutes for deployment.

US Patent:

20190163539, May 30, 2019

Filed:

Nov 26, 2018

Appl. No.:

16/200365

Inventors:

- San Francisco CA, US
Jeffrey CHAO - San Francisco CA, US

International Classification:

G06F 9/50

Abstract:

The technology disclosed herein relates to method, system, and computer program product (computer-readable storage device) embodiments for managing resource allocation in a stream processing framework. An embodiment operates by configuring an allocation of a task sequence and machine resources to a container, partitioning a data stream into a plurality of batches arranged for parallel processing by the container via the machine resources allocated to the container, and running the task sequence, running at least one batch of the plurality of batches. Some embodiments may also include changing the allocation responsive to a determination of an increase in data volume, and may further include changing the allocation to a previous state of the allocation, responsive to a determination of a decrease in data volume. Additionally, time-based throughput of the data stream may be monitored for a given worker node configured to run a batch of the plurality of batches.

US Patent:

20190155646, May 23, 2019

Filed:

Jan 28, 2019

Appl. No.:

16/259745

Inventors:

- San Francisco CA, US
Jeffrey Chao - Campbell CA, US

International Classification:

G06F 9/48

Abstract:

The technology disclosed relates to providing strong ordering in multi-stage processing of near real-time (NRT) data streams. In particular, it relates to maintaining current batch-stage information for a batch at a grid-scheduler in communication with a grid-coordinator that controls dispatch of batch-units to the physical threads for a batch-stage. This includes operating a computing grid, and queuing data from the NRT data streams as batches in pipelines for processing over multiple stages in the computing grid. Also included is determining, for a current batch-stage, batch-units pending dispatch, in response to receiving the current batch-stage information; identifying physical threads that processed batch-units for a previous batch-stage on which the current batch-stage depends and have registered pending tasks for the current batch-stage; and dispatching the batch-units for the current batch-stage to the identified physical threads subsequent to complete processing of the batch-units for the previous batch-stage.

US Patent:

20180307571, Oct 25, 2018

Filed:

Apr 16, 2018

Appl. No.:

15/954014

Inventors:

- San Francisco CA, US
Jeffrey Chao - San Francisco CA, US

Assignee:

salesforce.com, inc. - San Francisco CA

International Classification:

G06F 11/14
G06F 11/20

Abstract:

The technology disclosed relates to discovering multiple previously unknown and undetected technical problems in fault tolerance and data recovery mechanisms of modern stream processing systems. In addition, it relates to providing technical solutions to these previously unknown and undetected problems. In particular, the technology disclosed relates to discovering the problem of modification of batch size of a given batch during its replay after a processing failure. This problem results in over-count when the input during replay is not a superset of the input fed at the original play. Further, the technology disclosed discovers the problem of inaccurate counter updates in replay schemes of modern stream processing systems when one or more keys disappear between a batch's first play and its replay. This problem is exacerbated when data in batches is merged or mapped with data from an external data store.

US Patent:

20180253335, Sep 6, 2018

Filed:

May 7, 2018

Appl. No.:

15/973230

Inventors:

- San Francisco CA, US
Jeffrey Chao - San Francisco CA, US

International Classification:

G06F 9/50
G06F 3/06

Abstract:

The technology disclosed relates to maintaining throughput of a stream processing framework while increasing processing load. In particular, it relates to defining a container over at least one worker node that has a plurality workers, with one worker utilizing a whole core within a worker node, and queuing data from one or more incoming near real-time (NRT) data streams in multiple pipelines that run in the container and have connections to at least one common resource external to the container. It further relates to concurrently executing the pipelines at a number of workers as batches, and limiting simultaneous connections to the common resource to the number of workers by providing a shared connection to a set of batches running on a same worker regardless of the pipelines to which the batches in the set belong.

US Patent:

20180074852, Mar 15, 2018

Filed:

Sep 14, 2016

Appl. No.:

15/265817

Inventors:

- San Francisco CA, US
Jeffrey CHAO - San Francisco CA, US

Assignee:

salesforce.com, inc. - San Francisco CA

International Classification:

G06F 9/48
G06F 9/50
G06F 9/455
G06F 9/44

Abstract:

The technology disclosed provides a novel and innovative technique for compact deployment of application code to stream processing systems. In particular, the technology disclosed relates to obviating the need of accompanying application code with its dependencies during deployment (i.e., creating fat jars) by operating a stream processing system within a container defined over worker nodes of whole machines and initializing the worker nodes with precompiled dependency libraries having precompiled classes. Accordingly, the application code is deployed to the container without its dependencies, and, once deployed, the application code is linked with the locally stored precompiled dependencies at runtime. In implementations, the application code is deployed to the container running the stream processing system between 300 milliseconds and 6 seconds. This is drastically faster than existing deployment techniques that take anywhere between 5 to 15 minutes for deployment.

US Patent:

20170083368, Mar 23, 2017

Filed:

Dec 31, 2015

Appl. No.:

14/986401

Inventors:

- San Francisco CA, US
Jeffrey Chao - San Francisco CA, US

Assignee:

salesforce.com, inc. - San Francisco CA

International Classification:

G06F 9/50
G06F 3/06

Abstract:

The technology disclosed relates to maintaining throughput of a stream processing framework while increasing processing load. In particular, it relates to defining a container over at least one worker node that has a plurality workers, with one worker utilizing a whole core within a worker node, and queuing data from one or more incoming near real-time (NRT) data streams in multiple pipelines that run in the container and have connections to at least one common resource external to the container. It further relates to concurrently executing the pipelines at a number of workers as batches, and limiting simultaneous connections to the common resource to the number of workers by providing a shared connection to a set of batches running on a same worker regardless of the pipelines to which the batches in the set belong.

US Patent:

20170083378, Mar 23, 2017

Filed:

Dec 31, 2015

Appl. No.:

14/986419

Inventors:

- SAN FRANCISCO CA, US
Jeffrey Chao - San Francisco CA, US

Assignee:

salesforce.com, inc. - SAN FRANCISCO CA

International Classification:

G06F 9/50
G06F 17/30

Abstract:

The technology disclosed relates to managing processing of long tail task sequences in a stream processing framework. In particular, it relates to operating a computing grid that includes a plurality of physical threads which processes data from one or more near real-time (NRT) data streams for multiple task sequences, and queuing data from the NRT data streams as batches in multiple pipelines using a grid-coordinator that controls dispatch of the batches to the physical threads. The method also includes assigning a priority-level to each of the pipelines using a grid-scheduler, wherein the grid-scheduler initiates execution of a first number of batches from a first pipeline before execution of a second number of batches from a second pipeline, responsive to respective priority levels of the first and second pipelines.