Jeffrey M Chao

US Patent:

20190250947, Aug 15, 2019

Filed:

Apr 26, 2019

Appl. No.:

16/396522

Inventors:

- San Francisco CA, US
Jeffrey Chao - San Francisco CA, US

International Classification:

G06F 9/48
G06F 9/455
G06F 9/445
G06F 8/71
G06F 9/50

Abstract:

The technology disclosed provides a novel and innovative technique for compact deployment of application code to stream processing systems. In particular, the technology disclosed relates to obviating the need of accompanying application code with its dependencies during deployment (i.e., creating fat jars) by operating a stream processing system within a container defined over worker nodes of whole machines and initializing the worker nodes with precompiled dependency libraries having precompiled classes. Accordingly, the application code is deployed to the container without its dependencies, and, once deployed, the application code is linked with the locally stored precompiled dependencies at runtime. In implementations, the application code is deployed to the container running the stream processing system between 300 milliseconds and 6 seconds. This is drastically faster than existing deployment techniques that take anywhere between 5 to 15 minutes for deployment.

US Patent:

20190163539, May 30, 2019

Filed:

Nov 26, 2018

Appl. No.:

16/200365

Inventors:

- San Francisco CA, US
Jeffrey CHAO - San Francisco CA, US

International Classification:

G06F 9/50

Abstract:

The technology disclosed herein relates to method, system, and computer program product (computer-readable storage device) embodiments for managing resource allocation in a stream processing framework. An embodiment operates by configuring an allocation of a task sequence and machine resources to a container, partitioning a data stream into a plurality of batches arranged for parallel processing by the container via the machine resources allocated to the container, and running the task sequence, running at least one batch of the plurality of batches. Some embodiments may also include changing the allocation responsive to a determination of an increase in data volume, and may further include changing the allocation to a previous state of the allocation, responsive to a determination of a decrease in data volume. Additionally, time-based throughput of the data stream may be monitored for a given worker node configured to run a batch of the plurality of batches.

US Patent:

20180307571, Oct 25, 2018

Filed:

Apr 16, 2018

Appl. No.:

15/954014

Inventors:

- San Francisco CA, US
Jeffrey Chao - San Francisco CA, US

Assignee:

salesforce.com, inc. - San Francisco CA

International Classification:

G06F 11/14
G06F 11/20

Abstract:

The technology disclosed relates to discovering multiple previously unknown and undetected technical problems in fault tolerance and data recovery mechanisms of modern stream processing systems. In addition, it relates to providing technical solutions to these previously unknown and undetected problems. In particular, the technology disclosed relates to discovering the problem of modification of batch size of a given batch during its replay after a processing failure. This problem results in over-count when the input during replay is not a superset of the input fed at the original play. Further, the technology disclosed discovers the problem of inaccurate counter updates in replay schemes of modern stream processing systems when one or more keys disappear between a batch's first play and its replay. This problem is exacerbated when data in batches is merged or mapped with data from an external data store.

US Patent:

20180253335, Sep 6, 2018

Filed:

May 7, 2018

Appl. No.:

15/973230

Inventors:

- San Francisco CA, US
Jeffrey Chao - San Francisco CA, US

International Classification:

G06F 9/50
G06F 3/06

Abstract:

The technology disclosed relates to maintaining throughput of a stream processing framework while increasing processing load. In particular, it relates to defining a container over at least one worker node that has a plurality workers, with one worker utilizing a whole core within a worker node, and queuing data from one or more incoming near real-time (NRT) data streams in multiple pipelines that run in the container and have connections to at least one common resource external to the container. It further relates to concurrently executing the pipelines at a number of workers as batches, and limiting simultaneous connections to the common resource to the number of workers by providing a shared connection to a set of batches running on a same worker regardless of the pipelines to which the batches in the set belong.

US Patent:

20180074852, Mar 15, 2018

Filed:

Sep 14, 2016

Appl. No.:

15/265817

Inventors:

- San Francisco CA, US
Jeffrey CHAO - San Francisco CA, US

Assignee:

salesforce.com, inc. - San Francisco CA

International Classification:

G06F 9/48
G06F 9/50
G06F 9/455
G06F 9/44

Abstract:

The technology disclosed provides a novel and innovative technique for compact deployment of application code to stream processing systems. In particular, the technology disclosed relates to obviating the need of accompanying application code with its dependencies during deployment (i.e., creating fat jars) by operating a stream processing system within a container defined over worker nodes of whole machines and initializing the worker nodes with precompiled dependency libraries having precompiled classes. Accordingly, the application code is deployed to the container without its dependencies, and, once deployed, the application code is linked with the locally stored precompiled dependencies at runtime. In implementations, the application code is deployed to the container running the stream processing system between 300 milliseconds and 6 seconds. This is drastically faster than existing deployment techniques that take anywhere between 5 to 15 minutes for deployment.

US Patent:

20170083368, Mar 23, 2017

Filed:

Dec 31, 2015

Appl. No.:

14/986401

Inventors:

- San Francisco CA, US
Jeffrey Chao - San Francisco CA, US

Assignee:

salesforce.com, inc. - San Francisco CA

International Classification:

G06F 9/50
G06F 3/06

Abstract:

The technology disclosed relates to maintaining throughput of a stream processing framework while increasing processing load. In particular, it relates to defining a container over at least one worker node that has a plurality workers, with one worker utilizing a whole core within a worker node, and queuing data from one or more incoming near real-time (NRT) data streams in multiple pipelines that run in the container and have connections to at least one common resource external to the container. It further relates to concurrently executing the pipelines at a number of workers as batches, and limiting simultaneous connections to the common resource to the number of workers by providing a shared connection to a set of batches running on a same worker regardless of the pipelines to which the batches in the set belong.

US Patent:

20170083378, Mar 23, 2017

Filed:

Dec 31, 2015

Appl. No.:

14/986419

Inventors:

- SAN FRANCISCO CA, US
Jeffrey Chao - San Francisco CA, US

Assignee:

salesforce.com, inc. - SAN FRANCISCO CA

International Classification:

G06F 9/50
G06F 17/30

Abstract:

The technology disclosed relates to managing processing of long tail task sequences in a stream processing framework. In particular, it relates to operating a computing grid that includes a plurality of physical threads which processes data from one or more near real-time (NRT) data streams for multiple task sequences, and queuing data from the NRT data streams as batches in multiple pipelines using a grid-coordinator that controls dispatch of the batches to the physical threads. The method also includes assigning a priority-level to each of the pipelines using a grid-scheduler, wherein the grid-scheduler initiates execution of a first number of batches from a first pipeline before execution of a second number of batches from a second pipeline, responsive to respective priority levels of the first and second pipelines.

US Patent:

20170083380, Mar 23, 2017

Filed:

Jan 12, 2016

Appl. No.:

14/994131

Inventors:

- SAN FRANCISCO CA, US
Jeffrey Chao - San Francisco CA, US

Assignee:

salesforce.com, inc. - SAN FRANCISCO CA

International Classification:

G06F 9/50
G06F 9/52

Abstract:

The technology disclosed relates to managing resource allocation to task sequences in a stream processing framework. In particular, it relates to operating a computing grid that includes machine resources, with heterogeneous containers defined over whole machines and some containers including multiple machines. It also includes initially allocating multiple machines to a first container, initially allocating first set of stateful task sequences to the first container, running the first set of stateful task sequences as multiplexed units of work under control of a container-scheduler, where each unit of work for a first task sequence runs to completion on first machine resources in the first container, unless it overruns a time-out, before a next unit of work for a second task sequence runs multiplexed on the first machine resources. It further includes automatically modifying a number of machine resources and/or a number assigned task sequences to a container.