David A Hawkins

US Patent:

20180150542, May 31, 2018

Filed:

Nov 28, 2016

Appl. No.:

15/362688

Inventors:

- Redwood Shores CA, US
SAM IDICULA - Santa Clara CA, US
ERIK SCHLANGER - Austin TX, US
RISHABH JAIN - Austin TX, US
MICHAEL DULLER - San Francisco CA, US
CHRISTOPHER JOSEPH DANIELS - Cedar Park TX, US
DAVID JOSEPH HAWKINS - Austin TX, US

International Classification:

G06F 17/30
G06F 3/06

Abstract:

Techniques provide for hardware accelerated data movement between main memory and an on-chip data movement system that comprises multiple core processors that operate on the tabular data. The tabular data is moved to or from the scratch pad memories of the core processors. While the data is in-flight, the data may be manipulated by data manipulation operations. The data movement system includes multiple data movement engines, each dedicated to moving and transforming tabular data from main memory data to a subset of the core processors. Each data movement engine is coupled to an internal memory that stores data (e.g. a bit vector) that dictates how data manipulation operations are performed on tabular data moved from a main memory to the memories of a core processor, or to and from other memories. The internal memory of each data movement engine is private to the data movement engine. Tabular data is efficiently copied between internal memories of the data movement system via a copy ring that is coupled to the internal memories of the data movement system and/or is coupled to a data movement engine. Also, a data movement engine internally broadcasts data to other data movement engines, which then transfer the data to respective core processors. Partitioning may also be performed by the hardware of the data movement system. Techniques are used to partition data “in flight”. The data movement system also generates a column of row identifiers (RIDs). A row identifier is a number treated as identifying a row or element's position within a column. Row identifiers each identifying a row in column are also generated.