Kenneth Mc Daniel

US Patent:

20190155660, May 23, 2019

Filed:

Sep 19, 2018

Appl. No.:

16/136075

Inventors:

- Seattle WA, US
Kenneth F. Daniel - Seattle WA, US
James F. Athappilly - Seattle WA, US
Ahmet Besir Kurtulmus - Seattle WA, US
James Joseph Sutton - Halifax, CA
Diego M. Oppenheimer - Seattle WA, US

International Classification:

G06F 9/50
G06F 9/48
G06F 9/54
G06T 1/20
G06F 9/455

Abstract:

The technology includes methods, processes, and systems for virtualizing graphic processing unit (GPU) memory. Example embodiments of the technology include managing an amount of GPU memory used by one or more processes, such as Application Programming Interfaces (APIs), that directly or indirectly impact one or more other processes running on the same GPU. Managing and/or virtualizing the amount of GPU memory may ensure that an end user does not receive a GPU out-of-memory error because the API request is impacted by the processing of other API requests. A virtual machine with access to a GPU may be organized with one or more job slots that are configured to specify the number of processes that are able to run concurrently on a specific virtual machine. A process may be configured on each virtual machine running a software program or API and is used to schedule work based on GPU memory requirements.