An fpga-as-a-service system for accelerated serverless computing
Data di pubblicazione
Data di priorità
European and PCT Patent Application process
Politecnico di Milano
Department of Electronics, Information and Bioengineering
Santambrogio Marco, Brondolin Rolando, Bacis Marco
The present invention proposes a hardware accelerators management system for containerized and serverless environments. The system at least comprises a domain layer on which a plurality of application containers and functions are implemented, a hardware layer in which a set of hardware accelerators are implemented and a software layer configured for abstracting the application containers and the functions of the domain layer from the hardware layer, wherein the system comprises a hardware interface to send tasks to and reconfigure at least a portion of the processing means implemented in the hardware layer. The system also comprises a software structure that shares hardware accelerators of the hardware layer between application containers and functions of the domain layer. Advantageously, the software structure performs scheduling and optimization algorithms on the resource allocations of the hardware accelerators of the hardware layer for the application containers and functions of the domain layer in terms of device time and/or space slot of utilization. In detail, the scheduling and optimization algorithms comprises a monitoring structure interfacing with processing means and with the software layer for reading performance metrics of at least one processing means. Advantageously, the software structure comprises at least one device manager component connected with the hardware interface and at least one remote library component to interface each application container and function with the at least one device manager component concurrently.