Toward Efficient Transparent Computing for IoT Apps by On-Chip Kernel Offload

Abstract

Graphics processing units (GPUs) have of late enjoyed increased popularity as a general purpose computing accelerator in multiple application domains like artificial intelligence. However, there has been little exploration into the performance and energy optimization GPUs can deliver for increasingly popular but heavy burden on transparent computing for Internet-of-Things (IoT), such as deep-inference tasks under energy-constrained scenarios. This paper presents FuncShare, an extension of the capability of dynamic functional connectivity among IoT to cross-device hand over identified computation-intensive functional codes at runtime. As a kernel-level offloading solution, FuncShare now enables unmodified Android and Linux-based transparent computing applications (apps) to utilize not only application functionalities but also system functionalities across devices, as if they were to utilize them inside the same OpenCL or CUDA libraries. Toward secure network connection, FuncShare also allows performing of permission checks for remote apps in the same method as for local. Experimental results show that FuncShare enables transparent cross-device sharing for power-hungry functionalities and benefits significant performance enhancing than within-device processing even if a large amount of data is transferred.