Contention-aware Performance Modeling for Heterogeneous Edge and Cloud Systems

Ismet Dagli, Andrew Depke, Andrew Mueller, Md Sahil Hassan, Ali Akoglu, Mehmet Esat Belviranli

Research output: Chapter in Book/Report/Conference proceedingConference contribution

1 Scopus citations

Abstract

Diversely Heterogeneous System-on-Chips (DH-SoC) are increasingly popular computing platforms in many fields, such as autonomous driving and AR/VR applications, due to their ability to effectively balance performance and energy efficiency. Having multiple target accelerators for multiple concurrent workloads requires a careful runtime analysis of scheduling. In this study, we examine a scenario that mandates several concerns to be carefully addressed: 1) exploring the mapping of various workloads to heterogeneous accelerators to optimize the system for better performance, 2) analyzing data from the physical world in runtime to minimize the response time of the system 3) accurately estimating the resource contention by workloads during runtime since there will be con- current operations running under the same die, and 4) deferring the operation to the cloud for computationally more demanding operations such as continuous learning or real-time rendering, de- pending on the complexity of the computation. We demonstrate our analysis and approach on a VR project as a case study by using NVIDIA Xavier NX Edge DH-SoC and a server equipped with NVIDIA GeForce RTX 3080 GPU and AMD EPYC 7402 CPU.

Original languageEnglish (US)
Title of host publicationFRAME 2023 - Proceedings of the 3rd Workshop on Flexible Resource and Application Management on the Edge
PublisherAssociation for Computing Machinery, Inc
Pages27-31
Number of pages5
ISBN (Electronic)9798400701641
DOIs
StatePublished - Aug 14 2023
Externally publishedYes
Event3rd Workshop on Flexible Resource and Application Management on the Edge, FRAME 2023, held in conjunction with the HPDC 2023 and the FCRC 2023 Conferences - Orlando, United States
Duration: Jun 20 2023 → …

Publication series

NameFRAME 2023 - Proceedings of the 3rd Workshop on Flexible Resource and Application Management on the Edge

Conference

Conference3rd Workshop on Flexible Resource and Application Management on the Edge, FRAME 2023, held in conjunction with the HPDC 2023 and the FCRC 2023 Conferences
Country/TerritoryUnited States
CityOrlando
Period6/20/23 → …

Keywords

  • edge-cloud systems
  • heterogeneous accelerators
  • performance modeling

ASJC Scopus subject areas

  • Artificial Intelligence
  • Computer Networks and Communications
  • Software
  • Information Systems and Management

Cite this