Putting Data Science Pipelines on the Edge

Ali Akoglu, Genoveva Vargas-Solar

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

This paper proposes a composable “Just in Time Architecture” for Data Science (DS) Pipelines named JITA-4DS and associated resource management techniques for configuring disaggregated data centers (DCs). DCs under our approach are composable based on vertical integration of the application, middleware/operating system, and hardware layers customized dynamically to meet application Service Level Objectives (SLO - application-aware management). Thereby, pipelines utilize a set of flexible building blocks that can be dynamically and automatically assembled and re-assembled to meet the dynamic changes in the workload’s SLOs. To assess disaggregated DC’s, we study how to model and validate their performance in large-scale settings.

Original languageEnglish (US)
Title of host publicationICWE 2021 Workshops - ICWE 2021 International Workshops, BECS and Invited Papers, 2021, Revised Selected Papers
EditorsMaxim Bakaev, In-Young Ko, Michael Mrissa, Michael Mrissa, Cesare Pautasso, Abhishek Srivastava
PublisherSpringer Science and Business Media Deutschland GmbH
Pages3-14
Number of pages12
ISBN (Print)9783030922306
DOIs
StatePublished - 2022
Externally publishedYes
Event1st International Workshop on Big data-driven Edge Cloud Services, BECS 2021 held in conjunction with 21st International Conference on Web Engineering, ICWE 2021 - Virtual, Online
Duration: May 18 2021May 21 2021

Publication series

NameCommunications in Computer and Information Science
Volume1508 CCIS
ISSN (Print)1865-0929
ISSN (Electronic)1865-0937

Conference

Conference1st International Workshop on Big data-driven Edge Cloud Services, BECS 2021 held in conjunction with 21st International Conference on Web Engineering, ICWE 2021
CityVirtual, Online
Period5/18/215/21/21

Keywords

  • Data science pipelines
  • Disaggregated data centers
  • Edge computing

ASJC Scopus subject areas

  • Computer Science(all)
  • Mathematics(all)

Fingerprint

Dive into the research topics of 'Putting Data Science Pipelines on the Edge'. Together they form a unique fingerprint.

Cite this