Distributed Edge Machine Learning Pipeline Scheduling with Reverse Auctions

Authors

Connor Imes, Information Sciences Institute, University of Southern California
David W. King, Air Force Institute of TechnologyFollow
John Paul Walters, Information Sciences Institute, University of Southern California

Document Type

Conference Proceeding

Publication Date

9-2023

Abstract

Scheduling distributed machine learning pipelines in edge environments is a growing area of research as developers work to bring large, high-accuracy models to relatively low-powered devices. Edge environment dynamics, such as device availability and connectivity, make distributed scheduling a more challenging problem than in traditional cloud environments. Existing approaches usually require significant a priori knowledge of the environment and make assumptions about model availability, both of which are impractical in real edge deployments. We address this problem by proposing a simple and efficient reverse auction algorithm, where a device that wants to distribute a large machine learning workload requests bids from available resources in the environment to construct connected pipelines. We implement our reverse auction scheduling on an existing distributed machine learning pipeline framework and perform an empirical evaluation using a real distributed edge computing testbed. We prove that scheduling distributed pipelines without repeating devices is an NP-complete problem, but that finding good latency or throughput pipelines is tractable for fixed device orderings. Abstract ©2023 IEEE.

Comments

Copyright © 2023 by the Institute of Electrical and Electronics Engineers, Inc. All rights reserved.

Abstract shared by permission found on copyright page of proceedings.

This conference paper is available to IEEE digital subscribers via the DOI link below. Additional authentication may be required for access to your IEEE subscription.

Current AFIT faculty, students and staff may access the paper by clicking here.

Funding note: This work was supported by the Department of Navy, Office of Naval Research.

DOI

10.1109/FMEC59375.2023.10306169

Source Publication

2023 Eighth International Conference on Fog and Mobile Edge Computing (FMEC)

Recommended Citation

C. Imes, D. W. King and J. P. Walters, "Distributed Edge Machine Learning Pipeline Scheduling with Reverse Auctions," 2023 Eighth International Conference on Fog and Mobile Edge Computing (FMEC), Tartu, Estonia, 2023, pp. 196-203, doi: 10.1109/FMEC59375.2023.10306169.