Network Traffic Characteristics of Machine Learning Frameworks Under the Microscope

AutorZerwas, Johannes; Aykurt, Kaan; Schmid, Stefan; Blenk, Andreas
ArtConference Paper
AbstraktHigh computational demands of complex deep learning models led to workload distribution across multiple machines. Many frameworks for distributed machine learning (DML) have been developed and are employed in practice for orchestrating workload distribution. In this paper, we analyze and compare network behaviors of three widely used state-of-the-art DML frameworks. The study reveals that traffic can largely vary across the frameworks. While some frameworks exhibit well predictable patterns, others are less structured. We further explore whether and how it is possible to relate the network traffic to the DML jobs' attributes, and present a multiple linear regression model accordingly. Our results can inform the networking community about traffic characteristics and contribute toward the generation of realistic DML traffic for simulation studies.
KonferenzInternational Conference on Network and Service Management (CNSM) <17, 2021, Online>
ReferenzChemouil, P.: 17th International Conference on Network and Service Management, CNSM 2021. Proceedings: Smart Management for Future Networks and Services, October 25-29, 2021, Izmir, Turkey, Virtual. Piscataway, NJ: IEEE, 2021, pp. 207-215
SchlüsselISBN : 9781665424578