TY - GEN
T1 - Distributed Computing with the Cloud
AU - Afek, Yehuda
AU - Giladi, Gal
AU - Patt-Shamir, Boaz
N1 - Publisher Copyright: © 2021, Springer Nature Switzerland AG.
PY - 2021
Y1 - 2021
N2 - Motivated by cloud storage (à la Dropbox, Google Drive, etc.), we investigate distributed computing in message passing networks that contain a passive node that can only store and share data, and does not carry out any computations. Using basic primitives of collaborative transmission of a file from and to the cloud, we implement more complex tasks where the goal is to combine input values: e.g., each node holds a vector (or a matrix) as input and the sum (or product) of all the inputs should be stored in the cloud. We present near-optimal algorithms for these tasks. Finally we consider applications such as federated learning and file deduplication in this new model. Our results show that utilizing both node-cloud and node-node communication links can substantially speed up computation with respect to systems where processors communicate either only through the cloud or only through the network links.
AB - Motivated by cloud storage (à la Dropbox, Google Drive, etc.), we investigate distributed computing in message passing networks that contain a passive node that can only store and share data, and does not carry out any computations. Using basic primitives of collaborative transmission of a file from and to the cloud, we implement more complex tasks where the goal is to combine input values: e.g., each node holds a vector (or a matrix) as input and the sum (or product) of all the inputs should be stored in the cloud. We present near-optimal algorithms for these tasks. Finally we consider applications such as federated learning and file deduplication in this new model. Our results show that utilizing both node-cloud and node-node communication links can substantially speed up computation with respect to systems where processors communicate either only through the cloud or only through the network links.
UR - http://www.scopus.com/inward/record.url?scp=85119852148&partnerID=8YFLogxK
U2 - https://doi.org/10.1007/978-3-030-91081-5_1
DO - https://doi.org/10.1007/978-3-030-91081-5_1
M3 - منشور من مؤتمر
SN - 9783030910808
T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
SP - 1
EP - 20
BT - Stabilization, Safety, and Security of Distributed Systems - 23rd International Symposium, SSS 2021, Proceedings
A2 - Johnen, Colette
A2 - Schiller, Elad Michael
A2 - Schmid, Stefan
PB - Springer Science and Business Media Deutschland GmbH
T2 - 23rd International Symposium on Stabilization, Safety, and Security of Distributed Systems, SSS 2021
Y2 - 17 November 2021 through 20 November 2021
ER -