The Liquid Model Load Balancing Method
- Load balancing is one of the central problems that have to be solved in parallel computation. Here, the problem of distributed, dynamic load balancing for massive parallelism is addressed. A new local method, which realizes a physical analogy to equilibrating liquids in multi-dimensional tori or hypercubes, is presented. It is especially suited for communication mechanisms with low set-up to transfer ratio occurring in tightly-coupled or SIMD systems. By successive shifting single load elements to the direct neighbors, the load is automatically transferred to lightly loaded processors. Compared to former methods, the proposed Liquid model has two main advantages. First, the task of load sharing is combined with the task of load balancing, where the former has priority. This property is valuable in many applications and important for highly dynamic load distribution. Second, the Liquid model has high efficiency. Asymptotically, it needs O(D . K . Ldiff ) load transfers to reach the balanced state in a D-dimensional torus with K processors per dimension and a maximum initial load difference of Ldiff . The Liquid model clearly outperforms an earlier load balancing approach, the nearest-neighbor-averaging. Besides a survey of related research, analytical results within a formal framework are derived. These results are validated by worst-case simulations in one-and two-dimensional tori with up to two thousand processors.
Author: | Dominik Henrich |
---|---|
URN: | urn:nbn:de:hbz:386-kluedo-9843 |
Document Type: | Article |
Language of publication: | English |
Year of Completion: | 1996 |
Year of first Publication: | 1996 |
Publishing Institution: | Technische Universität Kaiserslautern |
Date of the Publication (Server): | 2000/05/25 |
Tag: | AG-RESY; LOADBAL; distributed computing; hypercubes; load balancing; load sharing; parallel algorithms; rings; tori |
Faculties / Organisational entities: | Kaiserslautern - Fachbereich Informatik |
DDC-Cassification: | 0 Allgemeines, Informatik, Informationswissenschaft / 004 Informatik |
Collections: | AG RESY |
Licence (German): | Standard gemäß KLUEDO-Leitlinien vor dem 27.05.2011 |