*Result*: Role-shifting threads: Increasing OpenMP malleability to address load imbalance at MPI and OpenMP

Title:
Role-shifting threads: Increasing OpenMP malleability to address load imbalance at MPI and OpenMP
Contributors:
Barcelona Supercomputing Center
Publisher Information:
SAGE Publications
Publication Year:
2023
Collection:
Universitat Politècnica de Catalunya, BarcelonaTech: UPCommons - Global access to UPC knowledge
Document Type:
*Academic Journal* article in journal/newspaper
File Description:
10 p.; application/pdf
Language:
English
Relation:
info:eu-repo/grantAgreement/EC/FP7/287530/EU/Dynamical Exascale Entry Platform/DEEP; info:eu-repo/grantAgreement/EC/FP7/610476/EU/DEEP Extended Reach/DEEP-ER; info:eu-repo/grantAgreement/EC/H2020/754304/EU/DEEP/DEEP-EST; info:eu-repo/grantAgreement/EC/H2020/955606/EU/DEEP – SOFTWARE FOR EXASCALE ARCHITECTURES/DEEP-SEA; info:eu-repo/grantAgreement/AEI/Plan Estatal de Investigación Científica y Técnica y de Innovación 2017-2020/PID2019-107255GB-C22/ES/UPC-COMPUTACION DE ALTAS PRESTACIONES VIII/; https://hdl.handle.net/2117/396655
Rights:
Open Access
Accession Number:
edsbas.F53DB09B
Database:
BASE

*Further Information*

*This paper presents the evolution of the free agent threads for OpenMP to the new role-shifting threads model and their integration with the Dynamic Load Balancing (DLB) library. We demonstrate how free agent threads can improve resource utilization in OpenMP applications with load imbalance in their nested parallel regions. We also demonstrate how DLB efficiently manages the malleability exposed by the role-shifting threads to address load imbalance issues. We use three real-world scientific applications, one of them to demonstrate that free agents alone can improve the OpenMP model without external tools, and two other MPI+OpenMP applications, one of them with a coupling case, to illustrate the potential of the free agent threads’ malleability with an external resource manager to increase the efficiency of the system. In addition, we demonstrate that the new implementation is more usable than the former one, letting the runtime system automatically make decisions that were made by the programmer previously. All software is released open-source. ; This work has received funding from the DEEP Projects, at the European Commission’s FP7, H2020, and EuroHPC Programmes, under Grant Agreements 287530, 610476, 754304, and 955606. The PCI2021-121958 financed by the Spanish State Research Agency - Ministry of Science and Innovation. And it also has the support of the Spanish Ministry of Science and Innovation (Computacion de Altas Prestaciones VIII: PID2019-107255GB). ; Peer Reviewed ; Postprint (author's final draft)*