Parallel system performance prediction and tuning

Reseach leader:Dvořák Václav
Team members:Čejka Rudolf, Kutálek Vladimír, Očenášek Jiří, Schwarz Josef, Staroba Jiří
Agency:Czech Science Foundation
Code:GA102/02/0503
Start:2002-01-01
End:2004-12-31
Keywords:Parallel processing, simulation of parallel computing, performance prediction, performance tuning
Annotation:
The goal of the project is the development of performance prediction techniques for parallel systems of all  kinds and tuning the performance of parallel applications running on real machines. Prediction techniques are to be developed both for message passing as well as shared memory architectures and built upon the calculus of communicating sequential processes (CSP), which yields the most concise description if compared to other tools (like Petri nets, CCS, communicating X-machines, etc.). The project aims at utilization of CSP-based simulation tool Transim used world-wide in the widest possible spectrum of real and realistic SW/HW architectures. The main results are expected in performance prediction and tuning in digital signal and image processing, discrete optimization, and in solution of large dense and sparse systems of linear equations. Parallel platforms relevant for this project are clusters of  workstations and PCs, symmetrical multiprocessors SMP and DSP-based embedded parallel systems including chip multiprocessors and complete Systems on Chip (SoC). Prediction-based  performance  tuning will lead to the fast comparison of various multiprocessor HW/SW architectures  and promising alternatives will then be coded (in MPI or OpenMP for portability) and put under the real test . The project will also address  a difficult issue of fair performance comparison of entirely different parallel systems, methods of load balancing, and reduction of communication and synchronization overhead.

Related projects

1999Research in information and control systems, CEZ MŠMT, MSM 262200012, 1999-2004, completed
Research leader: Honzík Jan M.
Team leaders: Češka Milan, Zendulka Jaroslav, Zezulka František

Publications

2005OHLÍDAL Miloš and SCHWARZ Josef. Design of Group Communication for Regular and Irregular Networks. In: Mendel 2005 11th Internacional Conference on Soft Computing. Brno: Faculty of Mechanical Engineering BUT, 2005, pp. 45-50. ISBN 80-214-2961-5.
 OHLÍDAL Miloš. Plánování skupinových komunikací v propojovacích sítích. In: Sborník příspěvků ze semináře Počítačové Architektury a Diagnostika. Praha: Faculty of Electrical Engineering, Czech Technical University, 2005, pp. 129-134. ISBN 80-01-03298-1.
2004DVOŘÁK Václav and ŠVÉDA Miroslav, ed. Proceedings of the International IEEE Conference and Workshop ECBS'2004. Los Alamitos, CA: IEEE Computer Society, 2004. ISBN 0-7695-2125-8.
 DVOŘÁK Václav. Formal Specifications of an Extended Phase-Parallel Model of Stream Processing. In: Proc. of Joint Workshop on Formal Specifications of Computer-Based Systems. Stirling: University of Stirling, 2004, pp. 37-44. ISBN 1-85769-1970.
 DVOŘÁK Václav. Optimizing Communication Architectures for Parallel Embedded Systems. Design of Embedded Control Systems. Berlin: Springer Verlag, 2004, pp. 225-234. ISBN 0-387-23630-9.
 DVOŘÁK Václav. Architektury a programování paralelních systémů. Brno: Publishing house of Brno University of Technology VUTIUM, 2004. ISBN 80-214-2608-X.
 DVOŘÁK Václav, ŠVÉDA Miroslav, RATTRAY Charles and ROZENBLIT Jerzy. Formal Specifications of Computer-Based Systems - J.UCS Special Issue. Journal of Universal Computer Science. 2004, vol. 9, no. 11, pp. 1258-1260. ISSN 0948-6968.
 GAŽAR Roman. Neural Network Training using Genetic Algorithm. In: Mendel 2004 10th Internacional Conference on Soft Computing. Brno: Faculty of Mechanical Engineering BUT, 2004, pp. 161-166. ISBN 80-214-2676-4.
 JAROŠ Jiří and SCHWARZ Josef. Development tools for rapid prototyping of evolutionary algorithms. In: Proceedings of 38th International conference MOSIS'04. Rožnov pod Radhoštěm, 2004, pp. 97-104. ISBN 80-85988-98-4.
 JAROŠ Jiří. Úloha plánování procesů na paralelním multiprocesorovém systému pomocí bayesovských optimalizačních algoritmů. In: Zborník príspevkov ze seminara Počítačové Architektury a Diagnostika. Bratislava: Slovak University of Technology in Bratislava, 2004, pp. 60-65. ISBN 80-969202-0-0.
 JAROŠ Jiří. Vývojové prostředky pro rychlé prototypování genetických algoritmů. Brno: Czech Science Foundation, 2004.
 KUTÁLEK Vladimír. Modelování a predikce výkonnosti aplikačně-specifických multiprocesorových systémů. In: Počítačové architektúry & diagnostika PAD 2004. Bratislava: Slovak Academy of Science, 2004, pp. 132-137. ISBN 80-969202-0-0.
 OHLÍDAL Miloš and SCHWARZ Josef. HYBRID PARALLEL SIMULATED ANNEALING USING GENETIC OPERATIONS. In: Mendel 2004 10th Internacional Conference on Soft Computing. Brno: Faculty of Mechanical Engineering BUT, 2004, pp. 89-94. ISBN 80-214-2676-4.
 OHLÍDAL Miloš and SCHWARZ Josef. Parallel Simulated Annealing Applied to the Traveling Salesman Problem. In: Proceedings of 38th International conference MOSIS'04. Rožnov pod Radhoštěm, 2004, pp. 155-162. ISBN 80-85988-98-4.
 OHLÍDAL Miloš. Hybrid parallel simulated annealing using genetic operations. In: Zborník príspevkov ze seminara Počítačové Architektury a Diagnostika. Bratislava: Slovak Academy of Science, 2004, pp. 48-53. ISBN 80-969202-0-0.
 SCHWARZ Josef and JAROŠ Jiří. A PROBLEM KNOWLEDGE BASED BAYESIAN OPTIMIZATION ALGORITHM APPLIED IN MULTIPROCESSOR SCHEDULING. In: Mendel Conference on Soft Computing. Brno: Faculty of Mechanical Engineering BUT, 2004, pp. 83-88. ISBN 80-214-2676-4.
 SCHWARZ Josef, OČENÁŠEK Jiří and JAROŠ Jiří. Advanced Bayesian Optimization Algorithms Applied in Decomposition Problems. In: Proceedings of ECBS 2004. Los Alamitos: IEEE Computer Society, 2004, pp. 102-111. ISBN 0-7695-2125-8.
 STAROBA Jiří and DVOŘÁK Václav. Design of Low-Cost Communication Algorithms for Irregular Networks. In: Proceedings of the 3rd International Conference on Networking ICN '04. Colmar: University of Haute Alsace, 2004, pp. 980-985. ISBN 0-86341-325-0.
2003DVOŘÁK Václav and KUTÁLEK Vladimír. A Methodology for Designing Communication Architectures for Multiprocessor SoCs. In: Proceedings EUROMICRO Symposium on Digital System Design - Architectures, Methods and Tools DSD 2003. Belek: IEEE Computer Society, 2003, pp. 455-458. ISBN 0-7695-2003-0.
 DVOŘÁK Václav. Communication Architectures for Application-Specific Multiprocessor Systems (on a Chip). In: Proc. of the 11th International Conference on Software, Telecommunications and Computer Networks SoftCOM 2003. Split: Faculty of Electrical Engineering, Mechanical Engineering and Naval Architecture, 2003, pp. 778-782. ISBN 953-6114-64-X.
 KUTÁLEK Vladimír and DVOŘÁK Václav. A multi-protocol cache controller. In: IFAC Workshop on Programmable devices and systems - PDS 2003. Ostrava: VŠB - Technical University of Ostrava, 2003, pp. 220-225. ISBN 0-08-044130-0.
 KUTÁLEK Vladimír and DVOŘÁK Václav. Tuning Parallel Performance of Global Image Processing Operators. In: Proceedings of 37th International Conference MOSIS´03 Modelling and Simulation of Systems. Ostrava, 2003, pp. 57-64. ISBN 80-85988-86-0.
 KUTÁLEK Vladimír. Modelování a predikce výkonnosti aplikačně-specifických multiprocesorových systémů. In: Počítačové Architektury & Diagnostika Pracovní seminář pro studenty doktorského studia Sborník příspěvků. Brno: Faculty of Information Technology BUT, 2003, pp. 67-72. ISBN 80-214-2471-0.
 OČENÁŠEK Jiří, SCHWARZ Josef and PELIKÁN Martin. Design of Multithreaded Estimation of Distribution Algorithms. In: Procceedings of GECCO 2003, USA. Chicago: Kluwer Verlag, 2003, pp. 1247-1258. ISBN 3-540-40-603-4.
 SCHWARZ Josef and OČENÁŠEK Jiří. ACCELERATED BAYESIAN OPTIMIZATION ALGORITHMS FOR ADVANCED HYPERGRAPH PARTITIONING, accepted paper. In: Procceedings of MENDEL 2003. Brno: Faculty of Mechanical Engineering BUT, 2003, pp. 133-141. ISBN 80-214-2411-7.
 SCHWARZ Josef. Bayesovské evoluční algoritmy s aplikacemi v úlohách dekompozice a alokace, zkrácená verze habilitační práce. Vědecké spisy VUT. Brno: Publishing house of Brno University of Technology VUTIUM, 2003, pp. 1-32. ISBN 80-214-2389-7.
 SCHWARZ Josef. Bayesovské evoluční algoritmy s aplikacemi v úlohách dekompozice a alokace, habilitační práce. Brno: Faculty of Information Technology BUT, 2003.
 STAROBA Jiří and DVOŘÁK Václav. Genetic Algorithm Optimization of Group Communications. In: 9th International Conference on Soft Computing Mendel 2003. Brno: Faculty of Mechanical Engineering BUT, 2003, pp. 47-52. ISBN 80-214-2411-7.
2002ČEJKA Rudolf, DVOŘÁK Václav and STAROBA Jiří. Predicting performance of SMP clusters. Distributed and Parallel Systems - Cluster and Grid Computing. Boston/London: Kluwer Academic Publishers, 2002, pp. 38-45. ISBN 1-4020-7209-0.
 DVOŘÁK Václav and STAROBA Jiří. Design Space Exploration of Parallel Embedded Applications Based on Performance-Oriented Specifications. In: Proceedings of the Joint Workshop on Formal Specifications of Computer-Based Systems. Stirling: University of Stirling, 2002, pp. 71-75. ISBN 1-85769-169-5.
 DVOŘÁK Václav. Executable System-Level Specifications of HW/SW Architecture for Embedded Multiprocessor Systems. In: Proceedings of the Joint Workshop on Formal Specifications of Computer-Based Systems, 2002. Stirling: University of Stirling, 2002, pp. 65-70. ISBN 1-85769-169-5.
 DVOŘÁK Václav. Simulation and Prototyping in Teaching Parallel Architectures, Algorithms, and Programming Models. In: Proceedings of the International Conference on Parallel and Distributed Processing Techniques and Applications. Las Vegas, Nevada: Computer Science Research, Education, and Applications Press, 2002, pp. 934-940. ISBN 1-892512-88-2.
 KUTÁLEK Vladimír and DVOŘÁK Václav. Prototyping Parallel Applications Based on Divide and Conquer Strategy. In: Proceedings of 36th International Conference MOSIS '02 Modelling and Simulation of Systems. Ostrava, 2002, pp. 313-320. ISBN 80-85988-71-2.
 KUTÁLEK Vladimír and DVOŘÁK Václav. Simulation and Prototyping Multiprocessor SoC with Hybrid Pipeline/Farm Architecture. In: Proceedings of IEEE Design and Diagnostics of Electronic Circuits and System Workshop. Brno: Faculty of Information Technology BUT, 2002, pp. 296-299. ISBN 80-214-2094-4.
 LAUMANNS Marco and OČENÁŠEK Jiří. Bayesian Optimization Algorithms for Multi-Objective Optimization. Lecture Notes in Computer Science. 2002, vol. 2002, no. 2439, pp. 298-307. ISBN 3-540-444139-5. ISSN 0302-9743.
 SCHWARZ Josef and OČENÁŠEK Jiří. Bayes-Dirichlet BDD as a probabilistic model for logic functions and evolutionary circuit decomposer. In: Mendel 2002. Brno: Faculty of Mechanical Engineering BUT, 2002, pp. 117-124. ISBN 80-214-2135-5.
 SCHWARZ Josef and OČENÁŠEK Jiří. Ratio cut hypergraph partitioning using BDD based MBOA optimization algorithm. In: Proceedings of IEEE Design and Diagnostics of Electronic Circuits and Systems Workshop. Brno: Faculty of Informatics and Information Technology Slovak University of Technology in Bratislava, 2002, pp. 87-96. ISBN 80-214-2094-4.
 STAROBA Jiří and DVOŘÁK Václav. Parallel Linear Equations Solvers for Scientific Simulation: Cluster and SMP Experience. In: Proceedings of XXIVth International Autumn Colloquium ASIS'02 Advanced Simulation of Systems. Ostrava, 2002, pp. 225-230. ISBN 80-85988-77-1.

Your IPv4 address: 54.166.150.10
Switch to IPv6 connection

DNSSEC [dnssec]