PARALLEL PROCESSING APPLICATIONS - A CASE STUDY ON DISTRIBUTED MEMORY PROGRAMMING WITH MPI Mayasarah binti Maslizan #1, Mohamed Faidz Mohamed Said #2 # Faculty of Computer & Mathematical Sciences, Universiti Teknologi MARA 70300 Seremban, Negeri Sembilan, MALAYSIA 1 sarahmaya95@gmail.com 2 faidzms@ieee.org Abstract—One of the types of parallel programming is distributed memory programming. It refers to a multiprocessor computer system. Each processor has its own private memory and not permitted to be accessed by any of the other tasks. Frequent and rapid data exchanges between the tasks are needed for most of the distributed memory programs. MPI is a communication process for programming parallel computers. The objective of the MPI is to be broadly used for writing message passing programs by generating a flexible, accessible, and efficient benchmark for message passing. MPI remains the vital model used in high-performance computing today. In this research paper, there are a few applications that use distributed memory programming and MPI with different types of models. Besides, the research paper also attempts to show the usage of the distributed memory programming with MPI. Results are then stated and the conclusion is obtained. Keywords: Distributed Memory, Message Passing Interface REFERENCES [1] J. A. Izaac and J. B. Wang, "pyCTQW: A continuous-time quantum walk simulator on distributed memory computers," Computer Physics Communications, vol. 186, pp. 81-92, 2015. [2] S. Jin, Y. Chen, D. Wu, R. Diao, and Z. H. Huang, "Implementation of Parallel Dynamic Simulation on Shared-Memory vs. Distributed-Memory Environments," IFAC-PapersOnLine, vol. 48, pp. 221-226, 2015. [3] P. Leggett, S. Johnson, and M. Cross, "CAPLib—a ‘thin layer’message passing library to support computational mechanics codes on distributed memory parallel systems," Advances in Engineering Software, vol. 32, pp. 61-83, 2001. [4] J. González-Domínguez, B. Remeseiro, and M. J. Martín, "Parallel definition of tear film maps on distributed-memory clusters for the support of dry eye diagnosis," Computer Methods and Programs in Biomedicine, vol. 139, pp. 51-60, 2017. [5] I. Foster and N. T. Karonis, "A grid-enabled MPI: Message passing in heterogeneous distributed computing systems," in Proceedings of the 1998 ACM/IEEE conference on Supercomputing, 1998, pp. 1-11. [6] K. R. Bisset, J. Chen, X. Feng, V. Kumar, and M. V. Marathe, "EpiFast: a fast algorithm for large scale realistic epidemic simulations on distributed memory systems," in Proceedings of the 23rd international conference on Supercomputing, 2009, pp. 430-439. [7] C. Yang, P. A. Penczek, A. Leith, F. J. Asturias, E. G. Ng, R. M. Glaeser, et al., "The parallelization of SPIDER on distributed-memory computers using MPI," Journal of structural biology, vol. 157, pp. 240-249, 2007. [8] B. Thomaszewski and W. Blochinger, "Physically based simulation of cloth on distributed memory architectures," Parallel Computing, vol. 33, pp. 377-390, 2007. [9] M. Alvioli and R. L. Baum, "Parallelization of the TRIGRS model for rainfall-induced landslides using the message passing interface," Environmental Modelling & Software, vol. 81, pp. 122-135, 2016. [10] M. Cole, "Bringing skeletons out of the closet: a pragmatic manifesto for skeletal parallel programming," Parallel computing, vol. 30, pp. 389-406, 2004. [11] P. B. Hansen, "An evaluation of the message-passing interface," ACM Sigplan Notices, vol. 33, pp. 65-72, 1998. [12] H. Sivaraj and G. Gopalakrishnan, "Random walk based heuristic algorithms for distributed memory model checking," Electronic Notes in Theoretical Computer Science, vol. 89, pp. 51-67, 2003. [13] D. Feng, A. N. Chernikov, and N. P. Chrisochoides, "A Hybrid Parallel Delaunay Image-to-Mesh Conversion Algorithm Scalable on Distributed-Memory Clusters," Procedia Engineering, vol. 163, pp. 59-71, 2016. [14] E. G. Pinho and F. H. de Carvalho, "An object-oriented parallel programming language for distributed-memory parallel computing platforms," Science of Computer Programming, vol. 80, pp. 65-90, 2014. [15] Maya, "https://www.youtube.com/watch?v=zGVGfmcudgE&rel=0."