high performance computing on graphics processing units: hgpu.org

The proverb above describes the essence of this paper and the motivation behind the development of our Interactive Parallelization Tool (IPT) that can transform serial applications into multiple parallel variants. The end-users of the IPT are required to develop an understanding about the basic concepts involved in parallel programming (viz. concurrency, data distribution and data gathering). After developing an understanding of the basic parallel programming concepts, the IPT can be used by its target audience (domain-experts and students) to semi-automatically generate parallel programs based on multiple parallel programming paradigms (MPI, OpenMP, and CUDA) and learn about these paradigms through observation and comparison. This IPT-based personalized learning approach complements the traditional methods of learning and training that usually emphasize the syntax and semantics of one or more programming standards. The main benefit of IPT is that it provides a jumpstart to the domain-experts in using modern HPC platforms for their research and development needs, and hence in lowering the adoption barriers to HPC.