high performance computing on graphics processing units: hgpu.org

hgpu.org » OpenMP

Comparing Llama-2 and GPT-3 LLMs for HPC kernels generation

Pedro Valero-Lara, Alexis Huante, Mustafa Al Lail, William F. Godoy, Keita Teranishi, Prasanna Balaprakash, Jeffrey S. Vetter

View

Download (PDF)

Source codes

Tags: Code generation, Computer science, CUDA, Deep learning, Fortran, HIP, HPC, nVidia, OpenACC, OpenMP, Package, Python

September 17, 2023 by hgpu

Scope is all you need: Transforming LLMs for HPC Code

Tal Kadosh, Niranjan Hasabnis, Vy A. Vo, Nadav Schneider, Neva Krien, Abdul Wasay, Nesreen Ahmed, Ted Willke, Guy Tamir, Yuval Pinter, Timothy Mattson, Gal Oren

View

Download (PDF)

Source codes

Tags: Code generation, Computer science, Deep learning, HPC, nVidia, nVidia A40, nVidia H100, OpenMP, Package

September 6, 2023 by hgpu

HPAC-Offload: Accelerating HPC Applications with Portable Approximate Computing on the GPU

Zane Fink, Konstantinos Parasyris, Giorgis Georgakoudis, Harshitha Menon

View

Download (PDF)

Source codes

Tags: AMD Radeon Instinct MI250X, ATI, Code generation, Computer science, HPC, LLVM, nVidia, nVidia V100, OpenMP, Package

September 6, 2023 by hgpu

Compute units in OpenMP: Extensions for heterogeneous parallel programming

Marc Gonzàlez-Tallada, Enric Morancho

View

Download (PDF)

Tags: AMD Radeon Instinct Mi50, ATI, Benchmarking, Computer science, Heterogeneous systems, OpenMP, Task scheduling

August 28, 2023 by hgpu

Mashing load balancing algorithm to boost hybrid kernels in molecular dynamics simulations

Raúl Nozal, Jose Luis Bosque

View

Download (PDF)

Source codes

Tags: AMD Radeon RX 5700 XT, ATI, Computer science, Heterogeneous systems, HPC, Molecular dynamics, OpenCL, OpenMP, Package, performance portability

August 28, 2023 by hgpu

Quantifying OpenMP: Statistical Insights into Usage and Adoption

Tal Kadosh, Niranjan Hasabnis, Timothy Mattson, Yuval Pinter, Gal Oren

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, Databases, Fortran, HPC, MPI, nVidia, OpenACC, OpenCL, OpenMP, Package, SYCL

August 20, 2023 by hgpu

Generating Parallel OpenCL and OpenMP Programs from Dataflow Graphs

Evelyn Borth

View

Download (PDF)

Tags: Benchmarking, Code generation, Computer science, OpenCL, OpenMP, Thesis

August 20, 2023 by hgpu

A portable C++ library for memory and compute abstraction on multi-core CPUs and GPUs

Pietro Incardona, Aryaman Gupta, Serhii Yaskovets, Ivo F. Sbalzarini

View

Download (PDF)

Source codes

Tags: AMD RX Vega 64, ATI, Computer science, CUDA, nVidia, nVidia A100, nVidia GeForce RTX 3090, OpenACC, OpenCL, OpenMP, Package, Performance, performance portability, SYCL

July 30, 2023 by hgpu

Creating a Dataset Supporting Translation Between OpenMP Fortran and C++ Code

Bin Lei, Caiwen Ding, Le Chen, Pei-Hung Lin, Chunhua Liao

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, Fortran, Machine learning, nVidia, nVidia RTX 6000 Ada, OpenMP, Package

July 24, 2023 by hgpu

Maximizing Parallelism and GPU Utilization For Direct GPU Compilation Through Ensemble Execution

Shilei Tian, Barbara Chapman, Johannes Doerfert

View

Download (PDF)

Tags: Benchmarking, Computer science, CUDA, LLVM, nVidia, nVidia A100, OpenMP, Performance

July 24, 2023 by hgpu

Modeling Parallel Programs using Large Language Models

Daniel Nichols, Aniruddha Marathe, Harshitha Menon, Todd Gamblin, Abhinav Bhatele

View

Download (PDF)

Tags: Code generation, Computer science, HPC, MPI, nVidia, nVidia A100, OpenMP

July 9, 2023 by hgpu

Evaluation of OpenAI Codex for HPC Parallel Programming Models Kernel Generation

William F. Godoy, Pedro Valero-Lara, Keita Teranishi, Prasanna Balaprakash, Jeffrey S. Vetter

View

Download (PDF)

Source codes

Tags: AI, Artificial intelligence, Benchmarking, Code generation, Computer science, CUDA, Fortran, HPC, Julia, nVidia, OpenACC, OpenMP, Package, Python

July 2, 2023 by hgpu

SCALE-Ahead-Of-Time Compilation of CUDA for AMD GPUs

LeetDecoding: A PyTorch Library for Exponentially Decaying Causal Linear Attention with CUDA Implementations

Anari-visionaray

Data Parallel Visualization and Rendering on the RAMSES Supercomputer with ANARI

PROM: an open-source software framework to enhance the robustness and performance of predictive models against such changes during deployment

Enhancing Deployment-Time Predictive Model Robustness for Code Analysis and Optimization

DeepSpeed: a deep learning optimization library that makes distributed training and inference easy, efficient, and effective

Scalable Access-Pattern Aware I/O Acceleration and Multi-Tiered Data Management for HPC and AI Workloads

* * *

high performance computing on graphics processing units: hgpu.org

Comparing Llama-2 and GPT-3 LLMs for HPC kernels generation

Scope is all you need: Transforming LLMs for HPC Code

HPAC-Offload: Accelerating HPC Applications with Portable Approximate Computing on the GPU

Compute units in OpenMP: Extensions for heterogeneous parallel programming

Mashing load balancing algorithm to boost hybrid kernels in molecular dynamics simulations

Quantifying OpenMP: Statistical Insights into Usage and Adoption

Generating Parallel OpenCL and OpenMP Programs from Dataflow Graphs

A portable C++ library for memory and compute abstraction on multi-core CPUs and GPUs

Creating a Dataset Supporting Translation Between OpenMP Fortran and C++ Code

Maximizing Parallelism and GPU Utilization For Direct GPU Compilation Through Ensemble Execution

Modeling Parallel Programs using Large Language Models

Evaluation of OpenAI Codex for HPC Parallel Programming Models Kernel Generation

Recent source codes

SCALE-Ahead-Of-Time Compilation of CUDA for AMD GPUs

LeetDecoding: A PyTorch Library for Exponentially Decaying Causal Linear Attention with CUDA Implementations

Anari-visionaray

PROM: an open-source software framework to enhance the robustness and performance of predictive models against such changes during deployment

DeepSpeed: a deep learning optimization library that makes distributed training and inference easy, efficient, and effective

HPX: a C++ Standard Library for Concurrency and Parallelism

TorchQC: Quantum Dynamics and Machine Learning

Matrix multiplication using Tensor Cores in CUDA

CPP Joules: Energy Measurement tool for CPP/CUDA programs

HPC-Coder-v2

Most viewed papers (last 30 days)