high performance computing on graphics processing units: hgpu.org

Applications

hgpu.org » paper

Composing Distributed Computations Through Task and Kernel Fusion

Rohan Yadav, Shiv Sundram, Wonchan Lee, Michael Garland, Michael Bauer, Alex Aiken, Fredrik Kjolstad

View

Download (PDF)

Tags: Computer science, CUDA, Distributed computing, MPI, nVidia, nVidia DGX-A100, Python

June 30, 2024 by hgpu

CATBench: A Compiler Autotuning Benchmarking Suite for Black-box Optimization

Jacob O. Tørring, Carl Hvarfner, Luigi Nardi, Magnus Själander

View

Download (PDF)

Source codes

Tags: Benchmarking, Compilers, Computer science, Machine learning, nVidia, nVidia GeForce GTX Titan V, nVidia Titan RTX, OpenCL, Package

June 30, 2024 by hgpu

Breaking the Memory Wall: A Study of I/O Patterns and GPU Memory Utilization for Hybrid CPU-GPU Offloaded Optimizers

Avinash Maurya, Jie Ye, M. Mustafa Rafique, Franck Cappello, Bogdan Nicolae

View

Download (PDF)

Tags: Computer science, CUDA, LLM, Memory, nVidia, nVidia A100, nVidia H100, Performance

June 23, 2024 by hgpu

GPU Parallelization of Astronomical Image Subtraction

Gustav Arneving, Hugo Wilhelmsson

View

Download (PDF)

Tags: Astrophysics, nVidia, nVidia GeForce GTX 1050, OpenCL, OpenMP, Physics, Thesis

June 23, 2024 by hgpu

An End-to-End Programming Model for AI Engine Architectures

Maksim Levental

View

Download (PDF)

Tags: Artificial intelligence, Computer science, Deep learning, nVidia, nVidia GeForce RTX 3080 Ti, Thesis, Vulkan

June 23, 2024 by hgpu

Optimal Kernel Orchestration for Tensor Programs with Korch

Muyan Hu, Ashwin Venkatram, Shreyashri Biswas, Balamurugan Marimuthu, Bohan Hou, Gabriele Oliaro, Haojie Wang, Liyan Zheng, Xupeng Miao, Jidong Zhai

View

Download (PDF)

Source codes

Tags: Compilers, Computer science, CUDA, Neural networks, nVidia, nVidia A100, nVidia V100, Package, PyTorch

June 23, 2024 by hgpu

COOK Access Control on an embedded Volta GPU

Benjamin Lesage, Frédéric Boniol, Claire Pagetti

View

Download (PDF)

Tags: Computer science, CUDA, Machine learning, Neural networks, nVidia, nVidia Jetson AGX Xavier

June 23, 2024 by hgpu

Stencil Computations on AMD and Nvidia Graphics Processors: Performance and Tuning Strategies

Johannes Pekkilä, Oskar Lappi, Fredrik Robertsén, Maarit J. Korpi-Lagg

View

Download (PDF)

Source codes

Tags: AMD Radeon Instinct MI100, AMD Radeon Instinct MI250X, ATI, Computer science, CUDA, Energy-efficient computing, HIP, nVidia, nVidia A100, nVidia V100, Package, Performance, PyTorch, Stencil computation

June 16, 2024 by hgpu

Understanding GPU Triggering APIs for MPI+X Communication

Patrick G. Bridges, Anthony Skjellum, Evan D. Suggs, Derek Schafer, Purushotham V. Bangalore

View

Download (PDF)

Tags: Computer science, HPC, MPI, Performance

June 16, 2024 by hgpu

Bag of Tricks: Benchmarking of Jailbreak Attacks on LLMs

Zhao Xu, Fan Liu, Hao Liu

View

Download (PDF)

Source codes

Tags: AI, Benchmarking, Computer science, nVidia, nVidia A800, Package, Security

June 16, 2024 by hgpu

A methodology for comparing optimization algorithms for auto-tuning

Floris-Jan Willemsen, Richard Schoonhoven, Jiří Filipovič, Jacob O. Tørring, Rob van Nieuwpoort, Ben van Werkhoven

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, nVidia, nVidia GeForce RTX 2080 Ti, nVidia GeForce RTX 3090, Package, Performance

June 16, 2024 by hgpu

SCALE-Ahead-Of-Time Compilation of CUDA for AMD GPUs

LeetDecoding: A PyTorch Library for Exponentially Decaying Causal Linear Attention with CUDA Implementations

Anari-visionaray

Data Parallel Visualization and Rendering on the RAMSES Supercomputer with ANARI

PROM: an open-source software framework to enhance the robustness and performance of predictive models against such changes during deployment

Enhancing Deployment-Time Predictive Model Robustness for Code Analysis and Optimization

DeepSpeed: a deep learning optimization library that makes distributed training and inference easy, efficient, and effective

Scalable Access-Pattern Aware I/O Acceleration and Multi-Tiered Data Management for HPC and AI Workloads

* * *

high performance computing on graphics processing units: hgpu.org

Applications

Composing Distributed Computations Through Task and Kernel Fusion

CATBench: A Compiler Autotuning Benchmarking Suite for Black-box Optimization

Breaking the Memory Wall: A Study of I/O Patterns and GPU Memory Utilization for Hybrid CPU-GPU Offloaded Optimizers

GPU Parallelization of Astronomical Image Subtraction

An End-to-End Programming Model for AI Engine Architectures

Optimal Kernel Orchestration for Tensor Programs with Korch

COOK Access Control on an embedded Volta GPU

Stencil Computations on AMD and Nvidia Graphics Processors: Performance and Tuning Strategies

Understanding GPU Triggering APIs for MPI+X Communication

Bag of Tricks: Benchmarking of Jailbreak Attacks on LLMs

A methodology for comparing optimization algorithms for auto-tuning

Recent source codes

SCALE-Ahead-Of-Time Compilation of CUDA for AMD GPUs

LeetDecoding: A PyTorch Library for Exponentially Decaying Causal Linear Attention with CUDA Implementations

Anari-visionaray

PROM: an open-source software framework to enhance the robustness and performance of predictive models against such changes during deployment

DeepSpeed: a deep learning optimization library that makes distributed training and inference easy, efficient, and effective

HPX: a C++ Standard Library for Concurrency and Parallelism

TorchQC: Quantum Dynamics and Machine Learning

Matrix multiplication using Tensor Cores in CUDA

CPP Joules: Energy Measurement tool for CPP/CUDA programs

HPC-Coder-v2

Most viewed papers (last 30 days)