high performance computing on graphics processing units: hgpu.org

hgpu.org » nVidia

Increased reliability on Intel GPUs via software diverse redundancy

Nikolaos Andriotis

View

Download (PDF)

Tags: Computer science, Deep learning, Machine learning, MPI, nVidia, OpenCL, Thesis

August 20, 2023 by hgpu

Quantifying OpenMP: Statistical Insights into Usage and Adoption

Tal Kadosh, Niranjan Hasabnis, Timothy Mattson, Yuval Pinter, Gal Oren

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, Databases, Fortran, HPC, MPI, nVidia, OpenACC, OpenCL, OpenMP, Package, SYCL

August 20, 2023 by hgpu

Porting Batched Iterative Solvers onto Intel GPUs with SYCL

Phuong Nguyen, Pratik Nayak, Hartwig Anzt

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, Intel, Intel Data Center GPU Max 1550, nVidia, nVidia A100, nVidia H100, Package, performance portability, Physics, SYCL

August 20, 2023 by hgpu

APACE: AlphaFold2 and advanced computing as a service for accelerated discovery in biophysics

Hyun Park, Parth Patel, Roland Haas, E. A. Huerta

View

Download (PDF)

Source codes

Tags: AI, Algorithms, Biology, Biomolecules, Biophysics, nVidia, nVidia A100, nVidia A40, Package

August 20, 2023 by hgpu

gZCCL: Compression-Accelerated Collective Communication Framework for GPU Clusters

Jiajun Huang, Sheng Di, Xiaodong Yu, Yujia Zhai, Jinyang Liu, Yafan Huang, Ken Raffenetti, Hui Zhou, Kai Zhao, Zizhong Chen, Franck Cappello, Yanfei Guo, Rajeev Thakur

View

Download (PDF)

Tags: Compression, Computer science, GPU cluster, MPI, nVidia, nVidia A100

August 13, 2023 by hgpu

A Model Extraction Attack on Deep Neural Networks Running on GPUs

Jonah G. O'Brien Weiss

View

Download (PDF)

Tags: Computer science, Neural networks, nVidia, nVidia Quadro RTX 8000, Security, Tesla T4

August 13, 2023 by hgpu

SYnergy: Fine-grained Energy-Efficient Heterogeneous Computing for Scalable Energy Saving

Kaijie Fan, Marco D'Antonio, Lorenzo Carpentieri, Biagio Cosenza, Federico Ficarelli, Daniele Cesarini

View

Download (PDF)

Tags: AMD Radeon Instinct MI100, ATI, Computer science, Energy-efficient computing, GPU cluster, Heterogeneous systems, Machine learning, nVidia, nVidia V100, SYCL

August 13, 2023 by hgpu

Static and Dynamic Analyses for Efficient GPU Execution

Philip Munksgaard

View

Download (PDF)

Tags: AMD Radeon Instinct MI100, ATI, Benchmarking, Computer science, nVidia, nVidia A100, OpenCL, Performance, Thesis

August 13, 2023 by hgpu

Isolated Scheduling for Distributed Training Tasks in GPU Clusters

Xinchi Han, Weihao Jiang, Peirui Cao, Qinwei Yang, Yunzhuo Liu, Shuyao Qi, Shengkai Lin, Shizhen Zhao

View

Download (PDF)

Source codes

Tags: Computer science, GPU cluster, Machine learning, Neural networks, nVidia, nVidia V100, Package

August 13, 2023 by hgpu

Bandicoot: C++ Library for GPU Linear Algebra and Scientific Computing

Ryan R. Curtin, Marcus Edel, Conrad Sanderson

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, Linear Algebra, nVidia, nVidia GeForce RTX 2080 Ti, OpenCL, Package, Programming techniques

July 30, 2023 by hgpu

Fast Knowledge Graph Completion using Graphics Processing Units

Chun-Hee Lee, Dong-oh Kang, Hwa Jeon Song

View

Download (PDF)

Tags: AI, Algorithms, Computer science, CUDA, Databases, Graph theory, nVidia, nVidia A100

July 30, 2023 by hgpu

A portable C++ library for memory and compute abstraction on multi-core CPUs and GPUs

Pietro Incardona, Aryaman Gupta, Serhii Yaskovets, Ivo F. Sbalzarini

View

Download (PDF)

Source codes

Tags: AMD RX Vega 64, ATI, Computer science, CUDA, nVidia, nVidia A100, nVidia GeForce RTX 3090, OpenACC, OpenCL, OpenMP, Package, Performance, performance portability, SYCL

July 30, 2023 by hgpu

MegaTrain: Full Precision Training of 100B+ Parameter Large Language Models on a Single GPU

Device Virtual Machine (DVM)

DVM: Real-Time Kernel Generation for Dynamic AI Models

Agentic Code Optimization via Compiler-LLM Cooperation

AutoKernel: Autoresearch for GPU kernels. Give it any PyTorch model, go to sleep, wake up to optimized Triton kernels

AutoKernel: Autonomous GPU Kernel Optimization via Iterative Agent-Driven Search

Triton-Sanitizer: A Fast and Device-Agnostic Memory Sanitizer for Triton with Rich Diagnostic Context

LLM.Q: Quantized LLM training in pure CUDA/C++

LLMQ: Efficient Lower-Precision LLM Training for Consumer GPUs

SOL-ExecBench: Speed-of-Light Benchmarking for Real-World GPU Kernels Against Hardware Limits

* * *

high performance computing on graphics processing units: hgpu.org

Increased reliability on Intel GPUs via software diverse redundancy

Quantifying OpenMP: Statistical Insights into Usage and Adoption

Porting Batched Iterative Solvers onto Intel GPUs with SYCL

APACE: AlphaFold2 and advanced computing as a service for accelerated discovery in biophysics

gZCCL: Compression-Accelerated Collective Communication Framework for GPU Clusters

A Model Extraction Attack on Deep Neural Networks Running on GPUs

SYnergy: Fine-grained Energy-Efficient Heterogeneous Computing for Scalable Energy Saving

Static and Dynamic Analyses for Efficient GPU Execution

Isolated Scheduling for Distributed Training Tasks in GPU Clusters

Bandicoot: C++ Library for GPU Linear Algebra and Scientific Computing

Fast Knowledge Graph Completion using Graphics Processing Units

A portable C++ library for memory and compute abstraction on multi-core CPUs and GPUs

Recent source codes

MegaTrain: Full Precision Training of 100B+ Parameter Large Language Models on a Single GPU

Device Virtual Machine (DVM)

Agentic Code Optimization via Compiler-LLM Cooperation

AutoKernel: Autoresearch for GPU kernels. Give it any PyTorch model, go to sleep, wake up to optimized Triton kernels

Triton-Sanitizer: A Fast and Device-Agnostic Memory Sanitizer for Triton with Rich Diagnostic Context

LLM.Q: Quantized LLM training in pure CUDA/C++

SOL-ExecBench: Speed-of-Light Benchmarking for Real-World GPU Kernels Against Hardware Limits

True 4-Bit Quantized CNN Training on CPU

cuFuzz: A GPU-oriented coverage-guided fuzzer for userland CUDA application

KernelSkill: A Multi-Agent Framework for GPU Kernel Optimization

Most viewed papers (last 30 days)