high performance computing on graphics processing units: hgpu.org

Massinissa Merouani, Khaled Afif Boudaoud, Iheb Nassim Aouadj, Nassim Tchoulak, Islam Kara Bernou, Hamza Benyamina, Fatima Benbouzid-Si Tayeb, Karima Benatchba, Hugh Leather, Riyadh Baghdadi

View

Download (PDF)

Source codes

Tags: Compilers, Computer science, Deep learning, Machine learning, OpenCL, Package, Programming Languages

March 24, 2024 by hgpu

APPy: Annotated Parallelism for Python on GPUs

Tong Zhou, Jun Shirako, Vivek Sarkar

View

Download (PDF)

Tags: Code generation, Compilers, Computer science, CUDA, Machine learning, nVidia, nVidia GeForce RTX 3090, Python

February 25, 2024 by hgpu

TransAxx: Efficient Transformers with Approximate Computing

Dimitrios Danopoulos, Georgios Zervakis, Dimitrios Soudris, Jörg Henkel

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, Machine learning, Neural networks, nVidia, nVidia V100, Package, PyTorch

February 18, 2024 by hgpu

QUICK: Quantization-aware Interleaving and Conflict-free Kernel for efficient LLM inference

Taesu Kim, Jongho Lee, Daehyun Ahn, Sarang Kim, Jiwoong Choi, Minkyu Kim, Hyungjun Kim

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, Deep learning, Machine learning, Matrix multiplication, Mixed precision, nVidia, nVidia A100, nVidia GeForce RTX 4090, nVidia RTX A6000, Package

February 18, 2024 by hgpu

Evaluating the Wide Area Classroom After 24,000 HPC Students

John Urbanic, Thomas Maiden, Valerie Rossi

View

Download (PDF)

Tags: Education, HPC, Machine learning, MPI, OpenACC, OpenMP, Physics

February 12, 2024 by hgpu

SCALE-Ahead-Of-Time Compilation of CUDA for AMD GPUs

LeetDecoding: A PyTorch Library for Exponentially Decaying Causal Linear Attention with CUDA Implementations

Anari-visionaray

Data Parallel Visualization and Rendering on the RAMSES Supercomputer with ANARI

PROM: an open-source software framework to enhance the robustness and performance of predictive models against such changes during deployment

Enhancing Deployment-Time Predictive Model Robustness for Code Analysis and Optimization

DeepSpeed: a deep learning optimization library that makes distributed training and inference easy, efficient, and effective

Scalable Access-Pattern Aware I/O Acceleration and Multi-Tiered Data Management for HPC and AI Workloads

* * *

high performance computing on graphics processing units: hgpu.org

Machine learning enhanced code optimization for high-level synthesis (ML-ECOHS)

Addressing Challenges in Utilizing GPUs for Accelerating Privacy-Preserving Computation

STuning-DL: Model-Driven Autotuning of Sparse GPU Kernels for Deep Learning

Hierarchical Resource Partitioning on Modern GPUs: A Reinforcement Learning Approach

A Systematic Literature Survey of Sparse Matrix-Vector Multiplication

QArray: a GPU-accelerated constant capacitance model simulator for large quantum dot arrays

94% on CIFAR-10 in 3.29 Seconds on a Single GPU

LOOPer: A Learned Automatic Code Optimizer For Polyhedral Compilers

APPy: Annotated Parallelism for Python on GPUs

TransAxx: Efficient Transformers with Approximate Computing

QUICK: Quantization-aware Interleaving and Conflict-free Kernel for efficient LLM inference

Evaluating the Wide Area Classroom After 24,000 HPC Students

Recent source codes

SCALE-Ahead-Of-Time Compilation of CUDA for AMD GPUs

LeetDecoding: A PyTorch Library for Exponentially Decaying Causal Linear Attention with CUDA Implementations

Anari-visionaray

PROM: an open-source software framework to enhance the robustness and performance of predictive models against such changes during deployment

DeepSpeed: a deep learning optimization library that makes distributed training and inference easy, efficient, and effective

HPX: a C++ Standard Library for Concurrency and Parallelism

TorchQC: Quantum Dynamics and Machine Learning

Matrix multiplication using Tensor Cores in CUDA

CPP Joules: Energy Measurement tool for CPP/CUDA programs

HPC-Coder-v2

Most viewed papers (last 30 days)