high performance computing on graphics processing units: hgpu.org

hgpu.org » Package

Green AI: A Preliminary Empirical Study on Energy Consumption in DL Models Across Different Runtime Infrastructures

Negar Alizadeh, Fernando Castor

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, Deep learning, Energy-efficient computing, nVidia, nVidia GeForce RTX 3070, Package, PyTorch, TensorFlow

February 25, 2024 by hgpu

TransAxx: Efficient Transformers with Approximate Computing

Dimitrios Danopoulos, Georgios Zervakis, Dimitrios Soudris, Jörg Henkel

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, Machine learning, Neural networks, nVidia, nVidia V100, Package, PyTorch

February 18, 2024 by hgpu

Graphtoy: Fast Software Simulation of Applications for AMD’s AI Engines

Jonathan Strobl, Leonardo Solis-Vasquez, Yannick Lavan, Andreas Koch

View

Download (PDF)

Source codes

Tags: ATI, Computer science, FPGA, molecular docking, Package

February 18, 2024 by hgpu

QUICK: Quantization-aware Interleaving and Conflict-free Kernel for efficient LLM inference

Taesu Kim, Jongho Lee, Daehyun Ahn, Sarang Kim, Jiwoong Choi, Minkyu Kim, Hyungjun Kim

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, Deep learning, Machine learning, Matrix multiplication, Mixed precision, nVidia, nVidia A100, nVidia GeForce RTX 4090, nVidia RTX A6000, Package

February 18, 2024 by hgpu

DeepSeek-Coder: When the Large Language Model Meets Programming – The Rise of Code Intelligence

Daya Guo, Qihao Zhu, Dejian Yang, Zhenda Xie, Kai Dong, Wentao Zhang, Guanting Chen, Xiao Bi, Y. Wu, Y.K. Li, Fuli Luo, Yingfei Xiong, Wenfeng Liang

View

Download (PDF)

Source codes

Tags: Code generation, Computer science, nVidia, nVidia A100, Package

February 12, 2024 by hgpu

Gallatin: A General-Purpose GPU Memory Manager

Hunter McCoy, Prashant Pandey

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, HPC, Memory, nVidia, nVidia A40, Package

February 4, 2024 by hgpu

Deductive verification for SYCL

Ellen Wittingen

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, Heterogeneous systems, HIP, nVidia, OpenCL, OpenMP, Package, SYCL, Thesis

February 4, 2024 by hgpu

LeftoverLocals: Listening to LLM Responses Through Leaked GPU Local Memory

Tyler Sorensen, Heidy Khlaaf

View

Download (PDF)

Source codes

Tags: Computer science, Data recovery, nVidia, nVidia GeForce RTX 4070, OpenCL, Package, Security, Vulkan

February 4, 2024 by hgpu

Towards a GPU-Parallelization of the neXtSIM-DG Dynamical Core

Robert Jendersie, Christian Lessig, Thomas Richter

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, Earth and Space Sciences, Finite element method, Numerical Analysis, nVidia, nVidia A100, nVidia GeForce RTX 3090, OpenMP, Package, PyTorch, SYCL

February 4, 2024 by hgpu

High-order thread-safe lattice Boltzmann model for HPC turbulent flow simulations

Andrea Montessori, Michele La Rocca, Giorgio Amati, Marco Lauricella, Adriano Tiribocchi, Sauro Succi

View

Download (PDF)

Source codes

Tags: cfd, CUDA, Fluid dynamics, HPC, Lattice Boltzmann model, nVidia, nVidia A100, nVidia GeForce RTX 3090, Package

February 4, 2024 by hgpu

Lessons Learned Migrating CUDA to SYCL: A HEP Case Study with ROOT RDataFrame

Jolly Chen, Monica Dessole, Ana Lucia Varbanescu

View

Download (PDF)

Source codes

Tags: CUDA, HEP, nVidia, nVidia Quadro RTX 4000, OpenCL, Package, Performance, Physics, SYCL

January 28, 2024 by hgpu

Minuet: Accelerating 3D Sparse Convolutions on GPUs

Jiacheng Yang, Christina Giannoula, Jun Wu, Mostafa Elhoushi, James Gleeson, Gennady Pekhimenko

View

Download (PDF)

Source codes

Tags: Cloud, Computer science, CUDA, Matrix multiplication, nVidia, nVidia GeForce RTX 2070, nVidia GeForce RTX 2080 Ti, nVidia GeForce RTX 3090, Package, Performance, PyTorch, Tesla A100

January 21, 2024 by hgpu

Over-synchronization in GPU Programs

profile_util: simple C++ library to report memory, timing, thread affinity

Profile Util library: A quick and easy way to get MPI, OpenMP and GPU runtime information

MaC: Mamba CPU performance predictor

MambaCPU: Enhanced Correlation Mining with State Space Models for CPU Performance Prediction

Mixed-precision finite element kernels

Mixed-precision finite element kernels and assembly: Rounding error analysis and hardware acceleration

SHMT: The Simultaneous and Heterogenous Multithreading project

General-Purpose Computing on Tensor Processors

Superpipeline: A Universal Approach for Reducing GPU Memory Usage in Large Models

EnergyUCB-Bandit

Online Energy Optimization in GPUs: A Multi-Armed Bandit Approach

See all packages

* * *

high performance computing on graphics processing units: hgpu.org

Green AI: A Preliminary Empirical Study on Energy Consumption in DL Models Across Different Runtime Infrastructures

TransAxx: Efficient Transformers with Approximate Computing

Graphtoy: Fast Software Simulation of Applications for AMD’s AI Engines

QUICK: Quantization-aware Interleaving and Conflict-free Kernel for efficient LLM inference

DeepSeek-Coder: When the Large Language Model Meets Programming – The Rise of Code Intelligence

Gallatin: A General-Purpose GPU Memory Manager

Deductive verification for SYCL

LeftoverLocals: Listening to LLM Responses Through Leaked GPU Local Memory

Towards a GPU-Parallelization of the neXtSIM-DG Dynamical Core

High-order thread-safe lattice Boltzmann model for HPC turbulent flow simulations

Lessons Learned Migrating CUDA to SYCL: A HEP Case Study with ROOT RDataFrame

Recent source codes

Kokkidio: Kokkos+Eigen - write fast, readable multi-platform code

LLaMA-Inference-Bench

MATAR

Over-synchronization in GPU Programs

profile_util: simple C++ library to report memory, timing, thread affinity

MaC: Mamba CPU performance predictor

Mixed-precision finite element kernels

SHMT: The Simultaneous and Heterogenous Multithreading project

Superpipeline: A Universal Approach for Reducing GPU Memory Usage in Large Models

EnergyUCB-Bandit

Most viewed papers (last 30 days)