high performance computing on graphics processing units: hgpu.org

hgpu.org » Artificial intelligence

Enhancing Deployment-Time Predictive Model Robustness for Code Analysis and Optimization

Huanting Wang, Patrick Lenihan, Zheng Wang

View

Download (PDF)

Source codes

Tags: Artificial intelligence, Computer science, Machine learning, OpenCL, Optimization, Package, Software Engineering

January 6, 2025 by hgpu

Scalable Access-Pattern Aware I/O Acceleration and Multi-Tiered Data Management for HPC and AI Workloads

Avinash Maurya

View

Download (PDF)

Source codes

Tags: AI, Artificial intelligence, Computer science, CUDA, Deep learning, HPC, nVidia, nVidia DGX-A100, Package, Thesis

December 29, 2024 by hgpu

SoK: A Systems Perspective on Compound AI Threats and Countermeasures

Sarbartha Banerjee, Prateek Sahu, Mulong Luo, Anjo Vahldiek-Oberwagner, Neeraja J. Yadwadkar, Mohit Tiwari

View

Download (PDF)

Tags: AI, Artificial intelligence, Computer science, LLM, Machine learning, Security

November 24, 2024 by hgpu

Context Parallelism for Scalable Million-Token Inference

Amy (Jie) Yang, Jingyi Yang, Aya Ibrahim, Xinfeng Xie, Bangsheng Tang, Grigory Sizov, Jeremy Reizenstein, Jongsoo Park, Jianyu Huang

View

Download (PDF)

Tags: Artificial intelligence, Benchmarking, Computer science, LLM, nVidia, nVidia H100, Performance

November 17, 2024 by hgpu

LLM-Inference-Bench: Inference Benchmarking of Large Language Models on AI Accelerators

Krishna Teja Chitty-Venkata, Siddhisanket Raskar, Bharat Kale, Farah Ferdaus, Aditya Tanikanti, Ken Raffenetti, Valerie Taylor, Murali Emani, Venkatram Vishwanath

View

Download (PDF)

Source codes

Tags: AI, AMD Radeon Instinct MI250, AMD Radeon Instinct MI300X, Artificial intelligence, ATI, Benchmarking, Computer science, CUDA, LLM, Machine learning, nVidia, nVidia A100, nVidia GH200, nVidia H100, OpenCL, Performance

November 10, 2024 by hgpu

NEO: Saving GPU Memory Crisis with CPU Offloading for Online LLM Inference

Xuanlin Jiang, Yang Zhou, Shiyi Cao, Ion Stoica, Minlan Yu

View

Download (PDF)

Tags: Artificial intelligence, Computer science, CUDA, LLM, Memory, nVidia, nVidia A10, nVidia H100, Tesla T4

November 10, 2024 by hgpu

Jailbreaking LLM-Controlled Robots

Alexander Robey, Zachary Ravichandran, Vijay Kumar, Hamed Hassani, George J. Pappas

View

Download (PDF)

Tags: Artificial intelligence, Computer science, LLM, Robotics, Security

October 27, 2024 by hgpu

General-Purpose Computing on Tensor Processors

Kuan-Chieh Hsu

View

Download (PDF)

Source codes

Tags: Artificial intelligence, Computer science, CUDA, Heterogeneous systems, Machine learning, nVidia, nVidia GeForce RTX 2080, nVidia GeForce RTX 3090, nVidia Jetson Nano, Package, Sparse matrix, Thesis, TPU

October 27, 2024 by hgpu

Superpipeline: A Universal Approach for Reducing GPU Memory Usage in Large Models

Reza Abbasi, Sernam Lim

View

Download (PDF)

Source codes

Tags: AI, Artificial intelligence, Computer science, CUDA, LLM, Machine learning, Memory, nVidia, nVidia GeForce RTX 3090, nVidia Quadro RTX 8000, Package

October 20, 2024 by hgpu

Efficient Configuration of Heterogeneous Resources and Task Scheduling Strategies in Deep Learning Auto-Tuning Systems

Pao-Yi Ken, Chao-Chin Wu

View

Download (PDF)

Tags: AI, Artificial intelligence, Computer science, Deep learning, Machine learning, nVidia, nVidia RTX A6000, Task scheduling

October 20, 2024 by hgpu

Sound and Partially-Complete Static Analysis of Data-Races in GPU Programs

Dennis Liew, Tiago Cogumbreiro, Julien Lange

View

Download (PDF)

Source codes

Tags: Artificial intelligence, Computer science, CUDA, nVidia, Package, Performance

October 13, 2024 by hgpu

Intel(R) SHMEM: GPU-initiated OpenSHMEM using SYCL

Alex Brooks, Philip Marshall, David Ozog, Md. Wasi-ur- Rahman, Lawrence Stewart, Rithwik Tom

View

Download (PDF)

Source codes

Tags: Artificial intelligence, Computer science, Heterogeneous systems, Intel, Intel Data Center GPU Max 1550, oneAPI, Package, SYCL

October 6, 2024 by hgpu

ViVid Project

Exploring data flow design and vectorization with oneAPI for streaming applications on CPU+GPU

VFLog: vertical + gpu + free join + datalog

Column-Oriented Datalog on the GPU

Code Generation for Cryptographic Kernels using Multi-word Modular Arithmetic on GPU

GSParLib

GSParLib: A multi-level programming interface unifying OpenCL and CUDA for expressing stream and data parallelism

Keras Sig: Efficient Path Signature Computation on GPU in Keras 3

KSig: GPU-accelerated computation of popular time series kernels

A User’s Guide to KSig: GPU-Accelerated Computation of the Signature Kernel

IterApp: Iterative Application Skeleton

Boosting Performance of Iterative Applications on GPUs: Kernel Batching with CUDA Graphs

SCALE-Ahead-Of-Time Compilation of CUDA for AMD GPUs

LeetDecoding: A PyTorch Library for Exponentially Decaying Causal Linear Attention with CUDA Implementations

Anari-visionaray

Data Parallel Visualization and Rendering on the RAMSES Supercomputer with ANARI

See all packages

* * *

high performance computing on graphics processing units: hgpu.org

Enhancing Deployment-Time Predictive Model Robustness for Code Analysis and Optimization

Scalable Access-Pattern Aware I/O Acceleration and Multi-Tiered Data Management for HPC and AI Workloads

SoK: A Systems Perspective on Compound AI Threats and Countermeasures

Context Parallelism for Scalable Million-Token Inference

LLM-Inference-Bench: Inference Benchmarking of Large Language Models on AI Accelerators

NEO: Saving GPU Memory Crisis with CPU Offloading for Online LLM Inference

Jailbreaking LLM-Controlled Robots

General-Purpose Computing on Tensor Processors

Superpipeline: A Universal Approach for Reducing GPU Memory Usage in Large Models

Efficient Configuration of Heterogeneous Resources and Task Scheduling Strategies in Deep Learning Auto-Tuning Systems

Sound and Partially-Complete Static Analysis of Data-Races in GPU Programs

Intel(R) SHMEM: GPU-initiated OpenSHMEM using SYCL

Recent source codes

ViVid Project

VFLog: vertical + gpu + free join + datalog

Code Generation for Cryptographic Kernels using Multi-word Modular Arithmetic on GPU

GSParLib

Keras Sig: Efficient Path Signature Computation on GPU in Keras 3

KSig: GPU-accelerated computation of popular time series kernels

IterApp: Iterative Application Skeleton

SCALE-Ahead-Of-Time Compilation of CUDA for AMD GPUs

LeetDecoding: A PyTorch Library for Exponentially Decaying Causal Linear Attention with CUDA Implementations

Anari-visionaray

Most viewed papers (last 30 days)