high performance computing on graphics processing units: hgpu.org

Chris Cummins, Bram Wasti, Jiadong Guo, Brandon Cui, Jason Ansel, Sahir Gomez, Somya Jain, Jia Liu, Olivier Teytaud, Benoit Steiner, Yuandong Tian, Hugh Leather

View

Download (PDF)

Source codes

Tags: Artificial intelligence, Benchmarking, Compilers, Computer science, CUDA, Machine learning, nVidia, Package, Performance

September 26, 2021 by hgpu

A readahead prefetcher for GPU file system layer

Vasilis Dimitsas, Mark Silberstein

View

Download (PDF)

Tags: Benchmarking, Computer science, CUDA, nVidia, Prefetch, Tesla K40

September 19, 2021 by hgpu

AutoDock-GPU: AutoDock for GPUs and other accelerators

Architecting Tensor Core-Based Reductions for Irregular Molecular Docking Kernels

NCCLX: collective communication framework

Collective Communication for 100k+ GPUs

Tutoring LLM into a Better CUDA Optimizer

Kernel Library for LLM Serving

Compiler and Runtime Systems for Generative AI Models

Adaptivity in AdaptiveCpp: Optimizing Performance by Leveraging Runtime Information During JIT-Compilation

Neptune: Advanced ML Operator Fusion for Locality and Parallelism on GPUs

Genten: Software for Generalized Tensor Decompositions by Sandia National Laboratories

A Performance Portable Matrix Free Dense MTTKRP in GenTen

Interleaved Learning and Exploration: A Self-Adaptive Fuzz Testing Framework for MLIR

Pinocchio: PINpointing Orbit Crossing Collapsed Hierarchical Objects

Accelerating cosmological simulations on GPUs: a portable approach using OpenMP

KernelCoder: trained on a curated dataset of reasoning traces and CUDA kernel pairs

ConCuR: Conciseness Makes State-of-the-Art Kernel Generation

See all packages

* * *

high performance computing on graphics processing units: hgpu.org

Dynamic GPU Energy Optimization for Machine Learning Training Workloads

High performance computing on Android devices – a case study

Analysis and Comparison of Performance and Power Consumption of Neural Networks on CPU, GPU, TPU and FPGA

Predictive Data Race Detection for GPUs

BAT: A Benchmark suite for AutoTuners

MQBench: Towards Reproducible and Deployable Model Quantization Benchmark

Performance Evaluation of Python ParallelProgramming Models: Charm4Py and mpi4py

OMB-Py: Python Micro-Benchmarks for Evaluating Performance of MPI Libraries on HPC Systems

HLS Portability from Intel to Xilinx: A Case Study

Small-Bench NLP: Benchmark for small single GPU trained models in Natural Language Processing

CompilerGym: Robust, Performant Compiler Optimization Environments for AI Research