high performance computing on graphics processing units: hgpu.org

hgpu.org » Deep learning

GEVO-ML: Optimizing Machine Learning Code with Evolutionary Computation

Jhe-Yu Liou, Stephanie Forrest, Carole-Jean Wu

View

Tags: Computer science, CUDA, Deep learning, Evolutionary Computations, Machine learning, Neural and Evolutionary Computing, nVidia, nVidia P100

October 29, 2023 by hgpu

Predicting the Execution Time of a kernel on a specific GPU using PTX code

Monika Dagar, Jorge Roldan

View

Download (PDF)

Tags: Computer science, CUDA, Deep learning, Machine learning, nVidia, nVidia GeForce GTX 1650, nVidia GeForce GTX Titan XP, Performance, PTX, Tesla K20, Tesla K80, Tesla M60, Tesla P100, Tesla T4, Tesla V100

October 22, 2023 by hgpu

Novel Parallelization Strategies for High-Performance DNN Training on HPC Systems

Arpan Jain

View

Download (PDF)

Tags: Artificial intelligence, Computer science, CUDA, Data parallelism, Deep learning, HPC, Machine learning, MPI, Neural networks, nVidia, Speech recognition, Tesla K80, Tesla V100, Thesis

October 1, 2023 by hgpu

Comparing Llama-2 and GPT-3 LLMs for HPC kernels generation

Pedro Valero-Lara, Alexis Huante, Mustafa Al Lail, William F. Godoy, Keita Teranishi, Prasanna Balaprakash, Jeffrey S. Vetter

View

Download (PDF)

Source codes

Tags: Code generation, Computer science, CUDA, Deep learning, Fortran, HIP, HPC, nVidia, OpenACC, OpenMP, Package, Python

September 17, 2023 by hgpu

Scope is all you need: Transforming LLMs for HPC Code

Tal Kadosh, Niranjan Hasabnis, Vy A. Vo, Nadav Schneider, Neva Krien, Abdul Wasay, Nesreen Ahmed, Ted Willke, Guy Tamir, Yuval Pinter, Timothy Mattson, Gal Oren

View

Download (PDF)

Source codes

Tags: Code generation, Computer science, Deep learning, HPC, nVidia, nVidia A40, nVidia H100, OpenMP, Package

September 6, 2023 by hgpu

Increased reliability on Intel GPUs via software diverse redundancy

Nikolaos Andriotis

View

Download (PDF)

Tags: Computer science, Deep learning, Machine learning, MPI, nVidia, OpenCL, Thesis

August 20, 2023 by hgpu

Monadic Deep Learning

Bo Yang, Zhihao Zhang Kirisame Marisa, Kai Shi

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, Deep learning, Java, Neural networks, OpenCL, Package, Scala

July 30, 2023 by hgpu

Miriam: Exploiting Elastic Kernels for Real-time Multi-DNN Inference on Edge GPU

Zhihe Zhao, Neiwen Ling, Nan Guan, Guoliang Xing

View

Download (PDF)

Tags: Benchmarking, Computer science, CUDA, Deep learning, Neural networks, nVidia, nVidia GeForce RTX 2060, nVidia Jetson TX2

July 16, 2023 by hgpu

Improving Automatic Parallel Training via Balanced Memory Workload Optimization

Yujie Wang, Youhe Jiang, Xupeng Miao, Fangcheng Fu, Xiaonan Nie, Bin Cui

View

Download (PDF)

Tags: Computer science, Deep learning, nVidia, nVidia Titan RTX, Performance, PyTorch

July 9, 2023 by hgpu

Deep Language Models for Software Testing and Optimisation

Foivos Tsimpourlas

View

Download (PDF)

Source codes

Tags: Benchmarking, Computer science, Deep learning, nVidia, nVidia GeForce GTX 1080, nVidia GeForce Titan X, OpenCL, Package, Software Engineering, Thesis

June 25, 2023 by hgpu

DGEMM on Integer Matrix Multiplication Unit

Hiroyuki Ootomo, Katsuhisa Ozaki, Rio Yokota

View

Download (PDF)

Source codes

Tags: Computer science, CUBLAS, CUDA, Deep learning, Linear Algebra, Machine learning, Matrix multiplication, nVidia, nVidia A100, nVidia Jetson AGX Orin, nVidia RTX 6000 Ada, nVidia Titan RTX, Package

June 25, 2023 by hgpu

Compiler Technologies in Deep Learning Co-Design: A Survey

Hongbin Zhang, Mingjie Xing, Yanjun Wu, Chen Zhao

View

Download (PDF)

Source codes

Tags: Compielrs, Computer science, Deep learning, HLS, OpenCL, Package, survey

June 4, 2023 by hgpu

Coccinelle: a C code transformation engine using SmPL for matches, refactorings, and bug fixing

Advances in Semantic Patching for HPC-oriented Refactorings with Coccinelle

DuoReduce: MLIR's benchmark

Hardware-Assisted Software Testing and Debugging for Heterogeneous Computing

Shamrock: Multi-GPU hydrodynamics for astrophysics

The Shamrock code: I- Smoothed Particle Hydrodynamics on GPUs

LLMPerf: GPU Performance Modeling meets Large Language Models

Hercules: A Compiler for Productive Programming of Heterogeneous Systems

* * *

high performance computing on graphics processing units: hgpu.org

GEVO-ML: Optimizing Machine Learning Code with Evolutionary Computation

Predicting the Execution Time of a kernel on a specific GPU using PTX code

Novel Parallelization Strategies for High-Performance DNN Training on HPC Systems

Comparing Llama-2 and GPT-3 LLMs for HPC kernels generation

Scope is all you need: Transforming LLMs for HPC Code

Increased reliability on Intel GPUs via software diverse redundancy

Monadic Deep Learning

Miriam: Exploiting Elastic Kernels for Real-time Multi-DNN Inference on Edge GPU

Improving Automatic Parallel Training via Balanced Memory Workload Optimization

Deep Language Models for Software Testing and Optimisation

DGEMM on Integer Matrix Multiplication Unit

Compiler Technologies in Deep Learning Co-Design: A Survey

Recent source codes

Coccinelle: a C code transformation engine using SmPL for matches, refactorings, and bug fixing

DuoReduce: MLIR's benchmark

Shamrock: Multi-GPU hydrodynamics for astrophysics

LLMPerf: GPU Performance Modeling meets Large Language Models

Hercules: A Compiler for Productive Programming of Heterogeneous Systems

Celerity Runtime: High-level C++ for Accelerator Clusters

wgpy: WebGL accelerated numpy-compatible array library for web browser

Microbenchmarking OpenMP target offload with Catch2

SUperman: Highly Efficient Permanent Computation Library

TransCL: An Automatic CUDA-to-OpenCL Programs Transformation Framework

Most viewed papers (last 30 days)