high performance computing on graphics processing units: hgpu.org

hgpu.org » PyTorch

Mystique: Enabling Accurate and Scalable Generation of Production AI Benchmarks

Mingyu Liang, Wenyin Fu, Louis Feng, Zhongyi Lin, Pavani Panakanti, Shengbao Zheng, Srinivas Sridharan, Christina Delimitrou

View

Download (PDF)

Source codes

Tags: AI, Benchmarking, Code generation, Computer science, CUDA, nVidia, Package, Performance, PyTorch, Tesla A100, Tesla V100

July 16, 2023 by hgpu

Improving Automatic Parallel Training via Balanced Memory Workload Optimization

Yujie Wang, Youhe Jiang, Xupeng Miao, Fangcheng Fu, Xiaonan Nie, Bin Cui

View

Download (PDF)

Tags: Computer science, Deep learning, nVidia, nVidia Titan RTX, Performance, PyTorch

July 9, 2023 by hgpu

GPU-Acceleration of Tensor Renormalization with PyTorch using CUDA

Raghav G. Jha, Abhishek Samlodia

View

Download (PDF)

Tags: CUDA, High Energy Physics - Lattice, nVidia, nVidia GeForce RTX 2080 Ti, Physics, PyTorch

June 4, 2023 by hgpu

PyTorch Hyperparameter Tuning – A Tutorial for spotPython

Thomas Bartz-Beielstein

View

Download (PDF)

Source codes

Tags: Computer science, Deep learning, Package, Python, PyTorch, Tutorial

May 28, 2023 by hgpu

TorchBench: Benchmarking PyTorch with High API Surface Coverage

Yueming Hao, Xu Zhao, Bin Bao, David Berard, Will Constable, Adnan Aziz, Xu Liu

View

Download (PDF)

Source codes

Tags: AMD Radeon Instinct MI210, ATI, Benchmarking, Computer science, Deep learning, nVidia, nVidia A100, Package, PyTorch

May 14, 2023 by hgpu

EvoTorch: Scalable Evolutionary Computation in Python

Nihat Engin Toklu, Timothy Atkinson, Vojtěch Micka, Paweł Liskowski, Rupesh Kumar Srivastava

View

Download (PDF)

Source codes

Tags: Artificial intelligence, Computer science, CUDA, Evolutionary Computations, Neural and Evolutionary Computing, nVidia, Package, Python, PyTorch, Tesla V100

March 5, 2023 by hgpu

SAIH: A Scalable Evaluation Methodology for Understanding AI Performance Trend on HPC Systems

Jiangsu Du, Dongsheng Li, Yingpeng Wen, Jiazhi Jiang, Dan Huang, Xiangke Liao, Yutong Lu

View

Download (PDF)

Tags: Artificial intelligence, Benchmarking, Computer science, CUDA, Deep learning, HPC, nVidia, PyTorch, Tesla V100

December 11, 2022 by hgpu

TorchOpt: An Efficient Library for Differentiable Optimization

Jie Ren, Xidong Feng, Bo Liu, Xuehai Pan, Yao Fu, Luo Mai, Yaodong Yang

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, Deep learning, Mathematical Software, nVidia, OpenMP, Package, PyTorch

November 20, 2022 by hgpu

A Study on Neural-based Code Summarization in Low-resource Settings

Yang He

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, Deep learning, nVidia, PyTorch, Software Engineering, Tesla V100, Thesis

November 13, 2022 by hgpu

pyGSL: A Graph Structure Learning Toolkit

Max Wasserman, Gonzalo Mateos

View

Download (PDF)

Source codes

Tags: Computer science, Machine learning, Package, PyTorch, Signal processing

November 13, 2022 by hgpu

torchode: A Parallel ODE Solver for PyTorch

Marten Lienen, Stephan Günnemann

View

Download (PDF)

Source codes

Tags: Computer science, Deep learning, Numerical Analysis, nVidia, nVidia GeForce GTX 1080 Ti, ODEs, Ordinary differential equations, Package, PyTorch

October 30, 2022 by hgpu

Enhancing the Performance Portability of Heterogeneous Circuit Analysis Programs

Tsung-Wei Huang

View

Download (PDF)

Tags: AMD Radeon RX 6900 XT, ATI, Computer science, Deep learning, nVidia, nVidia GeForce RTX 3090, OpenCL, performance portability, PyTorch, SYCL

September 11, 2022 by hgpu

Code generated HPC Kernels Using Llama-2-70b

Comparing Llama-2 and GPT-3 LLMs for HPC kernels generation

Scope is all you need: Transforming LLMs for HPC Code

pocl - Portable Computing Language

PoCL-R: An Open Standard Based Offloading Layer for Heterogeneous Multi-Access Edge Computing with Server Side Scalability

HPAC-Offload: Accelerating HPC Applications with Portable Approximate Computing on the GPU

openCLDispatcher

Novel insights on atomic synchronization for sort-based group-by on GPUs

CEED Benchmarks

Performant low-order matrix-free finite element kernels on GPU architectures

Sieve: Stratified GPU-Compute Workload Sampling

* * *

high performance computing on graphics processing units: hgpu.org

Mystique: Enabling Accurate and Scalable Generation of Production AI Benchmarks

Improving Automatic Parallel Training via Balanced Memory Workload Optimization

GPU-Acceleration of Tensor Renormalization with PyTorch using CUDA

PyTorch Hyperparameter Tuning – A Tutorial for spotPython

TorchBench: Benchmarking PyTorch with High API Surface Coverage

EvoTorch: Scalable Evolutionary Computation in Python

SAIH: A Scalable Evaluation Methodology for Understanding AI Performance Trend on HPC Systems

TorchOpt: An Efficient Library for Differentiable Optimization

A Study on Neural-based Code Summarization in Low-resource Settings

pyGSL: A Graph Structure Learning Toolkit

torchode: A Parallel ODE Solver for PyTorch

Enhancing the Performance Portability of Heterogeneous Circuit Analysis Programs

Recent source codes

Code generated HPC Kernels Using Llama-2-70b

Scope is all you need: Transforming LLMs for HPC Code

pocl - Portable Computing Language

HPAC-Offload: Accelerating HPC Applications with Portable Approximate Computing on the GPU

openCLDispatcher

CEED Benchmarks

Sieve: Stratified GPU-Compute Workload Sampling

EngineCL: Usability and Performance in Heterogeneous Computing

Ginkgo: high-performance linear algebra library for manycore systems

AlphaFold2

Most viewed papers (last 30 days)