high performance computing on graphics processing units: hgpu.org

hgpu.org » PyTorch

HAP: SPMD DNN Training on Heterogeneous GPU Clusters with Automated Program Synthesis

Shiwei Zhang, Lansong Diao, Chuan Wu, Zongyan Cao, Siyu Wang, Wei Lin

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, Deep learning, Distributed computing, GPU cluster, nVidia, nVidia A100, nVidia P100, nVidia V100, Package, PyTorch

January 14, 2024 by hgpu

Deep Learning for Obfuscated Code Analysis

Alexander Shroyer

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, Deep learning, nVidia, nVidia GeForce RTX 2060, OpenCL, Package, PyTorch, Thesis

January 7, 2024 by hgpu

Mystique: Enabling Accurate and Scalable Generation of Production AI Benchmarks

Mingyu Liang, Wenyin Fu, Louis Feng, Zhongyi Lin, Pavani Panakanti, Shengbao Zheng, Srinivas Sridharan, Christina Delimitrou

View

Download (PDF)

Source codes

Tags: AI, Benchmarking, Code generation, Computer science, CUDA, nVidia, Package, Performance, PyTorch, Tesla A100, Tesla V100

July 16, 2023 by hgpu

Improving Automatic Parallel Training via Balanced Memory Workload Optimization

Yujie Wang, Youhe Jiang, Xupeng Miao, Fangcheng Fu, Xiaonan Nie, Bin Cui

View

Download (PDF)

Tags: Computer science, Deep learning, nVidia, nVidia Titan RTX, Performance, PyTorch

July 9, 2023 by hgpu

GPU-Acceleration of Tensor Renormalization with PyTorch using CUDA

Raghav G. Jha, Abhishek Samlodia

View

Download (PDF)

Tags: CUDA, High Energy Physics - Lattice, nVidia, nVidia GeForce RTX 2080 Ti, Physics, PyTorch

June 4, 2023 by hgpu

PyTorch Hyperparameter Tuning – A Tutorial for spotPython

Thomas Bartz-Beielstein

View

Download (PDF)

Source codes

Tags: Computer science, Deep learning, Package, Python, PyTorch, Tutorial

May 28, 2023 by hgpu

TorchBench: Benchmarking PyTorch with High API Surface Coverage

Yueming Hao, Xu Zhao, Bin Bao, David Berard, Will Constable, Adnan Aziz, Xu Liu

View

Download (PDF)

Source codes

Tags: AMD Radeon Instinct MI210, ATI, Benchmarking, Computer science, Deep learning, nVidia, nVidia A100, Package, PyTorch

May 14, 2023 by hgpu

EvoTorch: Scalable Evolutionary Computation in Python

Nihat Engin Toklu, Timothy Atkinson, Vojtěch Micka, Paweł Liskowski, Rupesh Kumar Srivastava

View

Download (PDF)

Source codes

Tags: Artificial intelligence, Computer science, CUDA, Evolutionary Computations, Neural and Evolutionary Computing, nVidia, Package, Python, PyTorch, Tesla V100

March 5, 2023 by hgpu

SAIH: A Scalable Evaluation Methodology for Understanding AI Performance Trend on HPC Systems

Jiangsu Du, Dongsheng Li, Yingpeng Wen, Jiazhi Jiang, Dan Huang, Xiangke Liao, Yutong Lu

View

Download (PDF)

Tags: Artificial intelligence, Benchmarking, Computer science, CUDA, Deep learning, HPC, nVidia, PyTorch, Tesla V100

December 11, 2022 by hgpu

TorchOpt: An Efficient Library for Differentiable Optimization

Jie Ren, Xidong Feng, Bo Liu, Xuehai Pan, Yao Fu, Luo Mai, Yaodong Yang

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, Deep learning, Mathematical Software, nVidia, OpenMP, Package, PyTorch

November 20, 2022 by hgpu

A Study on Neural-based Code Summarization in Low-resource Settings

Yang He

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, Deep learning, nVidia, PyTorch, Software Engineering, Tesla V100, Thesis

November 13, 2022 by hgpu

pyGSL: A Graph Structure Learning Toolkit

Max Wasserman, Gonzalo Mateos

View

Download (PDF)

Source codes

Tags: Computer science, Machine learning, Package, PyTorch, Signal processing

November 13, 2022 by hgpu

Over-synchronization in GPU Programs

profile_util: simple C++ library to report memory, timing, thread affinity

Profile Util library: A quick and easy way to get MPI, OpenMP and GPU runtime information

MaC: Mamba CPU performance predictor

MambaCPU: Enhanced Correlation Mining with State Space Models for CPU Performance Prediction

Mixed-precision finite element kernels

Mixed-precision finite element kernels and assembly: Rounding error analysis and hardware acceleration

SHMT: The Simultaneous and Heterogenous Multithreading project

General-Purpose Computing on Tensor Processors

Superpipeline: A Universal Approach for Reducing GPU Memory Usage in Large Models

EnergyUCB-Bandit

Online Energy Optimization in GPUs: A Multi-Armed Bandit Approach

See all packages

* * *

high performance computing on graphics processing units: hgpu.org

HAP: SPMD DNN Training on Heterogeneous GPU Clusters with Automated Program Synthesis

Deep Learning for Obfuscated Code Analysis

Mystique: Enabling Accurate and Scalable Generation of Production AI Benchmarks

Improving Automatic Parallel Training via Balanced Memory Workload Optimization

GPU-Acceleration of Tensor Renormalization with PyTorch using CUDA

PyTorch Hyperparameter Tuning – A Tutorial for spotPython

TorchBench: Benchmarking PyTorch with High API Surface Coverage

EvoTorch: Scalable Evolutionary Computation in Python

SAIH: A Scalable Evaluation Methodology for Understanding AI Performance Trend on HPC Systems

TorchOpt: An Efficient Library for Differentiable Optimization

A Study on Neural-based Code Summarization in Low-resource Settings

pyGSL: A Graph Structure Learning Toolkit

Recent source codes

Kokkidio: Kokkos+Eigen - write fast, readable multi-platform code

LLaMA-Inference-Bench

MATAR

Over-synchronization in GPU Programs

profile_util: simple C++ library to report memory, timing, thread affinity

MaC: Mamba CPU performance predictor

Mixed-precision finite element kernels

SHMT: The Simultaneous and Heterogenous Multithreading project

Superpipeline: A Universal Approach for Reducing GPU Memory Usage in Large Models

EnergyUCB-Bandit

Most viewed papers (last 30 days)