high performance computing on graphics processing units: hgpu.org

hgpu.org » Task scheduling

On Scheduling Ring-All-Reduce Learning Jobs in Multi-Tenant GPU Clusters with Communication Contention

Menglu Yu, Bo Ji, Hridesh Rajan, Jia Liu

View

Download (PDF)

Tags: Computer science, Deep learning, GPU cluster, Task scheduling

July 24, 2022 by hgpu

Portable, Scalable Approaches for Improving Asynchronous Many-Task Runtime Node Use

John Keith Holmen

View

Download (PDF)

Tags: Computer science, CUDA, Heterogeneous systems, MPI, nVidia, nVidia GeForce GTX Titan X, performance portability, Task scheduling

June 5, 2022 by hgpu

The Application of AI Technology in GPU Scheduling Algorithm Optimization

Zhancai Yan, Yaqiu Liu, Hongrun Shao

View

Download (PDF)

Tags: Artificial intelligence, Computer science, CUDA, GPU cluster, nVidia, Task scheduling

May 22, 2022 by hgpu

CASE: A Compiler-Assisted SchEduling Framework for Multi-GPU Systems

Chao Chen, Chris Porter, Santosh Pande

View

Download (PDF)

Source codes

Tags: Compilers, Computer science, CUDA, nVidia, Package, Task scheduling, Tesla P100, Tesla V100

May 1, 2022 by hgpu

Atos: A Task-Parallel GPU Dynamic Scheduling Framework for Dynamic Irregular Computations

Yuxin Chen, Benjamin Brock, Serban Porumbescu, Aydın Buluç, Katherine Yelick, John D. Owens

View

Download (PDF)

Tags: Computer science, CUDA, nVidia, Task scheduling, Tesla V100

December 5, 2021 by hgpu

TENSILE: A Tensor granularity dynamic GPU memory scheduler method towards multiple dynamic workloads system

Kaixin Zhang, Hongzhi Wang, Tongxin Li, Han Hu, Jiye Qiu, Songling Zou

View

Download (PDF)

Tags: Computer science, CUDA, Databases, Deep learning, Machine learning, nVidia, nVidia GeForce RTX 2080 Ti, Task scheduling

May 30, 2021 by hgpu

Energy-aware Task Scheduling with Deadline Constraint in DVFS-enabled Heterogeneous Clusters

Xinxin Mei, Qiang Wang, Xiaowen Chu, Hai Liu, Yiu-Wing Leung, Zongpeng Li

View

Download (PDF)

Source codes

Tags: Computer science, Deep learning, Energy-efficient computing, Heterogeneous systems, nVidia, nVidia GeForce GTX 1080 Ti, Package, Task scheduling

April 5, 2021 by hgpu

GPGPU Task Scheduling Technique for Reducing the Performance Deviation of Multiple GPGPU Tasks in RPC-Based GPU Virtualization Environments

Jihun Kang, Heonchang Yu

View

Download (PDF)

Tags: AMD Radeon RX 570, ATI, Cloud, Computer science, HPC, OpenCL, Task scheduling, Virtualization

March 21, 2021 by hgpu

Nimble: Lightweight and Parallel GPU Task Scheduling for Deep Learning

Woosuk Kwon, Gyeong-In Yu, Eunji Jeong, Byung-Gon Chun

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, Deep learning, Neural networks, nVidia, Package, Task scheduling, Tesla V100

December 13, 2020 by hgpu

Towards Co-execution on Commodity Heterogeneous Systems: Optimizations for Time-Constrained Scenarios

Raúl Nozal, Jose Luis Bosque, Ramon Beivide

View

Download (PDF)

Source codes

Tags: AMD Radeon R7, ATI, Computer science, Heterogeneous systems, load balancing, nVidia, nVidia GeForce GTX 950, OpenCL, Package, performance portability, Task scheduling

November 1, 2020 by hgpu

Heterogeneity-Aware Cluster Scheduling Policies for Deep Learning Workloads

Deepak Narayanan, Keshav Santhanam, Fiodar Kazhamiaka, Amar Phanishayee, Matei Zaharia

View

Download (PDF)

Tags: Computer science, CUDA, Deep learning, FPGA, GPU cluster, Heterogeneous systems, nVidia, Optimization, Task scheduling, Tesla K80, Tesla P100, Tesla V100

August 30, 2020 by hgpu

Over-synchronization in GPU Programs

profile_util: simple C++ library to report memory, timing, thread affinity

Profile Util library: A quick and easy way to get MPI, OpenMP and GPU runtime information

MaC: Mamba CPU performance predictor

MambaCPU: Enhanced Correlation Mining with State Space Models for CPU Performance Prediction

Mixed-precision finite element kernels

Mixed-precision finite element kernels and assembly: Rounding error analysis and hardware acceleration

SHMT: The Simultaneous and Heterogenous Multithreading project

General-Purpose Computing on Tensor Processors

Superpipeline: A Universal Approach for Reducing GPU Memory Usage in Large Models

EnergyUCB-Bandit

Online Energy Optimization in GPUs: A Multi-Armed Bandit Approach

See all packages

* * *

high performance computing on graphics processing units: hgpu.org

On Scheduling Ring-All-Reduce Learning Jobs in Multi-Tenant GPU Clusters with Communication Contention

Portable, Scalable Approaches for Improving Asynchronous Many-Task Runtime Node Use

The Application of AI Technology in GPU Scheduling Algorithm Optimization

CASE: A Compiler-Assisted SchEduling Framework for Multi-GPU Systems

Atos: A Task-Parallel GPU Dynamic Scheduling Framework for Dynamic Irregular Computations

TENSILE: A Tensor granularity dynamic GPU memory scheduler method towards multiple dynamic workloads system

Energy-aware Task Scheduling with Deadline Constraint in DVFS-enabled Heterogeneous Clusters

Nimble: Lightweight and Parallel GPU Task Scheduling for Deep Learning

Towards Co-execution on Commodity Heterogeneous Systems: Optimizations for Time-Constrained Scenarios

Heterogeneity-Aware Cluster Scheduling Policies for Deep Learning Workloads

Recent source codes

Kokkidio: Kokkos+Eigen - write fast, readable multi-platform code

LLaMA-Inference-Bench

MATAR

Over-synchronization in GPU Programs

profile_util: simple C++ library to report memory, timing, thread affinity

MaC: Mamba CPU performance predictor

Mixed-precision finite element kernels

SHMT: The Simultaneous and Heterogenous Multithreading project

Superpipeline: A Universal Approach for Reducing GPU Memory Usage in Large Models

EnergyUCB-Bandit

Most viewed papers (last 30 days)