high performance computing on graphics processing units: hgpu.org

hgpu.org » AI

Superpipeline: A Universal Approach for Reducing GPU Memory Usage in Large Models

Reza Abbasi, Sernam Lim

View

Download (PDF)

Source codes

Tags: AI, Artificial intelligence, Computer science, CUDA, LLM, Machine learning, Memory, nVidia, nVidia GeForce RTX 3090, nVidia Quadro RTX 8000, Package

October 20, 2024 by hgpu

VitBit: Enhancing Embedded GPU Performance for AI Workloads through Register Operand Packing

Jaebeom Jeon, Minseong Gil, Junsu Kim, Jaeyong Park, Gunjae Koo, Myung Kuk Yoon, Yunho Oh

View

Download (PDF)

Tags: AI, Artificial intelligence, Computer science, CUDA, Deep learning, Neural networks, nVidia, nVidia Jetson AGX Orin, Performance

September 1, 2024 by hgpu

Efficiently Training 7B LLM with 1 Million Sequence Length on 8 GPUs

Pinxue Zhao, Hailin Zhang, Fangcheng Fu, Xiaonan Nie, Qibin Liu, Fang Yang, Yuanbo Peng, Dian Jiao, Shuaipeng Li, Jinbao Xue, Yangyu Tao, Bin Cui

View

Download (PDF)

Tags: AI, Computer science, CUDA, LLM, Machine learning, NLP, nVidia, nVidia A800

July 28, 2024 by hgpu

Supercharging Federated Learning with Flower and NVIDIA FLARE

Holger R. Roth, Daniel J. Beutel, Yan Cheng, Javier Fernandez Marques, Heng Pan, Chester Chen, Zhihong Zhang, Yuhong Wen, Sean Yang, Isaac (Te-Chung)Yang, Yuan-Ting Hsieh, Ziyue Xu, Daguang Xu, Nicholas D. Lane, Andrew Feng

View

Download (PDF)

Source codes

Tags: AI, Algorithms, Computer science, nVidia, Package, Security

July 7, 2024 by hgpu

Chat AI: A Seamless Slurm-Native Solution for HPC-Based Services

Ali Doosthosseini, Jonathan Decker, Hendrik Nolte, Julian M. Kunkel

View

Download (PDF)

Source codes

Tags: AI, Cloud, Computer science, HPC, LLM, nVidia, nVidia H100, Package, PC cluster

July 7, 2024 by hgpu

Bag of Tricks: Benchmarking of Jailbreak Attacks on LLMs

Zhao Xu, Fan Liu, Hao Liu

View

Download (PDF)

Source codes

Tags: AI, Benchmarking, Computer science, nVidia, nVidia A800, Package, Security

June 16, 2024 by hgpu

Efficient Approaches for GEMM Acceleration on Leading AI-Optimized FPGAs

Endri Taka, Dimitrios Gourounas, Andreas Gerstlauer, Diana Marculescu, Aman Arora

View

Download (PDF)

Tags: AI, Computer science, Deep learning, FPGA, GEMM, Matrix multiplication

April 21, 2024 by hgpu

High Performance Privacy Preserving AI

Jayavanth Shenoy, Patrick Grinaway, Shriphani Palakodety

View

Download (PDF)

Tags: AI, Artificial intelligence, Book, Computer science, Neural networks, Security

April 14, 2024 by hgpu

Using AI libraries for Incompressible Computational Fluid Dynamics

Boyang Chen, Claire E. Heaney, Christopher C. Pain

View

Download (PDF)

Tags: AI, Artificial intelligence, cfd, CUDA, Fluid dynamics, Neural networks, nVidia, Partial differential equations, PDEs, Tesla T4

March 3, 2024 by hgpu

Sustainable Supercomputing for AI: GPU Power Capping at HPC Scale

Dan Zhao, Siddharth Samsi, Joseph McDonald, Baolin Li, David Bestor, Michael Jones, Devesh Tiwari, Vijay Gadepally

View

Download (PDF)

Tags: AI, Computer science, Energy-efficient computing, HPC, nVidia, nVidia A100

March 3, 2024 by hgpu

Multi-line AI-assisted Code Authoring

Omer Dunay, Daniel Cheng, Adam Tait, Parth Thakkar, Peter C Rigby, Andy Chiu, Imad Ahmad, Arun Ganesan, Chandra Maddila, Vijayaraghavan Murali, Ali Tayyebi, Nachiappan Nagappan

View

Download (PDF)

Tags: AI, Artificial intelligence, Computer science, Software Engineering

February 12, 2024 by hgpu

Domain-Specific Code Language Models: Unraveling the Potential for HPC Codes and Tasks

Tal Kadosh, Niranjan Hasabnis, Vy A. Vo, Nadav Schneider, Neva Krien, Mihai Capota, Abdul Wasay, Nesreen Ahmed, Ted Willke, Guy Tamir, Yuval Pinter, Timothy Mattson, Gal Oren

View

Download (PDF)

Source codes

Tags: AI, Code generation, Computer science, Heterogeneous systems, HPC, nVidia, nVidia A40, OpenMP, Package, Python

January 7, 2024 by hgpu

* * *

high performance computing on graphics processing units: hgpu.org

Superpipeline: A Universal Approach for Reducing GPU Memory Usage in Large Models

VitBit: Enhancing Embedded GPU Performance for AI Workloads through Register Operand Packing

Efficiently Training 7B LLM with 1 Million Sequence Length on 8 GPUs

Supercharging Federated Learning with Flower and NVIDIA FLARE

Bag of Tricks: Benchmarking of Jailbreak Attacks on LLMs

Efficient Approaches for GEMM Acceleration on Leading AI-Optimized FPGAs

High Performance Privacy Preserving AI

Using AI libraries for Incompressible Computational Fluid Dynamics

Sustainable Supercomputing for AI: GPU Power Capping at HPC Scale

Multi-line AI-assisted Code Authoring

Domain-Specific Code Language Models: Unraveling the Potential for HPC Codes and Tasks

Recent source codes

ParaCodex: A Profiling-Guided Autonomous Coding Agent for Reliable Parallel Code Generation and Translation

SeedFold: Scaling Biomolecular Structure Prediction

Tilus: A Tile-Level GPU Kernel Programming Language

Memory-Efficient Acceleration of Block Low-Rank Foundation Models on Resource Constrained GPUs

BoltzGen:Toward Universal Binder Design

CUDA-L2: Surpassing cuBLAS Performance for Matrix Multiplication through Reinforcement Learning

cuPilot: A Strategy-Coordinated Multi-agent Framework for CUDA Kernel Evolution

MATLAB Tensor Core models

TritonForge: Transform PyTorch Operations into Optimized GPU Kernels with LLMs

RLTune: Hybrid Learning and Optimization-Based Dynamic Scheduling for DL Workloads on Heterogeneous GPU Clusters

Most viewed papers (last 30 days)