high performance computing on graphics processing units: hgpu.org

hgpu.org » nVidia A800

Efficiently Training 7B LLM with 1 Million Sequence Length on 8 GPUs

Pinxue Zhao, Hailin Zhang, Fangcheng Fu, Xiaonan Nie, Qibin Liu, Fang Yang, Yuanbo Peng, Dian Jiao, Shuaipeng Li, Jinbao Xue, Yangyu Tao, Bin Cui

View

Tags: AI, Computer science, CUDA, LLM, Machine learning, NLP, nVidia, nVidia A800

July 28, 2024 by hgpu

Bag of Tricks: Benchmarking of Jailbreak Attacks on LLMs

Zhao Xu, Fan Liu, Hao Liu

View

Tags: AI, Benchmarking, Computer science, nVidia, nVidia A800, Package, Security

June 16, 2024 by hgpu

Coccinelle: a C code transformation engine using SmPL for matches, refactorings, and bug fixing

Advances in Semantic Patching for HPC-oriented Refactorings with Coccinelle

DuoReduce: MLIR's benchmark

Hardware-Assisted Software Testing and Debugging for Heterogeneous Computing

Shamrock: Multi-GPU hydrodynamics for astrophysics

The Shamrock code: I- Smoothed Particle Hydrodynamics on GPUs

LLMPerf: GPU Performance Modeling meets Large Language Models

LLMPerf: GPU Performance Modeling meets Large Language Models

Hercules: A Compiler for Productive Programming of Heterogeneous Systems

Hercules: A Compiler for Productive Programming of Heterogeneous Systems

Celerity Runtime: High-level C++ for Accelerator Clusters

Concurrent Scheduling of High-Level Parallel Programs on Multi-GPU Systems

wgpy: WebGL accelerated numpy-compatible array library for web browser

WgPy: GPU-accelerated NumPy-like array library for web browsers

Microbenchmarking OpenMP target offload with Catch2

A Microbenchmark Framework for Performance Evaluation of OpenMP Target Offloading

SUperman: Highly Efficient Permanent Computation Library

SUperman: Efficient Permanent Computation on GPUs

TransCL: An Automatic CUDA-to-OpenCL Programs Transformation Framework

TransCL: An Automatic CUDA-to-OpenCL Programs Transformation Framework

See all packages

* * *

* * *

HGPU group © 2010-2025 hgpu.org

All rights belong to the respective authors

Login | Sitemap | Feedback | Policy

Contact us:

contact@hpgu.org