high performance computing on graphics processing units: hgpu.org

hgpu.org » Apple M2 Pro

Profiling Apple Silicon Performance for ML Training

Dahua Feng, Zhiming Xu, Rongxiang Wang, Felix Xiaozhu Lin

View

Tags: AI, Apple M2 Max, Apple M2 Pro, Apple M2 Ultra, Computer science, CUDA, Linear Algebra, LLM, Machine learning, nVidia, nVidia GeForce RTX 4090, nVidia GeFroce RTX 2080 Ti, nVidia Quadro RTX 4000, nVidia RTX A6000, Performance, PyTorch

February 3, 2025 by hgpu

FP4 FlashAttention forward, backward, and TorchTitan reproduction code

Hardware-Aware FP4 FlashAttention-4

EinsummableV3 - graph-based computation with tensor operations support

Every Kernel Is a Join: Automatic Multi-GPU Parallelism for AI Computations in Einsummable

MaxKernel: Intelligent TPU Kernel Engineering Agents

MaxKernel: Agentic Kernel Generation for TPUs

PTXBench: an open-source environment for kernel agents with architecture-specific CUDA/PTX

PTXBench: Benchmark and Adapt LLMs for GPU Kernel Optimization with Architecture-specific PTX

RealisticTritonBench: A Benchmark for Triton-Kernel Generation in Real-World AI Frameworks

RealisticTritonBench: A Benchmark for Triton-Kernel Generation in Real-World AI Frameworks

TensorCorePTX: PTX Tensor Core GEMM Exploration

Hand-Written PTX Tensor-Core GEMM Kernels: A Multi-Precision Study on NVIDIA L4

FlashPDE: Triton-fused PDE stencil kernels for physics-informed neural networks

FlashPDE: A Drop-In Fused Triton Operator Library for Neural PDE Solvers

PortLBM: Portable GPU-accelerated Lattice Boltzmann Method Simulations

PortLBM: A Portable Lattice Boltzmann Tool Leveraging SYCL on AMD, NVIDIA, and Intel GPUs

Harness Engineering for LLM-Driven GPU Kernel Generation

Harness Engineering for LLM-Driven GPU Kernel Generation

CANNBot Skills

Compiler-Grounded Hierarchical Diagnosis for LLM-Based Triton Kernel Optimization

See all packages

* * *

* * *

HGPU group © 2010-2026 hgpu.org

All rights belong to the respective authors

Login | Sitemap | Feedback | Policy

Contact us: