tensor-core

Several optimization methods of half-precision general matrix multiplication (HGEMM) using tensor core with WMMA API and MMA PTX instruction.

Several optimization methods of half-precision general matrix vector multiplication (HGEMV) using CUDA core.

Performance of the C++ interface of flash attention and flash attention v2 in large language model (LLM) inference scenarios.

Multiple GEMM operators are constructed with cutlass to support LLM inference.

FastCuda is a handwritten CUDA operator library featuring progressive GEMM and Reduce kernels, cuBLAS benchmarking, and C/C++/Python interfaces for learning, profiling, and performance optimization.

Use tensor core to calculate back-to-back HGEMM (half-precision general matrix multiplication) with MMA PTX instruction.

DeepGEMMPerTensor: clean and efficient FP8 GEMM per tensor kernels without scales

Codes for DTC-SpMM (ASPLOS'24)

⚡ 3-Million-Gate Blackwell-Class GPU Architecture | 57 SystemVerilog Modules | Yosys Verified | Designed by Adhiraj, India 🇮🇳

从 SGEMM 到推理组件的系统性 CUDA 学习主仓，整合四条历史实验路径

A reproducible GPU benchmarking lab that compares FP16 vs FP32 training on MNIST using PyTorch, CuPy, and Nsight profiling tools. This project blends performance engineering with cinematic storytelling—featuring NVTX-tagged training loops, fused CuPy kernels, and a profiler-driven README that narrates the GPU’s inner workings frame by frame.

The lab assignments from CS4302 Parallel and Distributed Programming (2022 Fall) with my solutions

🎬 Explore GPU training efficiency with FP32 vs FP16 in this modular lab, utilizing Tensor Core acceleration for deep learning insights.

用于学习模型加载、CUDA 算子、KV Cache 与 token 生成的轻量 C++ 推理运行时