Build a Local Open-Weight Triton Kernel Latency and Memory Auditor

Benchmark custom open-weight attention and GEMM Triton kernels against baseline implementations on local GPUs. Quantify execution time, register pressure, and SRAM efficiency before serving deployment.

Hardware Kernel Optimization Engineer

Ingest profiling trace outputs from local Triton kernel compilation and execution benchmarks.

Extract kernel execution times, shared memory allocations, and register spill counts.

Compare candidate fused kernels against standard unquantized PyTorch baseline operations.

Use hosted Claude API to synthesize kernel tuning recommendations and block size heuristics.

Kernel benchmark comparator dashboard with memory footprint graphs and tuning report export.

Create normalized synthetic benchmark tables representing Triton attention kernel runs across varying tile sizes. Starter examples below are synthetic. They are not downloaded records.

vLLM open-model serving Incorporate vLLM optimized attention and GEMM kernel execution references using Triton and CUTLASS.

mlflow, anthropic, pandas. mlflow tracks kernel benchmark metrics, artifacts, and parameter permutations across hardware runs. Hosted Claude API accessed over HTTPS for code commentary; kernel execution applies strictly to local open code.

Submit runnable source, pinned dependencies, setup commands, a working interface, example outputs, and a recorded end-to-end demo. Include tests and an action log.

Calculates percentage speedup or regression of candidate kernels over baseline operations.

Identifies register spilling into local memory that causes memory stall cycles.

Generates structured tuning recommendations for optimal tile and warp dimensions.

```json [ { "input": { "kernel_name": "fused_fp8_gemm", "block_m": 64, "block_n": 64, "registers_per_thread": 142, "spill_stores_bytes": 2048, "latency_us": 48.2, "baseline_us": 35.1 }, "expected_output": { "status": "REGRESSION", "spill_detected": true, "speedup_ratio": 0.73, "recommendation": "reduce_tile_size_to_32x64_to_relieve_register_pressure" } }, { "input": { "kernel_name": "fused_fp8_gemm", "block_m": 32, "block_n": 64, "registers_per_thread": 96, "spill_stores_bytes": 0, "latency_us": 22.4, "baseline_us": 35.1 }, "expected_output": { "status": "IMPROVED", "spill_detected": false, "speedup_ratio": 1.57, "recommendation": "adopt_configuration_for_production_profile" } } ] ```

Benchmarks open-source Triton code in isolated local user environments without accessing closed server systems. Use mock external writes. Require human review before any real deployment.