Agentic Compiler Engineer

From the original posting

Paris, France ABOUT KOG Kog builds a co-designed inference stack for real-time AI agents on standard NVIDIA and AMD datacenter GPUs, spanning model architecture, inference engine, compilers, and low-level GPU kernels. We developed Laneformer 2B and Delayed Tensor Parallelism (DTP), a Transformer architecture designed to overlap communication with computation. Our inference stack generates 3,500 tokens/s per request on 8 AMD MI300X GPUs and 2,100 tokens/s per request on 8 NVIDIA H200 GPUs, in FP16 at batch size 1, without quantization or speculative decoding. Our next challenge is making model…