K
Research Engineer - LLM Architecture
Kog
حضوريهندسة
من الإعلان الأصلي
Paris, France ABOUT KOG Kog builds a co-designed inference stack for real-time AI agents on standard NVIDIA and AMD datacenter GPUs. We develop model architectures and inference systems together. Our work includes Laneformer 2B and Delayed Tensor Parallelism (DTP), a Transformer architecture that overlaps communication with useful computation and weight streaming. Our inference stack generates 3,500 tokens/s per request on 8 AMD MI300X GPUs and 2,100 tokens/s per request on 8 NVIDIA H200 GPUs, in FP16 at batch size 1, without quantization or speculative decoding. Our next challenge is to…
مقتطف من نص الإعلان الأصلي (الإنجليزية). التفاصيل الكاملة عند صاحب العمل.معرض وظائف لا يوظّف ولا يمثّل صاحب العمل. تفاصيل الإعلان الأصلي هي المرجع.