Together AI's Dan Fu, Vice President of Kernels, explains how Together AI leverages NVIDIA GPUs to deliver AI responses in under 100 milliseconds while achieving some of the industry's lowest token...
Together AI's Dan Fu, Vice President of Kernels, explains how Together AI leverages NVIDIA GPUs to deliver AI responses in under 100 milliseconds while achieving some of the industry's lowest token costs. From developing a megakernel that fits an entire model into a single CUDA kernel to powering real-time voice agents that return their first 64 words in under 100 milliseconds, Together AI is focused on minimizing latency at every layer of the AI stack.
This website uses cookies
Comments 0
Be the first to comment!