In Episode 2 of AI Factory Insider, host Kaushik Shirhatti (VP, AI Factory, NVIDIA) is joined by Nic Borensztein (Distinguished Solution Architect, AI Factory, NVIDIA) and Jon Fernandez (Director, Enterprise AI Compute, NVIDIA) to go behind the scenes on how we operate our internal AI factory at scale.
What we cover
0:00 — Introduction & guests
0:56 — What is an Enterprise Validated Design (EVD)
3:35 — Building & validating the full software stack with partners
4:44 — Security in enterprise AI
6:06 — NVIDIA IT AI factory success story
7:02 — Why enterprises go on-prem: ROI, tokenomics & compliance
9:12 — Inside NVIDIA's own AI factory: the secure agent workspace
12:47 — Origin story: how our AI factory journey started
14:27 — Scale: 4 trillion tokens/month & 200M inference requests/day
16:10 — Use cases across every function (and why everyone's a developer now)
17:47 — Chip Nemo: AI for chip design
19:05 — Agent harnesses, the perceive-reason-act loop & secure workspaces
22:51 — What's next: confidential computing for on-prem frontier models
25:46 — Key takeaways & next episode preview
Resources
Secure Agent Workspace Reference Design
NVIDIA Enterprise AI Factory - Design Guide White Paper
NVIDIA’s AI Factory Drives Enterprise Innovation at Scale
What we cover
0:00 — Introduction & guests
0:56 — What is an Enterprise Validated Design (EVD)
3:35 — Building & validating the full software stack with partners
4:44 — Security in enterprise AI
6:06 — NVIDIA IT AI factory success story
7:02 — Why enterprises go on-prem: ROI, tokenomics & compliance
9:12 — Inside NVIDIA's own AI factory: the secure agent workspace
12:47 — Origin story: how our AI factory journey started
14:27 — Scale: 4 trillion tokens/month & 200M inference requests/day
16:10 — Use cases across every function (and why everyone's a developer now)
17:47 — Chip Nemo: AI for chip design
19:05 — Agent harnesses, the perceive-reason-act loop & secure workspaces
22:51 — What's next: confidential computing for on-prem frontier models
25:46 — Key takeaways & next episode preview
Resources
Secure Agent Workspace Reference Design
NVIDIA Enterprise AI Factory - Design Guide White Paper
NVIDIA’s AI Factory Drives Enterprise Innovation at Scale
This website uses cookies
Comments 0
Be the first to comment!