NVIDIA NVIDIA
July 16, 2026

How NVIDIA Runs Its Own AI Factory | AI Factory Insider Ep. 2

In Episode 2 of AI Factory Insider, host Kaushik Shirhatti (VP, AI Factory, NVIDIA) is joined by Nic Borensztein (Distinguished Solution Architect, AI Factory, NVIDIA) and Jon Fernandez (Director, Enterprise AI Compute, NVIDIA) to go behind the scenes on how we operate our internal AI factory at scale.

What we cover
0:00 — Introduction & guests
0:56 — What is an Enterprise Validated Design (EVD)
3:35 — Building & validating the full software stack with partners
4:44 — Security in enterprise AI
6:06 — NVIDIA IT AI factory success story
7:02 — Why enterprises go on-prem: ROI, tokenomics & compliance
9:12 — Inside NVIDIA's own AI factory: the secure agent workspace
12:47 — Origin story: how our AI factory journey started
14:27 — Scale: 4 trillion tokens/month & 200M inference requests/day
16:10 — Use cases across every function (and why everyone's a developer now)
17:47 — Chip Nemo: AI for chip design
19:05 — Agent harnesses, the perceive-reason-act loop & secure workspaces
22:51 — What's next: confidential computing for on-prem frontier models
25:46 — Key takeaways & next episode preview

Resources
Secure Agent Workspace Reference Design
NVIDIA Enterprise AI Factory - Design Guide White Paper
NVIDIA’s AI Factory Drives Enterprise Innovation at Scale
446

Comments 0

Replying to
5000 max

Be the first to comment!

This website uses cookies
This website uses cookies.
To maintain our services, we use cookies. They allow us to personalize ads, analyze our traffic, and provide social media features.

Customize your preferences

Select the cookies you accept: