A technical publication by Shubham Jindal

Not the LLM

The model is the center. The system is the product.

LLMs matter, but production AI is shaped by what surrounds the call: context retrieval, tool contracts, agent harnesses, runtimes, evals, observability, security, and governance.

Production AI / system cutawayA model call, wrapped for reality.
  1. Securityidentity · permissions · guardrails
  2. Governancepolicy · audit · approvals
  3. Observabilitytraces · latency · cost
  4. Evalsquality · regressions · task success
  5. MCP + toolscapabilities · data · action
  6. Harnessplans · loops
  7. Context
raw capabilityLLMreasoning + generation
Runtimestate · queues · sandboxes · latency · cost · scale
Capability starts at the center.Reliability accumulates outward.

Latest

Writing

Agents

It's Not the LLM. It's the Harness.

Why the same model behaves like a different agent when context, tools, state, permissions, and control loops change around it.

MCP

It's Not the LLM. It's the MCP.

Why capable agents fail when their tool interfaces overwhelm context, and how small verbs plus registry dispatch change the architecture.