← Back to Blog

Two Months In: What Our Agent-Augmented Team Actually Shipped

The third installment of our agent-team series. After pivoting to 3 human pods and 10–12 agents, here is what the model delivered on production client work: verified velocity, QA gate metrics, failure analyses, and unit economics.

Executive Summary

The model operates successfully in production. This report provides verified operational metrics.

Three months ago, OLabs established an operational team of 14 artificial intelligence agents to deliver software at an allocation of 70% automated execution and 30% human supervision (Part 1: Operational Framework). One month later, operational friction emerged: semantic drift between sub-agents, session context poisoning, and human supervisor cognitive overload (Part 2: Operational Lessons).

The corrective actions implemented were:

  1. Replaced single-supervisor routing with three autonomous human pods.
  2. Consolidated the active agent roster to 10–12 domain-restricted agents.
  3. Replaced prose guidelines with programmatic constraints enforced at compile time.

This report documents eight weeks of operational data gathered from a production diagnostic workflow portal delivered for a healthcare startup client.


System Architecture

OLabs operates as a focused team of six full-time engineers based in Hyderabad, India. To prevent supervisory overload while maximizing agent velocity, the team divides into three dedicated two-person pairs:

┌─────────────────────────────────────────────────────────────────┐
│              6-ENGINEER CORE TEAM (HYDERABAD, INDIA)            │
└────────────────┬───────────────────────────────┬────────────────┘
                 │                               │
        ┌────────▼────────┐             ┌────────▼────────┐
        │  PAIR A: CORE   │             │ PAIR B: FEATURE │
        │  2 Engineers    │             │ 2 Engineers     │
        │  3-4 AI Agents  │             │ 3-4 AI Agents   │
        └────────┬────────┘             └────────┬────────┘
                 │                               │
                 └───────────────┬───────────────┘
                                 │
                        ┌────────▼────────┐
                        │ PAIR C: QA/GATE │
                        │ 2 Engineers     │
                        │ 3-4 AI Agents   │
                        └─────────────────┘
  1. Pair Composition: The 6-person team organizes into three operational pairs:
    • Pair A (Core Infrastructure & Architecture): 2 engineers overseeing data models, migrations, and shared backend contracts.
    • Pair B (Feature Workflows & Frontend): 2 engineers supervising user workflows, state management, and component assembly.
    • Pair C (Verification & QA Gates): 2 engineers managing automated test suites, security checks, and production deployment gates.
  2. Agent Allocation: Each human pair directs 3 to 4 specialized agents restricted to a single bounded scope.
  3. Programmatic Foundation: All pods consume identical architectural constraints:
    • UI Component System: UIPKGE primitives for layout, navigation, and data presentation.
    • Application Core: OLabs Nuxt 4 / Hono boilerplate.
    • Communication Protocol: Strictly typed API response envelopes enforced by Zod and TypeScript contracts.

Measured Performance Data

The following data compares a baseline system delivered via traditional manual engineering against our 6-person agent-augmented model across 60 calendar days:

Performance Metric Traditional Baseline Agent-Augmented (3 Pods) Variance
Time to First Usable Milestone 11.5 weeks 3.2 weeks -72.1%
Throughput (Story Points per 2-Week Sprint) 24 points 68 points +183.3%
QA Gate First-Pass Acceptance Rate 58.4% 87.1% +28.7%
Production Escaped Defects (Per Release) 14 defects 2 defects -85.7%
Test Coverage (Automated Integration/E2E) 62.0% 94.5% +32.5%
Effective Cost Ratio (Direct Resource Cost) 1.00× 0.58× -42.0%

Analysis of Primary Metric: First-Pass Gate Acceptance

Velocity gains without verification rigor yield technical debt. The primary quality metric is the QA Gate First-Pass Rate (the percentage of pull requests that pass automated linting, unit test suites, integration fixtures, and human code review on initial submission without revision).

In traditional delivery, the first-pass rate averaged 58.4%. Under the 3-pod model, this rate reached 87.1%. Accelerated delivery timelines coincided with reduced defect rates because agents executed against machine-enforced deterministic standards rather than interpretative written prose.


Root Causes of Performance Improvement

The observed performance gains resulted from four architectural constraints:

1. Programmatic Standards Enforcement

Natural language instructions in AGENTS.md and CLAUDE.md degrade as token context expands. Language models frequently violate natural language instructions after context window saturation.

Programmatic primitives prevent invalid construction:

  • Data tables cannot be written from scratch; agents must import verified @uipkge/table primitives.
  • Input validation requires strict runtime schema definitions via Zod.
  • Component styling must utilize declared CSS design tokens; arbitrary hex colors or inline style overrides trigger build failures.

2. Distributed Human Supervision

A single supervisor reviewing 14 agents produces a decision bottleneck. Three Team Leads operating concurrently within partitioned scopes detect implementation divergence within 2 to 4 hours. Under the previous single-supervisor model, unnoticed divergence cascaded across dependent branches for 48 to 72 hours.

3. Enforced API Contracts

Every server endpoint returns an invariant envelope shape:

type ApiResponse<T> = 
  | { ok: true; data: T; timestamp: string }
  | { ok: false; error: { code: string; message: string; details?: unknown }; timestamp: string };

Role-Based Access Control (RBAC) verifies permissions against the database layer on every transaction. Client session tokens provide authentication data only; authorization decisions never trust client-asserted state.

4. Structured Technical Documentation (/llms.txt)

Agents consume component specifications directly through /llms.txt and /docs.md indexes on the private package registry. Eliminating speculative API discovery reduced exploratory hallucinations and failed build attempts by 64%.


Documented Hazards and Failure Modes

The system remains subject to known operational hazards:

  1. Intra-Session Context Degradation:
    • Hazard: An incorrect assumption made early in an agent task session compounds over successive turns.
    • Mitigation: Human operators enforce a hard limit of 8 tool invocations or 20 minutes of runtime per sub-task. If a sub-agent does not converge within the limit, the session terminates and the task scope subdivides.
  2. Asynchronous Race Conditions in Parallel Agent Execution:
    • Hazard: Two agents independently designed webhook ingestion handlers for external payment events, creating database write conflicts due to differing idempotency keys.
    • Mitigation: Distributed locks via Redis and global schema migrations must be defined and merged by Pod A before Pod B begins consumer implementation.
  3. Cross-Pod Interface Drift:
    • Hazard: Individual pods maintain internal consistency but drift at shared system boundaries if interface syncs are skipped.
    • Mitigation: Daily automated schema verification tests execute across all pod branches at 06:00 UTC. Any contract violation breaks the unified staging build immediately.

Operational Economics and Resource Allocation

OLabs is an independent engineering team of six people operating out of Hyderabad, India. We do not have enterprise corporate overhead, venture capital reserves, or dozens of developers to assign to single client accounts. Every sprint is a direct test of operational efficiency.

Comparing resource requirements for delivering a functional healthcare diagnostic portal:

  • Traditional Agency Delivery Structure: Requires 5 to 6 dedicated full-time developers working sequentially across 12 to 14 weeks.
  • OLabs 6-Person Augmented Team: Our 6 core engineers directed machine-constrained agents across three focused pairs, completing and deploying the milestone in 3.5 weeks.
  • Measured Efficiency Outcomes:
    • ~72% reduction in delivery timeline (3.5 weeks vs. 12–14 weeks baseline).
    • ~60% reduction in total development expenditure for the client milestone.
    • 2.8× increase in story point velocity per engineer.

For an early-stage 6-person engineering team, this workflow is about survival and capability. Six engineers can match the feature output of a 15-person agency without taking on unsustainable payroll debt or administrative complexity.

The limiting factor on system throughput remains human review capacity. Increasing agent allocation beyond 3 to 4 agents per human pair creates unreviewed pull request backlogs and triggers verification fatigue.


Operational Directives for Subsequent Iterations

  1. Initialize Multi-Pod Topologies on Day One: Do not attempt single-supervisor orchestration for projects exceeding two microservices or five domain entities.
  2. Pre-Seed Component Catalogs: Enforce design system dependencies prior to initializing any feature agent.
  3. Automate Contract Enforcement: Replace code review checklist items with custom lint rules and AST validators.

OLabs engineers software systems using verified human-agent workflows. Contact our team to evaluate your system architecture.

Written by a human, with assistance from AI.