Infrastructure Components#

What You’ll Learn

Gateway-First Processing Architecture:

  • Gateway-driven message processing with universal entry point patterns

  • Task extraction system converting conversations into actionable requirements

  • LLM-powered classification and intelligent routing for capability selection

  • Plan-first and reactive (ReAct) orchestration modes

  • Adaptive response generation and sophisticated error handling with recovery

Prerequisites: Understanding of Core Framework Systems and LangGraph StateGraph concepts

Target Audience: Infrastructure developers and agentic system architects building reliable, controllable execution pipelines

The Infrastructure Components provide the intelligent processing core that makes sophisticated agentic behavior possible while maintaining the reliability and oversight required for production systems. Master these components, and you’ll understand how to build agents that combine LLM intelligence with predictable, controllable execution.

Architecture Overview#

The Osprey Framework implements a Gateway-First, Three-Pillar Architecture with structured orchestration that replaces ad-hoc tool calling with coordinated, auditable execution:

Traditional Approach:

User Query → Tool Call 1 → Analyze → Tool Call 2 → Analyze → Tool Call 3 → Response

Plan-First Approach (default):

User Query → Complete Plan Creation → Execute All Steps → Response

Reactive Approach (ReAct):

User Query → Decide Step → Execute → Observe → Decide Next Step → ... → Response

Both modes provide full context utilization, natural human oversight, and capability validation. Plan-first minimizes LLM calls; reactive adapts dynamically to intermediate results.

The Three Pillars#

🧠 Task Extraction

Conversational Context Compression

Converts chat history into structured, actionable tasks with resolved references and context.

Task Extraction
🎯 Classification & Routing

Intelligent Capability Selection

LLM-powered analysis with few-shot examples to select appropriate capabilities for tasks.

Classification and Routing
🎼 Orchestrator Planning

Complete Execution Coordination

Plan-first and reactive orchestration with capability validation and approval integration.

Orchestrator Planning

Supporting Infrastructure#

🚪 Gateway Architecture

Universal Entry Point

Single message processing interface with state management and approval integration.

Gateway Architecture
💬 Message Generation

Adaptive Response System

Context-aware response generation with clarification workflows.

Message Generation
🔧 Error Handling

AI-Powered Recovery

Intelligent error classification with LLM-generated user explanations.

Error Handling
🚀 Next Steps

Now that you understand the infrastructure architecture, explore the processing pipeline:

🚪 Start with Gateway

Universal entry point for all message processing with state management and approval integration

Gateway Architecture
🧠 Follow the Pipeline

Task extraction, classification, orchestration - the three-pillar processing flow

Task Extraction
🔧 Build Resilience

AI-powered error recovery with intelligent retry policies and user communication

Error Handling
💬 Master Communication

Adaptive response generation with clarification workflows and domain customization

Message Generation