Context Window

Context Window Structure

An Octopus context window is a structured list of messages, each with a role and content. The LLM processes them in order:

// Example context window for one agent turn:
[
  {
    "role": "system",
    "content": "You are Aria, the HR specialist for Acme Corp. Your domain is..."
    // ← SystemPrompt from AgentComposite
  },
  {
    "role": "system",
    "content": "[Procedure: vendor_onboarding]\nTo onboard a vendor, follow these steps: ..."
    // ← Matched procedure from procedural memory
  },
  {
    "role": "context",    // treated as system in most LLM APIs
    "content": "[Retrieved Knowledge]\nSource: HR Policy 2025.pdf\n..."
    // ← Semantic memory retrieval results
  },
  {
    "role": "context",
    "content": "[Past Conversation Context]\n2025-03-14: User asked about leave balance..."
    // ← Episodic memory snippets
  },
  {
    "role": "user",
    "content": "Hi, can you help me add a new supplier?"
    // ← Turn 1 of message history
  },
  {
    "role": "assistant",
    "content": "Of course! To add a new supplier, I'll need the supplier name..."
    // ← Turn 1 response (from history)
  },
  {
    "role": "user",
    "content": "Onboard TechCorp as a new vendor, contact is procurement@techcorp.com, contract CTR-2025-001"
    // ← Current user message (turn 2)
  }
]

Role Mapping per LLM Provider

Context Window Size Per Provider