Baker Street
← Back to Features

Conversational AI Agent

Claude reasoning with tool dispatch, streaming responses, and full conversation context.

The Problem

Most AI integrations are glorified API wrappers. You send a prompt, get a response, and lose all context. There is no tool use, no multi-step reasoning, no way for the model to decide what to do next based on what it learned in the previous step. Building a real agent loop from scratch means handling streaming, tool dispatch, error recovery, and iteration limits yourself.

How Baker Street Solves It

The Baker Street Brain is a full agent orchestrator built on Claude. When you send a message, the Brain loads your conversation history, searches vector memory for relevant context, and hands everything to Claude along with a set of available tools. Claude decides what to do: answer directly, store a memory, dispatch a background job, query an extension, or any combination.

The agent can iterate up to 10 tool calls per turn, chaining results from one step into the next. Responses stream back in real time via Server-Sent Events, so you see the agent thinking as it works. The personality system (SOUL.md, BRAIN.md) shapes how the agent reasons and responds, making behavior configurable without code changes.

An observer runs after each conversation, using a lighter model to extract structured observations: decisions, preferences, facts, and patterns. These compress into long-term understanding that grows over time.

Example

# k8s/brain-deployment.yaml
apiVersion: apps/v1
kind: Deployment
metadata:
  name: baker-street-brain
spec:
  replicas: 1
  template:
    spec:
      containers:
        - name: brain
          image: baker-street/brain:latest
          env:
            - name: ANTHROPIC_API_KEY
              valueFrom:
                secretKeyRef:
                  name: baker-street-secrets
                  key: anthropic-api-key
            - name: DEFAULT_MODEL
              value: claude-sonnet-4-20250514
          volumeMounts:
            - name: personality
              mountPath: /app/operating_system
      volumes:
        - name: personality
          configMap:
            name: baker-street-personality

Learn More

See the Architecture documentation for a deep dive into the Brain's reasoning loop and tool dispatch system.