DocsSelf-Hosted Evaluation

Self-Hosted Evaluation

Guide

Deploy AKIOS Pro in your infrastructure, connect it beside your existing agent stack, and validate evidence collection — all self-hosted, no data leaves your boundary.

Prerequisites#

Infrastructure

  • • Docker Engine 24+
  • • 8GB RAM minimum
  • • 50GB available storage
  • • Linux x86_64 or ARM64

Integration Target

  • • LLM gateway access (logs or stream)
  • • Agent tool activity feed
  • • Optional: SIEM or data warehouse
  • • Network: outbound to your stack

What AKIOS Pro does not require

AKIOS Pro does not require modifying your agent code, replacing your workflow engine, or routing traffic through a cloud service. It deploys beside your existing stack.

1. Deploy AKIOS Pro#

1

PULL THE IMAGE

AKIOS Pro ships as a single Docker image. Pull it to your evaluation environment.

bash
docker pull akioudai/akios-pro:latest
2

START THE CONTAINER

Run AKIOS Pro with your evaluation license. Data is retained locally.

bash
docker run -d \
  --name akios-pro \
  -p 8080:8080 \
  -v akios-data:/data \
  -e AKIOS_LICENSE_KEY=eval-xxxx \
  akioudai/akios-pro:latest
3

VERIFY THE DEPLOYMENT

Confirm AKIOS Pro is running and accepting evidence connections.

bash
curl http://localhost:8080/health
# Expected: {"status":"ok","version":"1.0.0","uptime":"12s"}

2. Connect to Your Stack#

1

CONFIGURE EVIDENCE SOURCES

Point AKIOS Pro at your LLM gateway logs, tool activity streams, or agent telemetry.

bash
# Configure a gateway log source
docker exec akios-pro akios sources add \
  --type gateway \
  --endpoint https://your-gateway.internal \
  --format openai

Supported sources

LLM gateways (OpenAI, Anthropic, custom), tool execution logs, model responses, SIEM event streams, and webhook integrations.

2

VERIFY EVIDENCE COLLECTION

AKIOS Pro begins recording traces, policy findings, and PII signals immediately.

bash
# Check evidence status
docker exec akios-pro akios status

# Expected output
# Sources: 1 connected
# Traces: 247 recorded
# Findings: 12 (2 PII, 3 policy, 7 review)
# Retention: 30 days

3. Review Evidence#

Evidence PipelineObserve → Detect → Map → Export
Observe
LLM calls · Tool invocations · Policy events
Detect
PII exposure · Violations · Anomalies
Map
EU AI Act · GDPR · SOC 2 · HIPAA
Export
Evidence packs · SIEM · Audit

Open the AKIOS Pro dashboard at http://localhost:8080 to inspect evidence records:

Traces

Reconstruct agent sessions: prompts, tool calls, LLM responses, and decision points in chronological order.

Findings

Review PII exposure, policy violations, missing approvals, cost anomalies, and unresolved exceptions.

Export bundles

Package selected evidence into regulator-ready export files with control mappings and retention metadata.

4. Export Evidence#

1

SELECT EVIDENCE RANGE

bash
# Export last 7 days of evidence
docker exec akios-pro akios export \
  --from "2026-04-27" \
  --to "2026-05-04" \
  --format json \
  --output /data/export-2026-05-04.json
2

GENERATE EVIDENCE PACK

Evidence packs include traces, findings, control mappings, and retention attestations.

bash
# Generate a complete evidence pack
docker exec akios-pro akios pack \
  --id export-2026-05-04 \
  --include-controls \
  --include-retention-proof
# Output: /data/pack-export-2026-05-04.zip
3

SEND TO SIEM

Configure AKIOS Pro to forward evidence events to your SIEM for centralized monitoring.

Next Steps#