langwatch.ai — agentic threat model

Not certain from the listing — LangWatch is model-agnostic and does not host foundation models directly, but it evaluates LLM outputs and could be exposed to adversarial prompt injections contained within the monitored traces.

LangWatch ingests, processes, and stores multi-turn conversation traces, system prompts, and evaluation metrics. The primary threat is data exfiltration or leakage of sensitive user data contained within these telemetry streams.

Not certain from the listing — LangWatch integrates with external agent frameworks to capture execution steps, but it does not orchestrate agent planning or execute tools itself, limiting direct framework-level execution threats.

As an open-core platform, LangWatch can be self-hosted or consumed as SaaS. Infrastructure threats include unauthorized access to the monitoring dashboard, API key exposure, and potential container vulnerabilities in self-hosted deployments.

This is LangWatch's core domain. Threats include evaluation gaming, blind spots in complex multi-agent interactions, and evasion of guardrails or anomaly detection mechanisms by malicious agent behaviors.

Not certain from the listing — The open-core model requires robust role-based access control (RBAC) and data retention policies to prevent unauthorized access to sensitive LLM interaction logs, though specific compliance certifications are not detailed.

LangWatch is specifically designed to monitor multi-agent systems. The primary ecosystem threat is cascading failures where compromised or rogue agents corrupt the telemetry pipeline, leading to inaccurate system-wide evaluations.