AI Quality Engineering Platform

Test your AI the way you'd test anything you had to defend in production.

TrustQE is a purpose-built testing platform for AI systems — covering RAG pipelines, LLM outputs, agent behaviour, security vulnerabilities, multi-modal models, and the Responsible AI checks that regulators and boards now expect.

Built by TrustAssay  ·  8 testing modules  ·  Web UI · CLI · pytest-native  ·  Provider-agnostic
Testing modules

Eight modules, one platform

M1 · RAG

RAG Assurance

Tests retrieval quality, groundedness, and answer faithfulness. Catches hallucination, context conflation, and retrieval failure before they reach production.

M2 · LLM

LLM Evaluation

Scores model outputs for accuracy, consistency, and hallucination rate against your own ground-truth test sets — not generic third-party benchmarks.

M3 · Security

Security Testing

Probes for prompt injection, jailbreak susceptibility, data leakage, and PII exposure. Generates evidence packs ready for security and compliance review.

M4 · Agents

Agent & MAS Testing

Validates multi-step agent behaviour, tool use, and failure recovery — including multi-agent systems. Includes a published Agent Memory Benchmark.

M5 · RAI

Responsible AI

Tests bias, fairness, overreliance, and safety refusal quality. Produces audit-ready evidence packs aligned to regulatory expectations.

M6 · Continuous

Continuous Eval

Tracks model behaviour across releases, detects quality drift between deployments, and integrates into CI/CD so regressions are caught before they ship.

M7 · Multi-Modal

Multi-Modal Evaluation

Tests vision-language models, document AI pipelines, and OCR systems — covering image faithfulness, chart interpretation, and structured field extraction.

M8 · XAI

Explainability

Real SHAP and LIME attribution, counterfactual testing, and attention analysis. Quantifies how and why a model reaches its outputs — for audit and governance.

Classical ML testing is on the roadmap.

Three interfaces

Built for how engineering teams actually work

Web UI

Explore results, review module outputs, and build evidence packs for stakeholders and auditors — without requiring CLI access or scripting knowledge.

CLI

Run any module from the terminal, script multi-module test sequences, and pipe results into your own tooling. Fits naturally into automation and pipeline workflows.

pytest-native

Drop TrustQE assurance checks directly into your existing test suite. AI quality gates live alongside your other tests — not in a separate silo.

Product preview

See it in action

Ecosystem integrations

Export to the tools your team already uses

RAGAS DeepEval Garak Promptfoo Langfuse LangGraph Azure Pipelines GitHub Actions

TrustQE results export natively to popular evaluation frameworks and observability platforms — so the data goes where your team already looks.

Provider support

Works with the stack you already use

Gemini  ·  OpenAI  ·  Anthropic  ·  Azure OpenAI  ·  Ollama (local models)

Why it exists

An AI system isn't production-ready because it works in a demo. It's production-ready when it can be tested, explained, and defended.

Most AI testing today is ad hoc — prompt experiments, manual spot-checks, borrowed benchmark scores. TrustQE replaces that with structured, repeatable assurance that stands up to audit.

See it on your own use case.

TrustQE is under active development. If you'd like a walkthrough or want to discuss piloting it on a live AI system, get in touch directly.