How to set up Products & Connections in Truvyx
Create a product profile, separate development, staging, and production, choose a connection method, and verify the first safe request.
Read guideYou should not need to understand evaluation theory before you can use the platform. These guides walk through the practical path: what to click, what to write, what the result means, and what to do next.
Create a product profile, separate development, staging, and production, choose a connection method, and verify the first safe request.
Read guideTurn decisions, constraints, handoffs, and acceptable variations into evidence an AI evaluation can check.
Read guideLearn why three complementary dimensions reveal more than one accuracy number when you evaluate an AI agent.
Read guideWrite small, clear, repeatable checks for fields, constraints, tool calls, traces, and evidence.
Read guideMove from a failed run to an evidence-backed cause across prompts, tools, handoffs, constraints, and traces.
Read guideChange one variable at a time, compare the evidence, and promote the smallest verified repair into a regression test.
Read guideCreate a scoped key, connect the Truvyx MCP server, inspect its manifest, investigate runs, and trigger safe test workflows from your editor.
Read guideInstall the TypeScript or Python SDK, run an evaluation, read EvalResult, add CI gates, capture traces, and protect multi-agent contracts.
Read guideUnderstand model pricing, token usage, redundant calls, cost per correct decision, and efficiency benchmarks.
Read guideMeasure human-agent friction, find correction patterns, and improve escalation workflows with evidence.
Read guideCreate controlled MCP fault-injection experiments, score agent recovery, and export resiliency evidence.
Read guideAsk grounded questions about runs and RCA findings, then track recurring failures automatically.
Read guideTrace a failed run to its root cause, test counterfactual fixes, and create a verified remediation plan.
Read guideFind, inspect, download, cite, reuse, and contribute validated AI evaluation scenarios.
Read guideDesign agent nodes, dependencies, information boundaries, contracts, anti-pattern checks, and framework exports from one visual canvas.
Read guideGenerate, inspect, test, download, and run versioned verifier scripts, then connect evidence to Evaluation Runs and CI/CD.
Read guideDefine hard and soft constraints, check feasibility, configure escalation, protect sensitive fields, and connect rules to verification and diagnosis.
Read guideA beginner-first walkthrough of the real Scenario Studio workflow: domains, templates, Natural Language generation, constraints, saving, and the next module to open.
Read guideCreate a scenario, submit an agent output, and understand what PASSED, FAILED, and PARTIAL mean.
Read guideTurn a vague expectation into constraints, ground truth, and checks that can produce a useful diagnosis.
Read guideUse an API key, submit camelCase evaluation fields, poll the result, and handle failures safely.
Read guideLearn the difference between a score, a violation, a completeness gap, and a root-cause signal.
Read guideBuild a small regression suite and add evaluation to the development workflow without creating noise.
Read guide1. Scenario: describe what good behaviour looks like.
2. Run: submit what your agent actually did.
3. Diagnose: fix the smallest cause the evidence points to.