Runbook: move Xray test cases into TestWarden with CSV
Export, check, map, preview, import, reconcile. What the Xray adapter brings (cases, steps, priority, labels) and what stays behind (executions, sets, plans, attachments).
Xray alternative
Teams on Xray usually ask one of two things: can we add something above it, or can we replace it? Both are supported, and neither is required. Leave Xray in place and let The Warden decide whether the proof for each build is enough, or move test cases into native Jira testing with TestWarden.
Two adoption paths
Xray describes itself as Jira-native quality management covering manual and automated testing. TestWarden is a narrower Jira Cloud product with a different centre of gravity: native test management plus an independent verification authority. Choose by the decision you need to make, not by a feature count.
Your CI keeps running tests and, if you use it, keeps importing results into Xray. Add a step that submits the same complete JUnit XML, or a SARIF report from a scanner, to The Warden over the Forge App REST API. A read-only Xray Cloud collector is in source and still under acceptance. It is not live, and nothing is synchronised. The Warden evaluates the evidence you send for the exact build against a versioned contract.
Import manual test cases from the Xray Test Case Importer CSV, rebuild cycles in Plans & Runs, and run tests, defects and coverage in one Jira app that includes The Warden. Test cases move; execution history does not, so decide what to retain first (see below).
Capability matrix
The Xray column comes from Xray's own Marketplace listing and documentation. Where those pages say nothing, this table says nothing.
| Topic | Xray, per vendor documentation | TestWarden |
|---|---|---|
| What it is | Jira-native test and quality management using native Jira issue types for manual and automated testing. | Jira-native test management (shared library, structured steps, cycles, version-pinned attempts, coverage) plus The Warden, an evidence-based verification authority. |
| Hosting | Listed for Jira Cloud, Server and Data Center. | Jira Cloud on Atlassian Forge. TestWarden is publicly listed on Atlassian Marketplace; direct provider connectors remain separately staged. |
| Automation results | Import endpoints for Xray JSON, Cucumber JSON, JUnit, NUnit, xUnit, TestNG, Robot Framework and Behave results; REST and GraphQL APIs. | Evidence intake for JUnit XML, SARIF 2.1.0 and provider-neutral JSON, tied to repository, commit, build and environment. Submitted results are evidence for a decision, not test-run records. A read-only Xray Cloud collector is in source, not live. |
| Who decides readiness | Not described as a verification authority in the documentation reviewed; teams typically use reports and their own gates. | A deterministic policy returns CLEARED, VERIFYING, HELD, NEEDS APPROVAL or INCOMPLETE with fixed reason codes. No external pass can set CLEARED. |
| Pricing model | Paid through Atlassian Marketplace with Standard and Advanced editions and a free trial, per the Marketplace listing. This page quotes no vendor prices. | Free for sites up to 10 Jira users, a 30-day evaluation for larger sites, then user-tiered Standard. See the pricing page. |
Product pricing and plan details change; see the pricing page for TestWarden and Xray's own Marketplace listing for theirs. The eight questions that separate tools make a good evaluation checklist.
Switching from Xray
The Migration Center reads the Xray Test Case Importer CSV, or a Jira/Xray CSV with the Manual Test Steps JSON field: upload, mapping detection, preview, resumable import and a per-row fidelity report. It migrates test cases.
| In Xray | In TestWarden |
|---|---|
| Test (manual) | Test case with structured steps, imported |
| Summary, description, priority, labels | Title, description, priority, tags, imported |
| Test Set | Not imported. Recreate as a folder or tag. |
| Test Plan, Test Execution | Not imported. Rebuild as cycles in Plans & Runs. |
| Precondition issue | Not imported as a linked object. Precondition text on the test is kept. |
| Execution results, attachments | Not migrated by any TestWarden adapter. |
Historical executions and attachments do not move with the CSV. Retain your Xray site, or export the executions and reports you need for audit, before you retire it, and start clean cycles in TestWarden. If history must stay queryable in Jira, running both side by side through one release cycle is the lower-risk route.
Full details are on the Migration page, in the documentation and in Migrating from the Xray Test Case Importer CSV.
Choose. Pick the source: Xray Test Case Importer CSV, Zephyr Scale CSV, or a generic CSV such as an AIO Tests export. Here, a 412-row export.
Evaluate it yourself
Fit
If you need Server or Data Center hosting today, or a deep BDD and automation-import workflow inside the test manager, Xray's documented scope may fit better.
Get TestWarden on MarketplaceSources
Vendor statements on this page were checked against the official pages below on 2026-10-18. Vendors change products and plans; confirm current details with them.
From the blog
Export, check, map, preview, import, reconcile. What the Xray adapter brings (cases, steps, priority, labels) and what stays behind (executions, sets, plans, attachments).
Now available on Atlassian Marketplace
TestWarden is listed on the Atlassian Marketplace for Jira Cloud. Keep your existing test-management and CI tools, and add The Warden's independent verification layer—or use TestWarden's built-in Jira test management. Visit the Marketplace to get started; we're here if you want guided setup or migration help.