Get Help

Properties

Every field an output carries for each test — the result and the whole definition — with the names CAT recognizes for a database column or parameter.

The file formats write a fixed set of these fields — JSON and YAML all of them, XLSX its 22 columns, JUnit and TRX what their schemas have room for; see each format’s page. A database output is different: CAT reads the columns of the table (or the parameters of the procedure) you point it at and writes the fields whose names it recognizes, in any order, any subset. This table is the list of names it recognizes.

Names are matched by naming convention — TestResult, test_result, TEST_RESULT and Test Result are the same column — and a procedure parameter may carry the prefix C_ (C_TEST_RESULT).

Property Also accepted as What it contains
Execution Guid Execution ID One GUID per run, the same on every row of the run — groups the tests that were run together.
Project Project Name Name of the project file, without .cat.yaml.
Test Full Name Full Name [Suite].[Order].[Test case].[Name], empty parts left out — see Test properties.
Test Result Result Passed, Failed, Error or Inconclusive — see Results.
Started On Started When the evaluation started (UTC).
Finished On Finished When it finished (UTC).
Message — The complete message: the verdict, the sample of rows, the description, the data sources and the queries — what Azure DevOps shows for a failed test.
Raw Message — The verdict and the sample of rows only, without description and queries.
Exception — For Error: the exception message.
Description — The test’s description.
First Data Source Data Source Name of the data source of the first query.
First Query Query Text of the first query.
Second Data Source — Name of the data source of the second query, if any.
Second Query — Text of the second query, if any.
Expectation — The expectation, as written in the definition.
Key — The test’s Key, if set.
Metadata Test Metadata The metadata query that generated the test, if it came from a template.
Tags Test Tags The test’s tags, comma-separated.
Suite Test Suite Part of the full name.
Test Case — Part of the full name.
Order Test Order Part of the full name.
Name Test Name The test’s name — not unique on its own.
Timeout Timeout in Seconds The test’s timeout, 0 when none.
Maximum Errors Logged — The test’s Maximum errors logged.
Thread Number Thread The thread the test ran in — 0, 1, 2, …
Number Of Errors — Total number of offending rows, when the test set Log number of errors; otherwise empty.
Log Number Of Errors — Whether the test set Log number of errors.
  • Results — the same fields as a test sees them.
  • Database outputs — how a table or procedure is matched against this list.
← Settings
JSON →