https://docs.justcat.it/reference/tests/ Recent content in Tests on Hugo -- gohugo.io Wed, 19 Aug 2026 10:00:00 +0200 https://docs.justcat.it/reference/tests/properties/ Wed, 19 Aug 2026 10:00:00 +0200 https://docs.justcat.it/reference/tests/properties/ These properties apply wherever the definition lives — inline in the project file, in other YAML files, or in any provider that returns rows (Excel, a database query, …); sources can be combined. In YAML they are keys; in a tabular source they are the columns of one row. See Lists. Tests: - Name: Currency dimension is loaded Suite: Smoke tests Data source: FlightsSystem Query: SELECT * FROM Dimension.Currency Expectation: set is not empty Properties # Property Also accepted as Required Default Meaning Name Test name yes — Name of the test. https://docs.justcat.it/reference/tests/templates/ Wed, 19 Aug 2026 10:00:00 +0200 https://docs.justcat.it/reference/tests/templates/ A definition whose Metadata property has a value is not a test. It is a template, and it is never executed as written. Metadata holds the name of a query definition in the same project; the match ignores case. When the project is opened, CAT runs that query against the data source the query names, and produces one test per returned row. In every property of the template — the name, the description, the queries, all of them — the text %COLUMN% is replaced with that row’s value in the column called COLUMN. https://docs.justcat.it/reference/tests/order-and-key/ Tue, 25 Jan 2022 14:40:56 +0100 https://docs.justcat.it/reference/tests/order-and-key/ Sets match and Contains compare two sets the same way: CAT reads both from the top, row by row, and steps forward on the side that is behind. That only works when both sets arrive in the same order. This page covers the two ways of getting them there and the optional Key. Both sets must be sorted # The comparison never loads the sets whole — it walks them. A row that is out of order is a row CAT cannot find on the other side, and the test fails for the wrong reason. https://docs.justcat.it/reference/tests/tolerance/ Tue, 25 Jan 2022 14:40:56 +0100 https://docs.justcat.it/reference/tests/tolerance/ Two sets can differ by an amount that does not matter to the test: First set Second set 81.99999 82.0 82.00001 82 Tolerance tells Sets match and Contains how far apart two numbers may be and still match. It applies to every pair of values that both read as numbers; text, dates and NULLs are unaffected. Absolute tolerance # Tolerance states how large a difference still counts as equal, in the unit of the values: https://docs.justcat.it/reference/tests/results/ Fri, 21 Aug 2026 10:00:00 +0200 https://docs.justcat.it/reference/tests/results/ Results # Result Meaning Passed The queries ran and the expectation holds. Failed The queries ran and the expectation does not hold. The message says why — see Failure message. Error The expectation could not be evaluated. The message carries the cause: a data source or query the project does not define, a statement the provider refused (with the provider’s own error), a second-set property on a one-set expectation, a key that cannot be compared, or a Timeout that expired. https://docs.justcat.it/reference/tests/failure-message/ Tue, 25 Jan 2022 14:40:56 +0100 https://docs.justcat.it/reference/tests/failure-message/ Every test ends with a result and a message. A Failed test’s message depends on the expectation: Set is not empty: At least one row was expected but the query didn't return any results. Set row count: The expected row count 5 did not match the actual row count 7. Set is empty: No row was expected, but at least 1 row exists., a sample of the rows, and whether CAT read the whole set — the same shape as the two below.