CAT 1.11.0

You keep sending us tons of feedback, thank you very much for that! In this release, we addressed a few issues you reported.

Erroneous data sample #

CAT by default shortens strings in the sample of erroneous data, like this:

┌────┬────┬─────┬──────────────────────────┐
│(1) │(2) │(ID) │Message                   │
╞════╪════╪═════╪══════════════════════════╡
│ <  │    │1    │! Foo                     │
│    │ >  │1    │! Bar                     │
│ <  │    │3    │! Lorem ipsum dolor si... │
│    │ >  │3    │! Lorem ipsum dolor si... │
╞════╪════╪═════╪══════════════════════════╡
│(1) │(2) │(ID) │Message                   │
└────┴────┴─────┴──────────────────────────┘

Tables with columns containing JSON or other long texts are often part of the comparison. It simply does not make any sense to output texts with thousands of characters into the message (Azure DevOps would not display it in a usable manner anyway). But you reported that sometimes you just need much longer output (e.g., when the column contains file paths etc.). Now you can tweak it on a test level with Maximum sample column length:

- Name: Check we loaded all files
  Description: >
    Checks whether all JSON files were loaded into staging
  First Data Source: csv
  First Query: SELECT * FROM csv."files for import" ORDER BY file_path
  Second Data source: dwh
  Second Query: SELECT FilePath FROM Staging.Files ORDER BY FilePath
  Expectation: sets match
  Maximum errors logged: 30
  Maximum sample column length: 250 # <-- this is the new setting

Timeouts #

Users reported timeout issues with some less often used Providers. We reviewed all of them, now you should not have problem with any of the supported providers.

Just specify Timeout for a test, it will be honored:

- Name: Status can contain only values as Open, Closed, Suspended
  Test Suite: Completeness Data Quality Dimension
  Description : This test finds if column status has wrong value
  Data Source: Your data source
  Query: |
      SELECT *
      FROM staging.payments
      WHERE status NOT IN ('Open', 'Closed', 'Suspended');
 Expectation: set is empty
 Timeout: 180 # seconds

Our plans #

By the end of the next week there will be one more release addressing other stuff you reported. Then we plan to focus more on the CAT studio (GUI for CAT). Stay tuned!

That’s it :-). Happy testing.

CAT team