Matillion ETL release notes: v1.46
1.46.10 (interim release)
Bug fixes
Snowflake
- Fixed an issue that caused intermittent hanging of transformation jobs following the 1.46.8 update.
Redshift
- Fixed an issue where External Table Output could not populate the list of existing tables.
1.46.8 (interim release)
Improvements
All platforms
- Multi-line data types now supported.
Snowflake and Synapse
- Added support for Azure Blob Storage when running Azure Government Cloud.
Bug fixes
All platforms
- Fixed an issue in the Matillion ETL v1 API where the flag "onConflict=OVERWRITE" during job imports was not working.
- Fixed an issue where running a transformation job more than once concurrently could cause it to interfere with itself.
- Fixed an issue where mismatched value types passed validation.
- Multiple fixes to error messages.
- Multiple bug fixes for "Assert" Components.
Snowflake and Synapse
- Fixed an error related to asserting values on a view containing a datetime column.
BigQuery
- Multiple fixes to asserting struct metadata types.
1.46.7 (interim release)
Bug fixes
Redshift
- Fixed an issue where a recent Redshift update changing the Redshift cluster schema prevented Matillion ETL from using External Tables via Amazon Spectrum.
1.46 (major release)
New features and improvements
All platforms
- New Zendesk Chat Extract component allows users to load their Zendesk Chat data into an external table.
- New Zendesk Talk Query component allows users to load their Zendesk Talk data into a table.
- New MindSphere Extract component allows users to load their MindSphere data into a table (not available for Synapse).
- New "Assert" components can be used to test an existing object (Table, External Table, Scalar Variable, or View) against user-defined criteria. This allows users to prevent jobs continuing if resources are not in their expected state.
- New Assert Table component
- New Assert External Table component (not available for Synapse)
- New Assert Scalar Variable component
- New Assert View component
- New Recycle Bin feature gives users the opportunity to recover any deleted jobs before committing to deleting them completely.
- Reworked Component panel organization gives an alphabetized list of all connector components.
- Connectors that only import data into external tables have been renamed as "Extract" components.
Snowflake
- New Unpivot component can be used to convert table columns into additional table rows, the opposite of our existing Pivot component.
- A number of components have received property updates to better align with Snowflake.
Snowflake and Redshift
- New Zendesk Chat Extract component allows users to load their Zendesk Chat data into an external table.
Snowflake and BigQuery
- Additional data sources have been added to the Zuora Bulk Query component
- Revenue Schedule
- Revenue Event
- Revenue Event Item
- Revenue Event Item Invoice Item
- Revenue Event Item Invoice Item Adjustment
- Revenue Charge Summary Item
- Revenue Charge Summary
Redshift
- New Amazon Redshift Manage Shared Jobs allow users to perform common Redshift management tasks from within Matillion ETL jobs. This includes creating, pausing, and resizing clusters, creating and deleting snapshots, and modifying usage limits.
Azure Synapse
- New Rank component allows users to find the numerical rank of values in a column and output these ranks to a new column.
- New First/Last component allows users to create groups of data and return only the first or last rows from that group.
- New Lead/Lag component allows users to determine values of a new column based on data preceding or following that source row with a given offset.
- New functions have been added to the Window Calculation component:
- First/Last
- Lead/Lag
- Rank
- New Python Script component allows users to write custom Python scripts that are executed on the Matillion ETL instance to perform a wide variety of tasks.