Matillion ETL release notes: v1.51
1.51.9 (interim release)
(24th June 2021)
Bug fixes
All platforms
- Matillion has enabled transport-layer security (TLS) by default for all Hazelcast communications. This enablement will keep your data and messages secure in transit while operating in a cluster. TLS offers higher security and better performance than the earlier symmetric encryption, which is now deprecated by Hazelcast and which has been removed from Matillion ETL. No user interaction is required with this update, but if you wish to disable this setting (for example, if you wish to run Hazelcast Management Center for monitoring purposes) then you can set the value of variable HAZEL_SECURITY_ENABLED to false in the environment properties.
1.51.7 (interim release)
(8th March 2021)
Bug fixes
All platforms
- Fixed an issue where authorization of an OAuth entry was logging users out of Matillion ETL.
Snowflake and Redshift
- Fixed an issue where Matillion ETL was displaying a truncated list of SQS Queues in alphabetical order rather than all available SQS Queues.
1.51.6 (interim release)
(22nd February 2021)
Bug fixes
All platforms
- Fixed an issue where defining and selecting a cloud storage file's path and name using an environment variable was not working as expected—existing configurations continued to work, but it was not possible to define additional filename selections using variables.
1.51.5 (major release)
(12th February 2021)
New features and improvements
All platforms
- Apache Tomcat version updated to 8.5.59
- New Manage Error Reporting feature empowers users to post a message or webhook if an error occurs in a component or job that does not have any other error handling enabled.
- Read Only roles can now be assigned to users. Note: the Matillion ETL instance must be initiated via the Matillion Hub.
- Snowflake JDBC driver now available for selection in the Database Query component.
- Amazon Redshift JDBC driver now available for selection in the Database Query component.
- Matillion ETL can now detect whether renaming an orchestration or transformation job will affect other Jobs using a built-in dependency checker.
- Bash Script component can now be run as a Restricted user, removing access to instance credentials and Tomcat folders.
- Python Script component can now be run as a Restricted user, removing access to instance credentials and Tomcat folders for any user marked as "restricted".
- Zendesk Query is now Zendesk Support Query.
- The Query Result to Scalar component now comes with a Basic Mode, allowing users to edit each parameter in a no-code way by manually clicking into component parameters.
- Updates to the "Create Your Own Connector" feature:
- API Extract component now supports the use of Environment, Job, and Grid Variables when setting Parameter Names and Parameter Values in the URI Params, Query Params, and Header Params properties (not applicable to Synapse or Delta Lake).
- Manage Extract Profiles wizard now offers OAuth 2.0 and API key=value pairs as methods of authentication (not applicable to Synapse or Delta Lake).
- Manage Query Profiles wizard now supports connection parameters as a parameter type.
- Manage Query Profiles wizard now offers OAuth 2.0 as a method of authentication.
Snowflake
- Alter External Table component has been updated to include functionality to add or remove multiple files, rather than a single file. The earlier version of this component will be deprecated from v1.51.5 (this version) onwards.
- New Cloud Storage Unload component lets users write files from a table into a specified Google Cloud Storage (GCS) bucket. (Only available on Matillion ETL for Snowflake on Google Cloud Platform (GCP).)
Snowflake and Redshift
- New Microsoft SQL Server Output component enables users to output the contents of a table (or view) from their cloud data warehouse (CDW) to their Microsoft SQL Server database.
Redshift
- A new data type—SUPER—is now available. Use the SUPER data type to store semi-structured data or documents as values. For more information, read Amazon Redshift's SUPER type.
BigQuery
- Users can now choose between "native" Google BigQuery tables and external tables in third-party service Query components.
Synapse
- Google Sheets Query is now available for Matillion ETL for Synapse.
Delta Lake on Databricks
- Orchestration components: a number of orchestration components are now available in Matillion ETL for Delta Lake on Databricks in parity with other platforms, including:
- New Refresh Table component, which invalidates the cached entries—including data and metadata—of the given table or view. The invalidated cache is populated when the cached table or the query associated with it is executed again.
- Transformation components: a number of transformation components are now available in Matillion ETL for Delta Lake on Databricks in parity with other platforms, including:
Driver updates
- Jira API driver updated (v20.0.7564.0 → 20.0.7646.0)
- Apache Hive API driver updated (v20.0.7503.0 → v20.0.7627.0)
- Google Ad Manager API driver updated (v20.0.7488.0 → v20.0.7662.0)
- Paypal API driver updated (v18.0.6782.0 → v20.0.7682.0)
- SendGrid API driver updated (v17.0.6618.0 → v20.0.7627.0)
- REST API API driver updated (v19.0.7149.0 → v20.0.7699.0)
- Stripe API driver updated (v19.0.7340.0 → v20.0.7654.0)
Deprecation
All platforms
The YouTube Query component has been deprecated. When creating new orchestration jobs, please use the YouTube Analytics Query component instead.
Existing jobs using the YouTube Query component will continue to work as expected.