Matillion ETL release notes: v1.50
1.50.12 (interim release)
(24th June 2021)
Bug fixes
All platforms
- Matillion has enabled transport-layer security (TLS) by default for all Hazelcast communications. This enablement will keep your data and messages secure in transit while operating in a cluster. TLS offers higher security and better performance than the earlier symmetric encryption, which is now deprecated by Hazelcast, and which has been removed from Matillion ETL. No user interaction is required with this update, but if you wish to disable this setting (for example, if you wish to run Hazelcast Management Center for monitoring purposes) then you can set the value of variable HAZEL_SECURITY_ENABLED to false in the environment properties.
1.50.9 (interim release)
(29th January 2021)
Bug fixes
All platforms
- Fixed an issue regarding a recent sudo package vulnerability. For more information on this issue and on implementing a workaround outside of this update, please see this tech note.
1.50.8 (interim release)
(10th December 2020)
Bug fixes
All platforms
- Fixed an issue where the Task History API filter would always interpret times as +12 hours from the given value.
- Added independent authentication checks when users attempt to:
- Import or update user permissions or groups.
- Get a list of external security users.
- Restart the server.
- Load SSL configuration.
- Save security configuration.
- Upload certificates.
- Upload drivers.
Snowflake
- Fixed an issue where the Pardot Extract component raises a NullPointerException when run.
Redshift
- Fixed an issue where the token used by the S3 Load component appears as clear text in the SQL tab and job documentation.
BigQuery
- Added new CLI Read Only shared components:
- Run gsutil command
- Run gcloud command
- Run bq command
- Run AWS cli
1.50.7 (interim release)
(1st December 2020)
Bug fixes
All platforms
- Fixed an issue with Git integration where Git commit and Git push actions were taking an unexpectedly long time to complete in Matillion ETL instances with a high number of Matillion versions.
- Fixed an issue involving the Filter component adding quotes around functions.
- Fixed an issue where Manage Change Data Capture (CDC) was throwing an error after multiple DML changes to the same row.
Snowflake and Synapse
- (Microsoft Azure-hosted instances only) added an improvement to how Matillion ETL behaves with Azure Queue Listener's GetMessageRead transactions. The number of transactions is now limited to three per minute.
1.50.6 (major release)
(12th November 2020)
Advisories
All platforms
Due to a required upgrade of the Jira API driver, the Jira Query component may not function correctly for users updating HA clusters. See this tech note for more information.
BigQuery
If you started your Matillion ETL instance at 1.42.x or earlier and have manually upgraded the Tomcat package to a newer version than 8.5.42, please be aware that upgrading may cause problems. If your Tomcat version has not been changed, this should not affect you, although we would still recommend spinning up a new instance.
New features and improvements
All platforms
- New Intercom Output component allows users to push data from their cloud data warehouse to Intercom.
- Bearer token added as an available authentication method to the API Query component.
- Security updates:
- A new Change My Password dialog in the Project menu allows users to change their personal login password for the Matillion ETL instance.
- New Global Access permissions group allows admins to give a user full access to all projects.
- Admins can assign an initial permissions group to new users, meaning that users can now start with restricted access, rather than needing to log in once before an admin can limit their access.
- Objects in the Recycle Bin now show when they were sent to the Recycle Bin.
- Manage Extract Profiles wizard has new functionality and some UI improvements:
- Two new pagination strategies are now supported: cursor based and page based.
- The wizard now supports "bearer token" as a distinct authentication type.
- Users are no longer required to generate headers, as they are now generated automatically.
- Manage API Profiles is now Manage Query Profiles and has received a significant UI update to its wizard, including:
- Two new pagination strategies are now supported: cursor based and page based.
- The wizard now supports "bearer token" as a distinct authentication type.
- Users can now switch between "summary" mode and "advanced" mode.
- You can now find a Configurable Review screen at the end of the wizard.
- The authentication tab has had some UI improvements:
- Users can now switch between summary mode and advanced mode.
- You can now find a Configurable Review screen at the end of the Query Profile wizard.
- Added the ability to right-click rows of data in the Metadata tab to copy rows that can then be used to populate metadata for other components.
Snowflake
- Allow connection to URLs that are not ".snowflakecomputing.com"
Snowflake and Redshift
- (AWS-hosted instances only) RDS Bulk Output component now supports Microsoft SQL Server.
BigQuery
- JDBC Incremental Load lets users easily set up a Shared Job that will incrementally load from JDBC-compliant databases, rather than having to manually create such a job.
Delta Lake on Databricks
- Official launch of Matillion ETL for Delta Lake on Databricks AWS.
Bug fixes
All platforms
- Fixed an issue where single-line comments in Query Result to Grid/Scalar components caused compilation errors.
- Fixed an error where connectors would fail when using an existing S3 location to stage data.
- Fixed an "out of memory" issue regarding Manage Schedules.
BigQuery
- Fixed an issue where Table Update, Table Output, and Construct Struct were erroneously casting structs to NULL data type.
Driver updates
- Square driver updated (v19.0.7270.0 → v20.07538.0).
- Google Ad Manager driver updated (v19.0.7367.0 → v20.0.7488.0).
- Google Sheets driver updated (v19.0.7285.0 → v20.0.7550.0).
- Salesforce driver version reverted (v20.0.7587.0 → v19.0.7332). This circumvents a bug in the newer driver that often resulted in text column sizes returning 0.
- Shopify driver updated (v19.0.7354 → v19.0.7485).
- Jira driver updated (v19.0.7326 → v20.0.7564).
- NetSuite driver updated (v19.0.7156 → v20.0.7513).