Matillion ETL release notes: v1.48

Redshift

Fixed an issue where the token used by the S3 Load component appears as clear text in the SQL tab and job documentation.

BigQuery

Fixed an issue where SQL generated in the Construct Struct component was setting the "result" values to NULL when casting to a string data type.

All platforms

Fixed an issue where the Jira Query component was unable to query system tables following a recent driver update.

BigQuery

Fixed an issue where Salesforce Incremental Load was not correctly listing target datasets.

All platforms

New Webhook Post component gives users a simplified approach to posting notifications to multiple unique URLs to make other users aware of job behaviors. Manage Webhook Payloads allows users to pre-define payloads for later use.
Create Your Own Connector process improvements:
- Import/export for connector profiles is now possible through the UI and API.
- Server Migration function now supports migrating extract profiles.
- New pagination strategies: offset based and link-header based.
Query Result to Grid now supports WHERE clauses.
Assert components can now auto-populate semi-structured data, and persist metadata values in Assert View.

Snowflake

New Alter External Table component allows users to add or remove files from an external table, giving better control over external table source data.

Snowflake and BigQuery

Zuora Bulk Query now offers users the option to include deleted records in a query with the "Show Deleted Records" property.

Redshift

Materialized Views are now supported in the Create View component.
New Refresh Materialized View component allows users to update their materialized views to reflect changes made to corresponding tables.

Synapse

New Salesforce Output component allows users to push data from their data warehouse to a Salesforce object of their choice.
Users can now encrypt user-defined credentials using the Azure Key Vault.
New Table Output component allows users to write their transformation job data flows into a table.
New Unpivot component can be used to convert table columns into additional table rows, the opposite of our existing Pivot component.
New Split Fields component splits table fields based on user-determined criteria.
New Create External Table component allows users to use external tables to reference and query data directly from storage rather than in the data warehouse.

All platforms

Fixed an issue where JDBC Incremental load failed to identify existing tables.
Fixed an issue where JDBC Incremental Load performed a full load every time when source tables had mixed-case names.
Fixed an issue where JDBC Incremental Load always performed a full load.
Fixed an issue where JDBC Incremental Load failed if the source table name was a reserved word.
Fixed an issue where JDBC Incremental Load did not support source tables whose names contained spaces.
Fixed an issue where the scheduler was running CDC jobs in the wrong order.
Fixed an issue where CDC erroneously recreated target tables on subsequent runs.
Fixed an issue where the Table Update component did not validate when pointing at a table with a RECORD/STRUCT column.
Fixed an issue where the Shopify Query component would not fetch all expected data.
Fixed an issue where the following error was returned by the Data Transfer component for FTP sources: java.net.ConnectException.
Fixed an issue where Migrate would sometimes hang and fail for a certain projects.
Fixed an issue where OpenID integration email addresses were case sensitive.
Fixed an issue where "overwriting on conflict" did not overwrite when a job was referenced by a schedule.
Fixed an issue where Database Query was stripping leading zero characters from string fields.
Fixed an issue where LDAP Active Directory was throwing login errors for logins that used special characters.

Snowflake

Fixed an issue where the Flatten Variant component would not return results when double quotes were placed around property values in the Mapping Columns property.
Fixed an issue where environment import was ignoring set instance credentials.
Fixed an issue where DateTime values were not quoted in SQL in some cases.
Fixed an issue where Salesforce Incremental Load jobs would fail when a Matillion ETL for Snowflake instance was set with QUOTED_IDENTIFIERS_IGNORE_CASE = True.
Fixed an issue where CDC shared jobs would fail if QUOTED_IDENTIFIERS_IGNORE_CASE was set to True for the Snowflake Warehouse.

Snowflake and Redshift

Fixed an issue where the S3 Load Generator returned an error reading headers when instructed to ignore reading headers.

Snowflake and Synapse

Fixed an issue where the Pivot component would not quote resulting columns when columns did not conform to the "standard" naming convention.