IT Brief Australia - Technology news for CIOs & IT decision-makers
Story image
Snowflake announces series of innovations in data programmability
Wed, 9th Jun 2021
FYI, this story is more than a year old

Snowflake has announced new features to empower businesses with data cloud.

At its annual Snowflake Summit, the company announced innovations in data programmability, global data governance, and platform optimisations to empower organisations to bring more data together in the Data Cloud, achieving deeper value from data.

These announcements include:

Snowpark: With initial support for Java and Scala, Snowflake's developer experience, Snowpark, allows data engineers, data scientists, and developers to build using their preferred language and familiar programming concepts, and then execute these workloads directly within Snowflake. Currently in private preview, with public preview coming soon.

Java UDFs: With Java user-defined-functions (UDFs), customers can bring their custom code and business logic to Snowflake for better performance and expanded use case capabilities, while also reducing management complexity. Currently in private preview, with public preview coming soon.

Unstructured data: Snowflake is bringing accelerated time-to-value to unstructured data, enabling customers to store, govern, process, and share file data alongside their structured and semi-structured data and unlock new revenue opportunities. In private preview, with public preview coming soon.

SQL API: The Snowflake SQL API enables custom and off-the-shelf applications to call Snowflake directly through a REST API, without the need for client-side drivers, thus reducing the complexity and administration overhead requirements. In public preview.

Global governance capabilities include:

Classification: Snowflake's classification capability automatically detects personally identifiable information (PII) in a given table and leverages the tagging framework to annotate the data, allowing role-based policies to be used to control access to the data. Classification is in private preview.

Anonymised views: This new capability can be used to protect privacy and identity in a dataset, while still retaining its analytical value. The private preview of anonymised views is expected to be released soon.

Platform optimisations include:

Improved Storage Economics: Recent changes to Snowflake's storage representation of data have resulted in better compression, and reduced storage costs, according to the company.

This enhanced storage technology is available transparently, with no user action, no configuration changes, and no application or query changes. This is already rolled out to all Snowflake customers and will apply to newly written data.

Improved Support for Interactive Experiences: The new set of updates released for high volume and low latency workload requirements can result in up to a six times improvement on query throughput on a single compute cluster; and up to an eight times improvement in average query duration for those workloads. These enhancements are in private preview.

Usage Dashboard: The new usage dashboard helps customers better understand usage and costs across the platform, making it easy to manage Snowflake accounts across the entire organisation. The usage dashboard is in public preview.

In addition to Snowflake's core updates, it continues to expand its partner ecosystem.

The new Snowpark Accelerated Program provides partners who integrate with Snowpark with access to technical experts and additional exposure to Snowflake customers.

Data science partners such Dataiku and DataRobot also continue to enhance their integrations with Snowflake.

In addition, Amazon Web Services (AWS) has launched Snowflake integration with Amazon SageMaker Data Wrangler. Snowflake can now be used as a data source in Amazon SageMaker Data Wrangler to prepare data for machine learning.

Snowflake SVP of product Christian Kleinerman says, “Snowflake's unique architecture has not only redefined what's possible with data in the Data Cloud, but it has given us a strong foundation to continue to build and innovate on.

"This foundation powers Snowflake's leadership across six key workloads with blazing performance, reduced operational complexity, and hardened security, and it also enables us to create a global experience across clouds and regions.