Now Available: Access Gradient and LLM Datapacks Directly in Snowflake
Mar 12, 2024
Gradient Team
Gradient Now Supports Snowflake Customers Using Snowpark Container Services
We’re excited to announce our partnership with Snowflake, enabling the use of Gradient through Snowpark Container Services (Public Preview), a new runtime that empowers developers to effortlessly register and deploy container images in their Snowflake account. Starting today, Gradient can deploy our full platform within customers’ managed, governed Snowflake environment, enabling new and existing Snowflake customers with the ability to leverage their Snowflake data to develop AI applications on Gradient without compromising data security. As always, Gradient is dedicated to earning and keeping our customer’s trust, which is why Gradient maintains the highest standards for security and compliance including: SOC2 Type 2, HIPAA, and GDPR.
For those who are new to Snowflake, Snowpark Container Services provides a fully managed container for you to deploy, manage, and scale containerized applications within the Snowflake ecosystem. This means that users can run containerized workloads directly within Snowflake, ensuring that data doesn’t need to be moved out of the Snowflake environment for processing. This allows users to focus on developing and deploying their applications, without having the overhead of managing the underlying infrastructure or having to move data off the platform.
Access Gradient Datapacks Within Snowflake Marketplace
LLMs generally require massive amounts of data to learn the patterns of language effectively. Gathering, storing, and processing this volume of data is both challenging and resource-intensive. With Snowflake Marketplace, organizations can now discover and access third-party data and services across the Snowflake Data Cloud.
Starting today organizations can access Gradient’s Foundational LLM Datapacks on Snowflake Marketplace to help train foundational models from scratch. We’ve already ensured that the training data is pre-cleaned, so that the datapacks can be used freely. The following datapacks are available today, with additional datapacks arriving in the near future.
Since these datapacks are designed to help you get started with building your foundational models, they may not meet the sophistication that you’re looking for. If you’re looking for a comprehensive domain-specific LLM for finance or healthcare, Gradient offers highly sophisticated and fine-tuned industry models such as Albatross (finance) and Nightingale (healthcare) that outperform similar competitors against industry benchmarks.
Getting Started With Gradient on Snowflake
Gradient provides enterprise clients two options to get started with Gradient on Snowpark Container Services.
Option 1: Deployment Platform
To ensure our enterprise clients have the least amount of friction, Gradient provides an end-to-end deployment platform to deploy Gradient in Snowflake using Snowpark Container Services. By granting Gradient limited access to their Snowflake environment, Gradient will handle the end-to-end deployment of our platform in Snowflake. As a result, there is no work required from our client.
Option 2: Deployment Cookbook
For clients with stricter security requirements, Gradient provides a step-by-step cookbook to deploy using Snowpark Container Services, including pre-written scripts for the client to execute in their Snowflake environment. This option should entail minimal work on the client’s side, as all of the infrastructural details are already ironed out and encapsulated within the provided scripts.
To get started on either option, simply contact our team at contact@gradient.ai and we’ll ensure you have a smooth onboarding process.