Introducing Gradient: Simple APIs to Build Private AI Applications
Aug 29, 2023
Gradient Team
The Problems and Promises of Open-Source Language Models
The potential of Large Language Models (LLMs) has been widely recognized. However, there are significant hurdles for developers and organizations when customizing these models to their specific needs, while maintaining full control and privacy of their data. Fine-tuning open-source models allows you to own your model completely and keep your data private.
What’s so difficult about working with open-source LLMs? For starters, running inference on high-performance models requires specialized hardware with vast memory capacities. Every time a model is fine-tuned, its new state also needs to be saved, indexed and made available for future inferences. While many platforms have been released for inference and fine-tuning on closed-source models, there is no equivalent service for the open source ecosystem.
Recognizing this obstacle in a rapidly advancing world of AI, our founders created the Gradient developer platform to make inference and fine-tuning of state-of-the-art open-source LLMs accessible to all developers.
Introducing the Gradient Developer Platform
Gradient is a developer platform with an intuitive framework for fine-tuning and inference, dramatically simplifying the implementation of AI-driven solutions across industries. With just a few lines of code, developers can tap into the power of advanced language models, harnessing their potential like never before.
4 key features of the Gradient platform
Simple Fine-Tuning: Tailor state-of-the-art LLMs to your specific needs, leveraging the platform's user-friendly interface and robust tools.
Flexible Inference APIs: Integrate seamlessly into existing applications and services, reducing the barriers to entry for AI implementation.
Fully Private LLMs: Maintain full ownership and privacy of your data. Any LLM developed on the platform is only accessible to the developer who makes it.
Pay-As-You-Go Pricing: Unlike other offerings, developers only pay per token, whether they are fine-tuning or generating completions on the platform.
Developers receive many benefits by using Gradient, including:
Rapid Development: Reduce the AI development cycle with simple web APIs, accessible via an easy-to-use CLI, Python SDK, and Javascript SDK.
Cost-Effective: Gradient’s platform is truly on demand — developers only need to pay for the tokens consumed during the fine-tuning or inference process.
State of the Art: Gradient supports state-of-the-art LLMs, including Llama2, StarcoderPlus, and Nous Hermes.
“Gradient represents a new era of AI customization and deployment," said Chris Chang, CEO of Gradient. "Our API platform abstracts away the complexities of working with open-source models. We are democratizing access to custom, private models to any software developer.”
See the developer documentation for more details on the product.
Try Gradient or Join Us
Gradient is now available to independent developers and companies globally. Sign up and get started with $10 in free credits. You can also view our documentation here.
Following the free credits, Gradient comes with transparent, token-based pricing. Companies that require tighter security and governance can contact us to learn more and to see a demo.
Developers and organizations only beginning to see the potential of LLMs in various applications, and we’re excited to help them achieve this easier and faster. For any engineers, scientists and researchers looking to join us in this mission, we’re hiring!