Introducing the LangChain Integration

The Gradient and LangChain integration enables users to use their Gradient models for desired tasks in a LangChain workflow. Within the LangChain framework, users can call the Gradient API to run inference on their own LLMs built using the Gradient platform.

For example, let’s say a user is building an agent that can complete various tasks.

Task 1 may require more domain-specific expertise and/or reference private data, so they want this task to be completed using a private, custom LLM that has been fine-tuned on the Gradient platform. Meanwhile Task 2 only require general knowledge and involves no private data. Using LangChain, the user can designate which model is best suited to each task.

With the integration of LangChain, Gradient users will now have the power to:

1. Precision-Tailor AI Applications: Fine-tune multiple LLMs to specific data sets tailored for different domains and/or tasks, and then select the best model to use for each component of an application, enhancing accuracy and adaptability.

2. Integrate Workflows Seamlessly: Integrate fine-tuned models directly into complex AI workflows, drastically reducing the time between model training and deployment.

3. Optimize Resource Allocation: Efficiently allocate resources, ensuring the most cost-effective models are used for each task.

4. Collaborate More Effectively: Teams can work together more efficiently, by working on different components of an application and bringing them together in an integrated workflow.