LLMs
Models
LLMs
Models
We support multiple LLM vendors.
To use a model, make sure to have added your API key from the provider. Run
relevance keys.
We provide support for not just GPT, but other vendors such as Cohere and Anthropic. We are always adding to this list. Implement once, with the knowledge that as new models come out, your product can take advantage!
You can specify the model like so:
const { answer } = step('prompt_completion', {
prompt: 'What is the meaning of life?',
model: 'anthropic-claude-v1',
});
Our SDK will provide the options by intellisense.
Models
| Provider | Model name | Model ID |
|---|---|---|
| OpenAI | GPT 4 | openai-gpt4 |
| OpenAI | GPT 3.5 | openai-gpt3.5 |
| Anthropic | Claude | anthropic-claude-v1 |
| Anthropic | Claude Instant | anthropic-claude-instant-v1 |
| Palm | Text Bison | palm-text-bison |
| Palm | Chat Bison | palm-chat-bison |
| Cohere | Command | cohere-command |
| Cohere | Command Light | cohere-command-light |