LLMs
Models

To use a model, make sure to have added your API key from the provider. Run relevance keys.

We provide support for not just GPT, but other vendors such as Cohere and Anthropic. We are always adding to this list. Implement once, with the knowledge that as new models come out, your product can take advantage!

You can specify the model like so:

const { answer } = step('prompt_completion', {
    prompt: 'What is the meaning of life?',
    model: 'anthropic-claude-v1',
});

Our SDK will provide the options by intellisense.

‚Äč
Models

ProviderModel nameModel ID
OpenAIGPT 4openai-gpt4
OpenAIGPT 3.5openai-gpt3.5
AnthropicClaudeanthropic-claude-v1
AnthropicClaude Instantanthropic-claude-instant-v1
PalmText Bisonpalm-text-bison
PalmChat Bisonpalm-chat-bison
CohereCommandcohere-command
CohereCommand Lightcohere-command-light