Together

Use Together AI models with Kern agents.

Together is a platform for providing endpoints for Large Language models. See their library of models here.

We recommend experimenting to find the best-suited model for your use-case.

Together have tier based rate limits. See the docs for more information.

Authentication

Set your TOGETHER_API_KEY environment variable. Get your key from Together here.

1export TOGETHER_API_KEY=***

1setx TOGETHER_API_KEY ***

Example

Use Together with your Agent:

1from kern.agent import Agent
2from kern.models.together import Together
3
4agent = Agent(
5    model=Together(id="meta-llama/Meta-Llama-3.1-8B-Instruct-Turbo"),
6    markdown=True
7)
8
9# Print the response in the terminal
10agent.print_response("Share a 2 sentence horror story.")

Note View more examples here.

Params

Parameter	Type	Default	Description
`id`	`str`	`"meta-llama/Meta-Llama-3.1-8B-Instruct-Turbo"`	The id of the Together model to use
`name`	`str`	`"Together"`	The name of the model
`provider`	`str`	`"Together"`	The provider of the model
`api_key`	`Optional[str]`	`None`	The API key for Together (defaults to TOGETHER_API_KEY env var)
`base_url`	`str`	`"https://api.together.xyz/v1"`	The base URL for the Together API

Together also supports the params of OpenAI.