Together Embedder

The TogetherEmbedder can be used to embed text data into vectors using the Together API. Together uses the OpenAI API specification, so the TogetherEmbedder class is similar to the OpenAIEmbedder class, incorporating adjustments to ensure compatibility with the Together platform. Get your key from here.

Usage

1from kern.knowledge.knowledge import Knowledge
2from kern.vectordb.pgvector import PgVector
3from kern.knowledge.embedder.together import TogetherEmbedder
4
5# Embed sentence in database
6embeddings = TogetherEmbedder().get_embedding("The quick brown fox jumps over the lazy dog.")
7
8# Print the embeddings and their dimensions
9print(f"Embeddings: {embeddings[:5]}")
10print(f"Dimensions: {len(embeddings)}")
11
12# Use an embedder in a knowledge base
13knowledge = Knowledge(
14    vector_db=PgVector(
15        db_url="postgresql+psycopg://ai:ai@localhost:5532/ai",
16        table_name="together_embeddings",
17        embedder=TogetherEmbedder(),
18    ),
19    max_results=2,
20)

Params

Parameter	Type	Default	Description
`model`	`str`	`"nomic-ai/nomic-embed-text-v1.5"`	The name of the model used for generating embeddings.
`dimensions`	`int`	`768`	The dimensionality of the embeddings generated by the model.
`api_key`	`str`		The API key used for authenticating requests.
`base_url`	`str`	`"https://api.Together.ai/inference/v1"`	The base URL for the API endpoint.
`enable_batch`	`bool`	`False`	Enable batch processing to reduce API calls and avoid rate limits
`batch_size`	`int`	`100`	Number of texts to process in each API call for batch operations.

Developer Resources

View Cookbook