Basic Agent

Code

1from kern.agent import Agent
2from kern.models.litellm import LiteLLM
3
4openai_agent = Agent(
5    model=LiteLLM(
6        id="huggingface/mistralai/Mistral-7B-Instruct-v0.2",
7        top_p=0.95,
8    ),
9    markdown=True,
10)
11
12openai_agent.print_response("Whats happening in France?")

Usage

Set up your virtual environment

1uv venv --python 3.12
2source .venv/bin/activate

1uv venv --python 3.12
2.venv\Scripts\activate

Set your API key

1export LITELLM_API_KEY=xxx

Install dependencies

1uv pip install -U litellm kern-ai

Run Agent

1python cookbook/11_models/litellm/basic.py