Audio Input Agent

Code

1import requests
2from kern.agent import Agent
3from kern.media import Audio
4from kern.models.litellm import LiteLLM
5
6# Fetch the QA audio file and convert it to a base64 encoded string
7url = "https://kern-public.s3.us-east-1.amazonaws.com/demo_data/QA-01.mp3"
8response = requests.get(url)
9response.raise_for_status()
10mp3_data = response.content
11
12# Audio input requires specific audio-enabled models like gpt-5-mini-audio-preview
13agent = Agent(
14 model=LiteLLM(id="gpt-5-mini-audio-preview"),
15 markdown=True,
16)
17agent.print_response(
18 "What's the audio about?",
19 audio=[Audio(content=mp3_data, format="mp3")],
20 stream=True,
21)

Usage

Set up your virtual environment

1uv venv --python 3.12
2source .venv/bin/activate
1uv venv --python 3.12
2.venv\Scripts\activate

Set your API key

1export LITELLM_API_KEY=xxx

Install dependencies

1uv pip install -U litellm kern-ai

Run Agent

1python cookbook/11_models/litellm/audio_input_agent.py