feat(llm): add newer Anthropic + OpenAI models (opus 4.6/4.7, sonnet 4.6, haiku 4.5, gpt-5.4/5.4-mini/5.5) (#544)

* feat(llm): add newer Anthropic and OpenAI models to LiteLLM

Add 9 model entries across the LiteLLM proxy config, k8s values, and
ButtercupLLM enum so callers can opt into newer models without code
changes: openai-o4-mini, openai-gpt-5/-mini/-nano, claude-4-opus,
claude-4.1-opus, claude-4.5-haiku, claude-4.6-sonnet, claude-4.7-opus.

Verified end-to-end with docker compose: LiteLLM v1.57.8 boots cleanly,
/v1/models lists all 27 entries, and chat completions for the new
model IDs are dispatched to api.anthropic.com / api.openai.com.

Co-Authored-By: Claude Opus 4.7 <noreply@anthropic.com>

* feat(llm): narrow new model set to opus 4.6/4.7, sonnet 4.6, haiku 4.5 + gpt-5.4/5.4-mini/5.5

Replace the previously added openai-o4-mini and gpt-5/-mini/-nano entries
with gpt-5.4, gpt-5.4-mini, gpt-5.5; drop claude opus 4 and 4.1 in favor
of opus 4.6. Final new entries (7): claude-4.5-haiku, claude-4.6-sonnet,
claude-4.6-opus, claude-4.7-opus, openai-gpt-5.4-mini, openai-gpt-5.4,
openai-gpt-5.5.

Re-verified with docker compose: LiteLLM v1.57.8 boots, /v1/models lists
all 25 entries, and chat completions for claude-4.6-opus and
openai-gpt-5.5 are dispatched to api.anthropic.com / api.openai.com.

Co-Authored-By: Claude Opus 4.7 <noreply@anthropic.com>

---------

Co-authored-by: Claude Opus 4.7 <noreply@anthropic.com>
This commit is contained in:
Riccardo Schirone
2026-06-16 10:25:40 +02:00
committed by GitHub
parent 2ddae66040
commit adf5530b41
3 changed files with 98 additions and 1 deletions
+7
View File
@@ -30,9 +30,16 @@ class ButtercupLLM(Enum):
OPENAI_GPT_4_1_NANO = "openai-gpt-4.1-nano"
OPENAI_GPT_4_1_MINI = "openai-gpt-4.1-mini"
OPENAI_GPT_4_1 = "openai-gpt-4.1"
OPENAI_GPT_5_4_MINI = "openai-gpt-5.4-mini"
OPENAI_GPT_5_4 = "openai-gpt-5.4"
OPENAI_GPT_5_5 = "openai-gpt-5.5"
CLAUDE_3_7_SONNET = "claude-3.7-sonnet"
CLAUDE_4_SONNET = "claude-4-sonnet"
CLAUDE_4_5_SONNET = "claude-4.5-sonnet"
CLAUDE_4_5_HAIKU = "claude-4.5-haiku"
CLAUDE_4_6_SONNET = "claude-4.6-sonnet"
CLAUDE_4_6_OPUS = "claude-4.6-opus"
CLAUDE_4_7_OPUS = "claude-4.7-opus"
GEMINI_PRO = "gemini-pro"
GEMINI_2_5_FLASH = "gemini-2.5-flash"
GEMINI_2_5_FLASH_EXP = "gemini-2.5-flash-exp"
+46 -1
View File
@@ -363,6 +363,27 @@ litellm-helm:
tpm: 150000000
rpm: 30000
- model_name: openai-gpt-5.4-mini
litellm_params:
model: openai/gpt-5.4-mini
api_key: os.environ/OPENAI_API_KEY
tpm: 150000000
rpm: 30000
- model_name: openai-gpt-5.4
litellm_params:
model: openai/gpt-5.4
api_key: os.environ/OPENAI_API_KEY
tpm: 30000000
rpm: 10000
- model_name: openai-gpt-5.5
litellm_params:
model: openai/gpt-5.5
api_key: os.environ/OPENAI_API_KEY
tpm: 30000000
rpm: 10000
- model_name: claude-3.7-sonnet
litellm_params:
model: anthropic/claude-3-7-sonnet-20250219
@@ -382,7 +403,31 @@ litellm-helm:
api_key: os.environ/ANTHROPIC_API_KEY
tpm: 1775000
- model_name: gemini-pro
- model_name: claude-4.5-haiku
litellm_params:
model: anthropic/claude-haiku-4-5-20251001
api_key: os.environ/ANTHROPIC_API_KEY
tpm: 1775000
- model_name: claude-4.6-sonnet
litellm_params:
model: anthropic/claude-sonnet-4-6
api_key: os.environ/ANTHROPIC_API_KEY
tpm: 1775000
- model_name: claude-4.6-opus
litellm_params:
model: anthropic/claude-opus-4-6
api_key: os.environ/ANTHROPIC_API_KEY
tpm: 1775000
- model_name: claude-4.7-opus
litellm_params:
model: anthropic/claude-opus-4-7
api_key: os.environ/ANTHROPIC_API_KEY
tpm: 1775000
- model_name: gemini-pro
litellm_params:
model: gemini/gemini-pro
api_key: os.environ/GEMINI_API_KEY
+45
View File
@@ -89,6 +89,27 @@ model_list:
tpm: 150000000
rpm: 30000
- model_name: openai-gpt-5.4-mini
litellm_params:
model: openai/gpt-5.4-mini
api_key: os.environ/OPENAI_API_KEY
tpm: 150000000
rpm: 30000
- model_name: openai-gpt-5.4
litellm_params:
model: openai/gpt-5.4
api_key: os.environ/OPENAI_API_KEY
tpm: 30000000
rpm: 10000
- model_name: openai-gpt-5.5
litellm_params:
model: openai/gpt-5.5
api_key: os.environ/OPENAI_API_KEY
tpm: 30000000
rpm: 10000
- model_name: claude-3.7-sonnet
litellm_params:
model: anthropic/claude-3-7-sonnet-20250219
@@ -108,6 +129,30 @@ model_list:
api_key: os.environ/ANTHROPIC_API_KEY
tpm: 400000
- model_name: claude-4.5-haiku
litellm_params:
model: anthropic/claude-haiku-4-5-20251001
api_key: os.environ/ANTHROPIC_API_KEY
tpm: 400000
- model_name: claude-4.6-sonnet
litellm_params:
model: anthropic/claude-sonnet-4-6
api_key: os.environ/ANTHROPIC_API_KEY
tpm: 400000
- model_name: claude-4.6-opus
litellm_params:
model: anthropic/claude-opus-4-6
api_key: os.environ/ANTHROPIC_API_KEY
tpm: 400000
- model_name: claude-4.7-opus
litellm_params:
model: anthropic/claude-opus-4-7
api_key: os.environ/ANTHROPIC_API_KEY
tpm: 400000
- model_name: gemini-pro
litellm_params:
model: gemini/gemini-pro