mirror of
https://github.com/trailofbits/buttercup
synced 2026-06-21 14:11:39 +00:00
feat(llm): add newer Anthropic + OpenAI models (opus 4.6/4.7, sonnet 4.6, haiku 4.5, gpt-5.4/5.4-mini/5.5) (#544)
* feat(llm): add newer Anthropic and OpenAI models to LiteLLM Add 9 model entries across the LiteLLM proxy config, k8s values, and ButtercupLLM enum so callers can opt into newer models without code changes: openai-o4-mini, openai-gpt-5/-mini/-nano, claude-4-opus, claude-4.1-opus, claude-4.5-haiku, claude-4.6-sonnet, claude-4.7-opus. Verified end-to-end with docker compose: LiteLLM v1.57.8 boots cleanly, /v1/models lists all 27 entries, and chat completions for the new model IDs are dispatched to api.anthropic.com / api.openai.com. Co-Authored-By: Claude Opus 4.7 <noreply@anthropic.com> * feat(llm): narrow new model set to opus 4.6/4.7, sonnet 4.6, haiku 4.5 + gpt-5.4/5.4-mini/5.5 Replace the previously added openai-o4-mini and gpt-5/-mini/-nano entries with gpt-5.4, gpt-5.4-mini, gpt-5.5; drop claude opus 4 and 4.1 in favor of opus 4.6. Final new entries (7): claude-4.5-haiku, claude-4.6-sonnet, claude-4.6-opus, claude-4.7-opus, openai-gpt-5.4-mini, openai-gpt-5.4, openai-gpt-5.5. Re-verified with docker compose: LiteLLM v1.57.8 boots, /v1/models lists all 25 entries, and chat completions for claude-4.6-opus and openai-gpt-5.5 are dispatched to api.anthropic.com / api.openai.com. Co-Authored-By: Claude Opus 4.7 <noreply@anthropic.com> --------- Co-authored-by: Claude Opus 4.7 <noreply@anthropic.com>
This commit is contained in:
committed by
GitHub
parent
2ddae66040
commit
adf5530b41
@@ -30,9 +30,16 @@ class ButtercupLLM(Enum):
|
||||
OPENAI_GPT_4_1_NANO = "openai-gpt-4.1-nano"
|
||||
OPENAI_GPT_4_1_MINI = "openai-gpt-4.1-mini"
|
||||
OPENAI_GPT_4_1 = "openai-gpt-4.1"
|
||||
OPENAI_GPT_5_4_MINI = "openai-gpt-5.4-mini"
|
||||
OPENAI_GPT_5_4 = "openai-gpt-5.4"
|
||||
OPENAI_GPT_5_5 = "openai-gpt-5.5"
|
||||
CLAUDE_3_7_SONNET = "claude-3.7-sonnet"
|
||||
CLAUDE_4_SONNET = "claude-4-sonnet"
|
||||
CLAUDE_4_5_SONNET = "claude-4.5-sonnet"
|
||||
CLAUDE_4_5_HAIKU = "claude-4.5-haiku"
|
||||
CLAUDE_4_6_SONNET = "claude-4.6-sonnet"
|
||||
CLAUDE_4_6_OPUS = "claude-4.6-opus"
|
||||
CLAUDE_4_7_OPUS = "claude-4.7-opus"
|
||||
GEMINI_PRO = "gemini-pro"
|
||||
GEMINI_2_5_FLASH = "gemini-2.5-flash"
|
||||
GEMINI_2_5_FLASH_EXP = "gemini-2.5-flash-exp"
|
||||
|
||||
@@ -363,6 +363,27 @@ litellm-helm:
|
||||
tpm: 150000000
|
||||
rpm: 30000
|
||||
|
||||
- model_name: openai-gpt-5.4-mini
|
||||
litellm_params:
|
||||
model: openai/gpt-5.4-mini
|
||||
api_key: os.environ/OPENAI_API_KEY
|
||||
tpm: 150000000
|
||||
rpm: 30000
|
||||
|
||||
- model_name: openai-gpt-5.4
|
||||
litellm_params:
|
||||
model: openai/gpt-5.4
|
||||
api_key: os.environ/OPENAI_API_KEY
|
||||
tpm: 30000000
|
||||
rpm: 10000
|
||||
|
||||
- model_name: openai-gpt-5.5
|
||||
litellm_params:
|
||||
model: openai/gpt-5.5
|
||||
api_key: os.environ/OPENAI_API_KEY
|
||||
tpm: 30000000
|
||||
rpm: 10000
|
||||
|
||||
- model_name: claude-3.7-sonnet
|
||||
litellm_params:
|
||||
model: anthropic/claude-3-7-sonnet-20250219
|
||||
@@ -382,6 +403,30 @@ litellm-helm:
|
||||
api_key: os.environ/ANTHROPIC_API_KEY
|
||||
tpm: 1775000
|
||||
|
||||
- model_name: claude-4.5-haiku
|
||||
litellm_params:
|
||||
model: anthropic/claude-haiku-4-5-20251001
|
||||
api_key: os.environ/ANTHROPIC_API_KEY
|
||||
tpm: 1775000
|
||||
|
||||
- model_name: claude-4.6-sonnet
|
||||
litellm_params:
|
||||
model: anthropic/claude-sonnet-4-6
|
||||
api_key: os.environ/ANTHROPIC_API_KEY
|
||||
tpm: 1775000
|
||||
|
||||
- model_name: claude-4.6-opus
|
||||
litellm_params:
|
||||
model: anthropic/claude-opus-4-6
|
||||
api_key: os.environ/ANTHROPIC_API_KEY
|
||||
tpm: 1775000
|
||||
|
||||
- model_name: claude-4.7-opus
|
||||
litellm_params:
|
||||
model: anthropic/claude-opus-4-7
|
||||
api_key: os.environ/ANTHROPIC_API_KEY
|
||||
tpm: 1775000
|
||||
|
||||
- model_name: gemini-pro
|
||||
litellm_params:
|
||||
model: gemini/gemini-pro
|
||||
|
||||
@@ -89,6 +89,27 @@ model_list:
|
||||
tpm: 150000000
|
||||
rpm: 30000
|
||||
|
||||
- model_name: openai-gpt-5.4-mini
|
||||
litellm_params:
|
||||
model: openai/gpt-5.4-mini
|
||||
api_key: os.environ/OPENAI_API_KEY
|
||||
tpm: 150000000
|
||||
rpm: 30000
|
||||
|
||||
- model_name: openai-gpt-5.4
|
||||
litellm_params:
|
||||
model: openai/gpt-5.4
|
||||
api_key: os.environ/OPENAI_API_KEY
|
||||
tpm: 30000000
|
||||
rpm: 10000
|
||||
|
||||
- model_name: openai-gpt-5.5
|
||||
litellm_params:
|
||||
model: openai/gpt-5.5
|
||||
api_key: os.environ/OPENAI_API_KEY
|
||||
tpm: 30000000
|
||||
rpm: 10000
|
||||
|
||||
- model_name: claude-3.7-sonnet
|
||||
litellm_params:
|
||||
model: anthropic/claude-3-7-sonnet-20250219
|
||||
@@ -108,6 +129,30 @@ model_list:
|
||||
api_key: os.environ/ANTHROPIC_API_KEY
|
||||
tpm: 400000
|
||||
|
||||
- model_name: claude-4.5-haiku
|
||||
litellm_params:
|
||||
model: anthropic/claude-haiku-4-5-20251001
|
||||
api_key: os.environ/ANTHROPIC_API_KEY
|
||||
tpm: 400000
|
||||
|
||||
- model_name: claude-4.6-sonnet
|
||||
litellm_params:
|
||||
model: anthropic/claude-sonnet-4-6
|
||||
api_key: os.environ/ANTHROPIC_API_KEY
|
||||
tpm: 400000
|
||||
|
||||
- model_name: claude-4.6-opus
|
||||
litellm_params:
|
||||
model: anthropic/claude-opus-4-6
|
||||
api_key: os.environ/ANTHROPIC_API_KEY
|
||||
tpm: 400000
|
||||
|
||||
- model_name: claude-4.7-opus
|
||||
litellm_params:
|
||||
model: anthropic/claude-opus-4-7
|
||||
api_key: os.environ/ANTHROPIC_API_KEY
|
||||
tpm: 400000
|
||||
|
||||
- model_name: gemini-pro
|
||||
litellm_params:
|
||||
model: gemini/gemini-pro
|
||||
|
||||
Reference in New Issue
Block a user