mirror of
https://github.com/trailofbits/buttercup
synced 2026-06-21 14:11:39 +00:00
Riccardo Schirone
e705a64fb2
* patcher: ensure tests_passed is always set * patcher: make find_tests try harder * patcher: prefer simpler patches * patcher: make sure the rootcause also consider the last failing pov * patcher: small adjustment to reflection prompt * patcher: apply the delta-mode diff while testing test instructions * patcher: other improvements * fix tests * patcher: store found test instructions to speed up future patches (#903) * patcher: store found test instructions to speed up future patches * fix lint
litellm
The litellm service proxies all LLMs.
After deploying LiteLLM, you can test it with:
curl --location 'http://127.0.0.1:8080/chat/completions' \
--header 'Content-Type: application/json' \
--header "Authorization: Bearer sk-1234" \
--data ' {
"model": "azure-gpt-4o-mini",
"messages": [
{
"role": "user",
"content": "explain the color red"
}
]
}
'
Create a virtual key with a budget of 0.01:
curl 'http://127.0.0.1:8080/key/generate' \
--header 'Authorization: Bearer sk-1234' \
--header 'Content-Type: application/json' \
--data-raw '{"max_budget": 0.01}' | jq ".key"
Use the virtual key in normal requests as the bearer token.