Commit Graph

16 Commits

Author SHA1 Message Date
Ronald Eytchison 594748aec1 Use claude 4.5 (#437)
* Replace Claude 4 with Claude 4.5

Also remove Claude 3.5 and replace usage with Claude 4

* Use claude 4.5 as the Anthropic fallback model for patcher
2026-01-27 09:35:30 -05:00
Riccardo Schirone 945298c039 litellm_config: remove spaces to fix litellm parsing the file (#328)
A few spaces in the litellm_config.yaml file were preventing litellm
from correctly parsing and loading the configuration.
2025-09-03 10:06:38 -04:00
Boyan MILANOV c25b3956d0 Support Gemini (#306)
* Add gemini api key option during setup and in deployment environments

* Add gemini pro as a fallback model in all components

* Lint

* Set rate limits for gemini models

* Add fallback models in more places

* Fix typo

* Fix kwargs expansion

* Fix instantiation of llm with callbacks

* Fixed formatting after merge

* Fix instantiation of default models

* Lint

* Fix llm creation

* Fix

* Lint

* Lint

---------

Co-authored-by: Michael D Brown <michael.brown@trailofbits.com>
2025-08-26 10:59:00 -04:00
Riccardo Schirone e705a64fb2 patcher: misc fixes (#901)
* patcher: ensure tests_passed is always set

* patcher: make find_tests try harder

* patcher: prefer simpler patches

* patcher: make sure the rootcause also consider the last failing pov

* patcher: small adjustment to reflection prompt

* patcher: apply the delta-mode diff while testing test instructions

* patcher: other improvements

* fix tests

* patcher: store found test instructions to speed up future patches (#903)

* patcher: store found test instructions to speed up future patches

* fix lint
2025-06-20 17:03:33 -04:00
Ronald Eytchison 103acdfa1c Update anthropic rate limits (#855)
Also remove unused haiku model
2025-06-16 09:18:28 -04:00
Ronald Eytchison e5231f9b97 Update k8s litellm and add claude 4 (#700) 2025-05-22 23:01:56 -04:00
Michael D Brown a0b2248c70 Update seed-gen models and overall rate limits for stability (#696)
* #695 downgrade to sonnet 3.5 in seed-gen

* #683 Set litellm rate limits to tier4/5 (anth/oai)

* Re-enable CI check

* Update litellm_config.yaml
2025-05-22 15:06:44 -04:00
Michael D Brown 55e9be361e Update models to latest (#673)
* #669 add support for new openAI models in common

* #667 Update models in use to GPT_4_1* and 3_7_SONNET

* revert to 3.5 haiku for "mini" model backups
2025-05-22 11:01:25 -04:00
Ronald Eytchison 1a7537d204 Add Claude 3.7 sonnet (#126) 2025-03-06 09:23:22 -05:00
Ronald Eytchison 6c3067e8fa Remove comments 2025-02-18 09:54:44 -05:00
Ronald Eytchison 02679fe521 Switch from Azure-hosted models to OpenAI-hosted 2025-02-18 09:54:44 -05:00
Ronald Eytchison 2b48b1ca23 Remove model versions from names 2025-02-12 09:35:45 -05:00
Ronald Eytchison 3f31277d7d Add claude 3.5 models 2025-02-12 09:35:45 -05:00
Ronald Eytchison 64b602d23d Add o1 and o3-mini models 2025-02-12 09:35:45 -05:00
Ronald Eytchison b73288b16d Add LLM utils to common
Also bump common to python>=3.10
2025-01-28 12:03:09 -05:00
Ronald Eytchison ee9422b39d Add litellm service (#2)
* Start litellm service

* Add Azure OpenAI

* Move litellm to main compose.yaml

* Add litellm DB

Enables cost tracking
2025-01-16 09:56:12 +01:00