Multiple AI provider like Groq, ...

[kidclone3]

Hi, I am a fan of you. Since I read your code and ran some agents, I have been using the free API of OpenAI (GPT-3.5). I still don't want to spend real money, so I am looking for a better alternative to GPT-3.5.

Groq provides free API usage of Llama 3.3 70B with outstanding performance compared to GPT-3.5, so I will try switching to it.

For better design, I can implement the Repository Pattern for multiple AI models. Can I create a PR to contribute to this project?

[moondevonyt]

hey man, thank you! you can definitely submit a pr a free api usage of llama would be so awesome

[nelohenriq]

that would be awesome, altough we can use the openai library to run ollama or groq or deepseek, so just add base_url to OpenAi init and change model on MODEL_OVERRIDE when needed or in config.AI_MODEL to the model(s) you want to use. It would be interesting to have the tts from ollama instead of openai's