Provider Priority: Choosing the Right LLM for Your Bot

Did you know you can now prioritise which Large Language Model (LLM) provider your bot uses? This allows you to:

• Maximize credit usage: Prioritise providers with unused credits.

• Optimize API costs: Prioritise lower-cost providers for specific tasks.

• Improve reliability: Use a backup provider if the primary provider experiences issues.

  

Lets head over to MODIFY BOT, Then the GENERAL tab. Here you will see the Models you are able to set up and use.

*If you are missing a model, check if you have set up the API key for that model.

You can choose the order of these and even make it so credits aren't an option so your credits never get used. In this case, failed keys result in no AI response.

Credits VS Key

The options include Anthropic (credits), OpenAI (credits), Anthropic (key), OpenAI (key).

Key = Your API KEY

Credits = AGENT Credits

Using AGENT Credits As Fallback

Why We Recommend having AGENT Credits as a fallback (Credits)

Having AGENT credits as a fallback method to OpenAI API keys and Anthropic API keys is crucial for maintaining seamless bot functionality. When primary API keys fail, AGENT credits ensure the bot continues to respond without interruption. This reliability is essential for maintaining user engagement and satisfaction, ultimately leading to more booked appointments and a smoother overall experience. By preventing downtime, AGENT credits help sustain the bot’s performance and effectiveness, ensuring consistent message delivery.

🤖 By prioritising LLM providers, you gain greater control over your bot's performance and costs. You can optimise credit usage, minimise API expenses, and enhance reliability by designating backup providers. This flexibility empowers you to fine-tune your bot's operations and ensure a smooth and consistent user experience.