Using Cache Functionality to Save on API Usage

What is Cache Functionality?

When working with AI functions, you can optimize performance and save on OpenAI API usage by using cache functionality. This allows you to store AI responses for up to 3 days, reducing unnecessary requests and improving your application's efficiency. Cache functionality temporarily stores responses, preventing repeated API calls. This cuts down on usage and boosts performance, especially in environments like Excel where custom functions may frequently re-run due to worksheet changes.

Benefits of Caching

  • Reduces API Usage: By caching responses, you minimize the number of requests made to the OpenAI API, saving on usage costs.
  • Improves Performance: Cached responses are retrieved much faster than making a new API call, leading to quicker execution of AI functions.

How to Use Caching


  1. Find the Caching Setting:
    • Navigate to the Settings -> Caching
    • Enable cache functionality for your AI functions.

Did this answer your question? Thanks for the feedback There was a problem submitting your feedback. Please try again later.

Still need help? Contact Us Contact Us