Veeresh Devireddy

AI Cost Optimization

What strategies do you use to reduce the cost of AI in production, distribution, and maintenance? How are you optimizing it?

Add a comment

Replies
Best
Wiktor Wysocki
Mostly via rethinking the way of prompting, but not the length of the prompts - as it could decrease quality. I do it by lowering the number of prompts. If example my program used 12*n*n prompts and now it uses 12*n it is a greater improvement in most cases than just shortening the prompt.