Running multiple LLMs sounds smart until you see the bill. We use them to...
https://www.instapaper.com/read/2019815005
Running multiple LLMs sounds smart until you see the bill. We use them to balance different strengths and failure modes, but mixing outputs can hide critical dissent. Be careful-aggregating models complicates privacy across providers.