2 points | by ritwikkar 3 hours ago
2 comments
https://thinkingmachines.ai/blog/defeating-nondeterminism-in...
> The hardest part isn’t bad output, it’s not being able to explain failures to PMs or stakeholders when nothing obviously broke.
Try: The known unreliability of stochastic LLM tech caused obviously predictable failure of output depended upon by the user.
Perhaps present the analogy of a random number generator feeding the calculation of a company's statutory financial accounts.
https://thinkingmachines.ai/blog/defeating-nondeterminism-in...
> The hardest part isn’t bad output, it’s not being able to explain failures to PMs or stakeholders when nothing obviously broke.
Try: The known unreliability of stochastic LLM tech caused obviously predictable failure of output depended upon by the user.
Perhaps present the analogy of a random number generator feeding the calculation of a company's statutory financial accounts.