Q: Should I use "ready-to-use" evaluation metrics?
A: No. It's a bad idea in most situations.
https://hamel.dev/blog/posts/evals-faq/should-i-use-ready-to-use-evaluation-metrics.html
Hamel Husain argues against using ready-to-use evaluation metrics for AI
AISummary
Hamel Husain answers "No" to whether teams should use ready-to-use evaluation metrics, calling them a bad idea in most situations. He points to a linked blog post for his reasoning.
Post on XView on X
Source: Hamel Husain · x.comPublished · added here