bringing too much complexity into model arch can cause unknown issues that can't be tested by evals even those internal ones.
Original titlebringing too much complexity into model arch can cause unknown issues that can't be tested by evals even those internal ones. but nvm, so...
AISummary
but nvm, sometimes people can take the small unknown costs for big benefits in efficiency as fm are becoming more and more focused on so called agentic tasks
Source: Junyang Lin · x.com