Replit CEO proposes general AI models train smaller domain-specific replacements

Replit CEO Amjad Masad argues that general models could train smaller, domain-specific successors on the fly when they detect a limited use case. He compares this to a just-in-time compiler that emits optimized code during execution. He says such specialized models could be cheaper, less vulnerable to prompt injection, and less harmful than general agents.