This is the way! Game engines needed abstractions and guardrails to facilitate the user in orchestrating the underlying core facilities.
With AI the abstractions are made by the user and the agent brings it all together. That's how it works with threejs, it's very freeying.