Ofc it does . All it was trained on was farming for levelling. It's not about doing something unpredictable. It's about potential.
Feed it a bigger context and train it on class-specific fighting patterns, buffing, item values, trading, chatting in L2 lingo, reading trade chat, party-based farming, crafting goals, etc, and you have something that a normal deterministic bot would take a really long time coding to achieve.
Add that to all of the work being offloaded to a model instead of the gameserver, and you have a much better solution that feels way more natural. Ofc you can do pretty much everything with a state machine but you'd have to write insane amounts of code. It's a waste of time.
Don't be blindsided by your hate for AI. There is considerable potential here.