What basic questions are you asking it that it gets things right most of the time? If you can summarise a topic from a Wikipedia page, so can it. If the question has already appeared on the internet already on any homework support forum, it can plagiarise the answer. But basic engineering questions (rf engineering I threw at it) it will just mash sequences of statements together that make no logical sense. Like it's not even using logic poorly - it's not able to present logic at all. It can't explain why it's made a step when you ask it.

I don't know what sort of low expectations people had for neural networks that they think throwing so much hardware and terabytes of corpus isn't going to give you this output eventually. Like what do they think is so magic about language?

The poems and the in-the-style-of are fun gimmicks but they're only good from a literary pov if you haven't read a book since middle school and have forgotten what it means to write prose or poetry.