LLMs are just knowledge replicators. There are multiple Star Trek episodes that feature this kind of technology without any actuall intelligence but incredibly good at replicating preexisting knowledge and experiences.

Like the Drone that Picard encountered where he lived an entire life in a civilisation that had died long ago. Or basically all Holodeck Episodes.

Still actual intelligence with creative thought is something somehow different.