I think a lot about of it can be attributed to the literary predecessors of the “isekai” genre (Alice in Wonderland, The Wizard of Oz, The Lion, The Witch & The Wardrobe, A Connecticut Yankee in King Arthur’s Court, etc. )
Also probably the most detailed fantasy world in literature would probably be Tolkein’s Middle Earth which largely inspired Dungeons & Dragon’s & RPGs in general).