You're Going To Be Amazing

See, part of the conceit of the PotC trilogy is that all myths are true. Nearly every supernatural element in the franchise has a root in some real world mythology or pirate lore, although some of them are mashed together.

Another thing is that they take place at the end of the Golden Age of Piracy, and the more the map gets filled in, and the more the Royal Navy takes power, there less room there is for the mystical and supernatural in the world. This is explicitly called out in At World's End with the death of the kraken:

Barbossa: The world used to be a bigger place. Jack: The world's still the same. There's just... less in it.

The only way to access the world of the supernatural is through the supernatural itself. You can only get to the Isla de Muerta with Jack's compass that points to whatever you desire, or if you already know where its is. You need Tia Dalma's map to find the edge of the world. To access the supernatural, you need to already be immersed in it.

Concept art of Percy De Rolo by Phil Bourassa for The Legend of Vox Machina