Trade in ivory, spices and gold brought great wealth to the town, but it now sits abandoned and is being taken over by coral ...