It was in a palace.
This was easy for the jinnee of the lamp, of course, and the next day, when Aladdin went to the palace, everybody in the city came out to watch.
Go to the Sultan's palace?
They left the gardens, walked past the Sultan's palace, and out of the city up into the hills.
Edward once told a story about the house :Buckingham Palace was very big, and people sometimes got lost.