Flag Rock, at the southernmost end of the Fort, was once a Portuguese bastion. Today it is easily the most popular place to catch a sunset. During daylight hours you may see daredevil locals leaping into the water from the rocks. Numerous vendors sell good street food such as fresh papaya with chilli powder from carts.

　　During the Dutch period, approaching ships were signalled from the bastion atop Flag Rock, warning them of dangerous rocks – hence its name. Musket shots were fired from Pigeon Island, close to the rock, to further alert ships to the danger. Later, the Dutch built a lighthouse here; since removed, the nearby street name survives.