In AD 1704, the Allied Fleet initiated a siege on a defenceless Gibraltar. This was prompted by the failure to enthrone the Hapsburg, Prince Charles of Austria for the Bourbon King, Philip V. Gibraltar was forced to capitulate as in AD 1309 with Ferdinand IV. Allied troops landed via the Shrine, in the same manner that Barbarossa’s troops did. Valuables were stolen and the statue was broken into pieces and discarded.

Under the Terms of Capitulation, Catholics were allowed to practise their faith. Church property would be respected. This proved to be too late for the Shrine -the harm had already been done.  Free passage was granted to those who wished to leave.  Thirty families remained whilst 6000 inhabitants moved away from the Rock.

The Confraternity continued their services, especially their almsgiving and the burial needs of the poor.

The Devotion to Our Lady persevered throughout the British occupation. No records exist as to when the Confraternity came to an end.