Colbert is located on Chelsea's Sloane Square