Campaign ‘incredibly frustrating and disappointing’, says mayor of city gripped by housing crisis