They can make a stink or write you up or something. But if they're as short staffed as everyone else, it's the sort of thing you can tune out so long as someone higher up the chain recognizes they need you more than they need five minutes.