Swan Tower

While it's true there may be more to the story than we know, a man who consistently asks for consent and then suddenly doesn't ask does not sound to me like a man who has "forgotten" anything - it sounds like a man who isn't asking because he knows what answer he'll get and doesn't like it.