Happened to me too, try to close the menu with E/P button instead while having mouse back in middle of screen, helps a lot.
