References to President Obama's vacationing habits have dogged him throughout his presidency - jokes about his golf swing, his days off, etc. etc. From the Republican presidential debate: “He thinks being hands-on in the economy is to work on his golf grip.”
A surprising fact: he's heard it before. In fact, in 2000, when he was still a somewhat obscure Illinois politician with a "lack of name recognition." See THIS article from the Hyde Park Herald, a local Chicago newspaper.