The 109th Congress (2006) was arguably the one that took the most vacation days. When evaluating the combined total, there were 239 (Senate 138, House 101) days in session.
I'm not entirely certain down to the exact number of days, but I'm fairly certain the Continental Congresses took a lot of time off in between sessions.