You have two choices -- either you must take a lot of interest in sport, too, and spend time enjoying them with him. Or you must assume that a big chunk of his time is not available for dating to allow him his avid interest.
I can tell you that you'd better be prepared to learn to like (or at least tolerate) sports yourself! Try to learn as much as you can and get interested.