Some recent studies have suggested that marijauna can decrease sperm count, decrease the amount of seminal fluid you have, and alter the behavior of sperm.
Marijuana has not been shown to actually affect sperm count. It's mostly just urban legend that is passed around to scare people away from smoking it. You shouldn't have any effect on trying to conceive if you smoke.