B6 actually aids in the formation of neurotransmitters that affect mood and sexual stimulation, because of this it is actually believed to aid in preventing impotence by enhancing testosterone levels in the body.
B6 does is not known to cause impotence. If too much is taken it can cause nuerological side effetcs including skin rashes, chest pain, upset stomach and fatigue.
B6 vitamin is essential as a co-factor for many body enzymes. Deficiency or excess intake may cause some neurological symptoms but its not known to affect sexual function directly.