The first step to being assertive is to be confident in yourself. Like who you are and like what you ant to do. Men will then respond to your assertiveness.
I would recommend that you take a class in self-esteem and self-confidence for women. Build those two traits up and your passivity problem should take a hike!