No, not all are poisonous, only some are. Like the amazon poison dart frog, who has a poison in the mucous covering the body to protect it from predators, but only a few others have poisons.
No not all frogs and toads are poisonous. The frogs that tends to be usually are quite small is size and come in vibrant colors-the dart frog. The toads may look unique as well; different from the majority of the species which are nonpoisonous.