Appearance is the main difference between them. Both plants contain a substance, urushiol, that can cause allergic reactions if it touches your skin. Poison ivy often grows vine like, using trees for support. Poison oak is a shrub. Poison ivy sometimes has berries on the plant in the fall. Poison ivy leaves have three main points; oak has serrated edges.