For a horse lover, a in-store credit at a riding apparel store would be a good idea. Someone who rides might not own a horse, but would still need attire.
You could get a nice silver necklace with a horse pendant, or you could get a gift basket with little horse goodies like notecards and things with a horse theme.