I always like being able to give personalized gifts. What about an engraved picture frame with an artistic picture of the church? Another option for the picture would be to take a picture of the congregation. If there has been a collection of funds for a gift from multiple people, perhaps something like a watch.
Individually, give a gift certificate to a restaurant or department store. You and others from church could make a photo album or CD of the last five years church memories. Memory gifts are meaningful. Group gifts to buy electronics that a pastor might need are also a good idea.
I think something neutral but elegant would work. For example, a nice set of coasters or cutlery, a nice tie, a good fountain pen or some quality napkins. A small box of chocolates and a card alongside would be a good touch.
A personalized gift would be a good idea. Maybe a pen engraved with his name or a bible verse, or a watch or something useful that you know he will like.