It is better to stay away from them if it is possible, else both of you husband and wife, speak up with each other and decide cordially between you two.
Communication is the best answer in this situation. Communicate with your spouse and identify the real issue. Then decide how best to approach the family.