It is possible that your body is doing more work to compensate for a underlying health problem. I am not an expert, but it likely has something to do with blood pressure. Give your doctor a call and ask.
most likely the worst thing it would mean is that your blood pressure is elevated. you might try taking notice if this happens when you are upset or stressed more so than when you are relaxed. If it occurs when you are somewhere where you can check your bp do a check and see if its elevated.