A product with tea tree oil in it can help reduce the inflammation, just make sure you are not allergic to it. You can add it to your regular moisturizer.
Something that may be in your medicine cabinet worth trying is preparation H or visine! These products take the redness/inflammation out. You may also want to try the benzoyl peroxide products and a drying mask to assist you.