I've seen wood secrete sap for year. What I do is scrape it off, sand it down, and do a little bit of touch up work with the stain until everything looks even.
There really isn't much you can do because this is a natural process that the wood will have to go through. You can use turpentine to easilly wipe it up and eventually the wood will dry out and this will no longer be an issue for you.