Before being endowed with the power of the Holy Spirit, they spoke Hebrew. After that, they spoke whatever language was needed to spread the Gospel. See Acts 2.
They were most likely multi-lingual, speaking Aramaic with additional knowledge of Hebrew, Greek and Latin. All the New Testament books are written in Greek.
