Termites are worse. They can eat through wood, though not like a chainsaw as depicted in cartoons. Ants are also bad, but termites can do severe damage.
Neither the ants nor the termites are welcome in any home but as per the question, out of the two termites are more harmful because they damage your furniture, your important papers etc.
