This may well be normal so don't panic. You should bring this to the attention of your pediatrition at your baby's next well check. They can perform several tests to reassure you that all is well.
It could possibly be an early sign of a developmental problem such as Autism or a learning delay. Ask your doctor about it. Sometimes it's too early to tell.