People look for different things when buying a diamond. For some the size is most important. For others it's the cut or clarity. Figure out matters the most to you.
My engagement ring is 4 carats. It is a nice size ring. I had no preference on how big the diamond was or the particular stone it was. It meant more to me that he picked it out on his own.