A feverish puppy may be lethargic, uninterested in food, and obviously unwell; or just a little slower than usual. Either way, there is no question here: call your vet!
It's always best to visit a vet if you suspect your puppy is sick. Home treatments could cause a reaction and are not always going to solve the problem.