I buy things on credit card, and pay the full amount off, but my credit score is going down instead of up?

I have nothing else my name expect this credit card, and student loans that are not due yet because I am still in college.