10 week old puppy -- Advice needed?

I was wondering if it's normal that my 10 week old puppy bites and puts his mouth on everything... I mean literally the only time he's not biting pants, shoes, hands, arms, toys, etc... Is when he's asleep. I have tried yelping, ignoring, bitter apple, spray water, but the only thing to calm him down is to hold him down for a minute or two... Then he'll walk away. Any advice?? Thanks in advance!