Of course, never EVER give a puppy a stick to play with, or bones to gnaw on. One single bone chip can literally be the difference between life and death. Store anything you value and don’t want to have chewed in higher places where puppy can’t reach or knock them over.  It is the same thing as child-proofing your home like a responsible parent. 

If puppy gets a hold of marbles, coins, or small kid’s toys, he could choke while chewing on them, so be sure these small things are picked up and out of puppy’s reach at all times. Puppies chew when they are excited.  It is a way of releasing pent up energy.   

He also doesn’t know that he has done anything wrong unless you tell him so. You have to educate him firmly.   If puppy does chew on stuff in the house, don’t spank him.  He may be responding to your behavior and chewing even more out of defiance.