Exactly how new is he? He probably just needs some time to settle down
Try not to grab him...instead offer treats and pet him softly.
Also, you may want to consider getting him a buddy. Guinea pigs are highly social animals and do best in groups
. I've also found that single guinea pigs can be more nervous.