You could be putting pressure on certain nerves in the palm of your hand when you ride. Think about where you hold the bars and also consider getting some gloves with a bit of padding in the area towards the outside of the bars. A change to fatter, softer grips could also help.