Why do parents read to their children, but they do not "math" to their children? You will notice that this story is peppered with the word "math" used as a verb instead of the more common use as a noun. Many parents feel uncomfortable with speaking "math" because they lack confidence in their own math aptitude.
A common story I've been told by many mothers is how they themselves had very unpleasant math related experiences. However, you'll be surprised how easy it is to introduce math into your child's every day life and still have fun. For example, simple number counting goes a long way and is very impressionable at a young age. You can start at any age, 1yr, 2yrs or 3yrs. Count from 1 to 10 by 1's and 2's. Gradually count up to 20, 30, etc. Then count by 3's, 4's, etc. Incorporate physical objects: count by 1's while handing a ball to your child then subtract 1 while taking a ball back. Using simple yet creative techniques will surely make a difference.