and as babies too, does it grow different?
Kind of. Men and women have different patterns of hair growth, and hair growth is influenced by sex hormones. Also, men are genetically more likely to lose hair as its a gene located on the X chromosome. Therefore, one copy of the gene is enough to make them lose their hair. I have no idea about babies hair, though my own hair was very different as a young child than it is now.
Everyone is different and so is our hair. I don't think it grows a certain way based on your gender.