Hilary Duff said she "struggled" growing up in the public eye, "trying to fit a certain mold and have control over something ...