Well, my undergrad degree was on pre-primary education (that is the education of 4-6-year-olds), my first master was on special needs education (all ages). Then I did an MBA (completely different field) and now, my PhD is on Sociology!!!!!
This is a change of fields!!!!!!
I never had any problems and I believe that if you like what you are doing, you can do it!