I'm not really sure how it will be perceived by the organizers of the conference, but i would do what works for you and your research ect. you have the excuse that your supervisor has requested you change to poster presentation, and just be polite and apologetic. also better sooner, than later, I'm sure they can find someone at this stage to fill your spot.