I’m having a "who moved my cheese?" moment

Just as I had gotten settled in at my desk, I’m told that we’ll probably be moving my desk so that a door behind it can be opened, to facilitate people coming into my office through that door to talk to us rather than going around the hall. Either these people will either be talking right over my desk, or the right part of my L shaped desk will have to be removed from the office so they can get in.

I don’t want people talking over me, so if I have to I guess I’ll halve my desk.

I guess it’s not really a big deal, but for some reason I’m finding it very upsetting.