Your eye and brain stop responding when they get used to seeing the same thing. By staring into the goggles with one eye seeing green and the other red, the eyes become less sensitive to the respective colors. When visitors look up, their green de-sensitized eye sees a red world, and the their red de-sensitized eye sees a green world.