Take it off. If you want, mark the settings on the studs/turnbuckles, but it's really not hard to calibrate the steering, and usually a good idea to do after dropping the rudder anyways. Do mark the height on the rudder post where the quadrant sits!
If you don't, the quadrant will be in the way and you risk damaging it when reinserting the rudder, as it's tricky enough to lift and align the heavy rudder to slide the post into the upper bearing.