What isn't easy to handle about it that would be easier with a only slightly smaller sail?
We're quite happy with our large Genoa. When replacing it, I went for the same size but added 5 pairs of telltales (and a foam luff for better shape when reefed). The telltales are essential in trimming it well, which is all about the car position going upwind (towable cars very helpful here), and when trimmed well, upwind performance is excellent. For downwind, we pole it out with a Selden telescopic pole. Bit of work, but the huge sail with the pole replaces an asym and is our main downwind sail. Wouldn't want it any smaller for that!
Newer Bavarias have smaller non-overlapping jibs, but that's a completely different setup with a much larger mainsail and different mast position to make up for it. If you just reduce Genoa size to below what it was designed for, you'll go slower in light airs.