Don't worry about the ISCV, when the ecu is in idle mode, it should be ignoring the MAP reading.
You could sort of say the same of the booster, depends how bothered you are by it (and how often you brake and accelerate at the same time).
If you were keen, you could copy the way the factory 20v manifold does the booster. Just drill and tap two threads in the adaptor manifold (Cyl 1 and 4), and hook them up with vacuum lines to the booster separately.