If by "aluminum manifold" you mean a vacuum chamber... and if you're feeding that from the vac ports on the throttle bodies themselves that won't work very well.
Most of the vac ports on the throttle bodies are before the butterfly, not after it. To get a true vac source (certainly strong enough) for the brake booster you need to
use the ports on the T3 manifold (as they are after the butterflies) to feed the vacuum camber - which you can then use for the booster, map and fpr.