Not Enough Vaccuum
If every thing is fine you could try bumping your idle up to help with braking.
booster accumulate some vacuum from better points
so you have some reserve. If this bleeds too badly then
you might have a weak boost. Or maybe this is just old
school and no longer this way?
Might pull the hose from the vac booster and be sure it's
pulling vacuum there (75kPa MAP should still be ~ 4PSI
vacuum) and not fallen off the back of the manifold.
If you prop up the RPM on a coast-down and brake, get
the vacuum up, is brake function improved?

