Is it a single type control solenoid. ? If it is and the Vac pipes are the wrong way round then it will not dump the vac to atmosphere when switched off. They are usually marked up VAC and OUT.
Most likely too obvious a solution but it could explain your problem. ?