I reckon your wife's made the decision for you by forging ahead. You cant not go now because otherwise your legacy as father and grandfather will be tainted by being a stuffy old curmudgeon who puts theoretical rights before personal responsibilities.