So-called “Nimbys” have become a scapegoat, accused of standing in the way of Labour’s vision to build 1.5 million homes by the end of this parliament.