If that is your argument then those remainers may as well vote for The Funny Tinge Party as they are all ardent remainers.
Aside from the Labour vote, the majority of Labour's rank and file membership were and still are also against Brexit: 90% say they would vote to stay in the EU in another referendum and most of them want that referendum.
Give up kidding yourself on that Brexit is the revolutionary desire of the left-leaning public or politically active. Its not: your fellow Brexiteer travellers are mainly Tories and Kippers.