If there had been no violent retaliation against The Village, and Number 6 had said I want nothing more to do with The Village, take me home and let me go. Would they have simply let him go? It seems highly unlikely, seeing as he’d already reported the existence of The Village twice to the Colonel, different Colonel’s. So that is proof enough that Number 6 could not be trusted to simply go back to his world and be expected to forget all about The Village. No, they’d probably stick him in a vacant orbit tube alongside the other two rejects! But on the other hand, had Number 6 accepted the proposed offer of ultimate power, to replace Number 1, they’d need somewhere to put the ex-Number 1, in Orbit Tube 1!
Be seeing you