In Arrival, the Prisoner is abducted to the village, his identity is stripped away, and he is given a new identity, a new name Number Six. It is an identity which the Prisoner rejects. He refuses to wear his number, and does so only once when the situation suits him, and that is during the episode of The Schizoid Man. And it is during The Schizoid Man that No.6's attitude towards that identity given to him upon his arrival in the village changes, as he desperately fights to maintain his identity, that of being No.6. After all, it's the only identity he has now.
Be seeing you