The Prisoner had to begin somewhere. But really are we really to believe that it was somewhere at the end of that long and deserted road in the opening sequence? Well that's not right for a start! That long and deserted road, isn't even a road. It's a disused runway on an old WWII airfield!
Even if we were to consider the actions of 'Fall Out,' which is a form of resignation, to be the commencement of 'the Prisoner,' we do see the Prisoner returned to London, driving passed the Houses of Parliament on his way to the underground car park. And yet seconds later we see a grimmaced faced man behind the wheel of his Lotus 7. There's a clash of thunder and before you know it, we'll be at the end of that runway again! It would seem that we have come full circle, and are not much wiser for having taken the journey!