Apprentice star Nick Hewer has criticised the system which will result in people having to retire later.
The state pension age will rise to 66 for men and women by 2020, while legislation provides for it to increase to 68 by 2046.
Some experts have predicted that the age limits could continue to rise to cope with soaring life expectancy.
Lord Sugar's sidekick told the Radio Times that young people could end up working until their late seventies.
Hewer said: "People have the right to enjoy their old age with dignity and comfort and that has to be funded through taxation.
"They have a duty to work and support themselves during their lifetime and then, as elderly people, they deserve to be able to stop."
The 68-year-old Countdown host and former PR man said he did not have the energy to do the same job now as he did when he was younger.
Hewer, who met pensioners for the BBC1 season of programmes When I'm 65, said of their experience: "Even working in the chocolate factory was arduous.
"Younger people can do it, but it was exhausting for the pensioners. They loved the social aspect - the banter and the chat - but keeping up with the physicality of the work was too much.
"We should be saying 'You've contributed to the exchequer all your lives and now is your time to enjoy your old age', rather than 'You should have jolly well made provision for yourselves'."