Thomas Bach is to step down as Olympics president next year.
It had been thought that the 70-year-old may try and change the IOC's 12-year limit to extend his term at the helm.
However, Bach told the General Assembly in Paris that he would leave the post and not amend the Olympic Charter.
'A leadership change is best for our organization,' he explained. 'At my age, I'm no longer the best captain. New times need new leaders.'
Bach had been in post since 2013 and will now depart next year.
Last year some IOC members had spoken in favour of changing the rules, which were brought in an attempt to end corruption in the 1990s.
'These conversations have moved me deeply and touched my heart,' Bach said.
Britain's Lord Sebastian Coe is likely to be among those in the running to take the role.
Bach's summer has been dominated by questions over the IOC's decision to allow Imane Khelif and Lin Yu-Ting to compete in this summer's Olympics.
The boxers were alleged by the Russia-dominated International Boxing Association to have failed a gender test which led to them being banned from their World Championships.
But the Olympics president has remained steadfastly behind the decision and recently defended the right of both to box at the Games.
But he added that he would be the first to adopt an agreed 'scientifically solid system'.
He said: 'This system is working and so therefore our decision is clear.
'Women should be allowed to take part in women's competitions and the two are women.'