Education secretary Michael Gove said he wants to end the modularisation of some GCSE subjects.
Speaking to the BBC's Andrew Marr over the weekend, the politician suggested that he is in favour of students sitting just one exam.
"Instead of GCSEs being split into bite-sized elements we think it's important that at the end of the GCSE course the student should be examined on everything they have learnt at one time," Mr Gove said.
"We'll have fewer exams but a concentration on a more rigorous approach at age 16."
Mr Gove claimed the government is keen to see more emphasis placed on raising standards, as well as teachers being given more freedom.
Spending less money on examinations is a good thing, the minister said.
Government figures published in August show that 69.1 per cent of pupils achieved A*-C grades in at least five GCSE subjects this year, with results improving for the 23rd consecutive year.