They are asking more money when you booked your holiday, saying that they can offer a better flight time.
And when you are on the airport, you will see that there was no flight going on that time of the day.
So you have been paying for the upgrade even that there was no other.