CNN  — 

Anyone who’s lost an evening researching flight deals knows that airfare pricing can seem pretty random – high one week, low the next and long-distance often cheaper than short-haul.

There’s a method behind the madness, though.

It’s called airline revenue management: the science of adjusting fares dynamically and in real time so that airlines can maximize their revenue.

And it’s not just a case of simple supply and demand.

Airlines now rely on ever-more sophisticated software that takes into account a broad range of factors, from overall conditions across their global networks, right down to the individual preferences of their passengers.

You can now buy airline tickets with monthly payments

The evolution of airline pricing techniques

Courtesy Lufthansa
Skytrax has revealed its 2016 top 10 best airlines. In 10th place is German carrier Lufthansa. It's successfully climbed two places to re-enter the top 10 list.
ROSLAN RAHMAN/AFP/Getty Images
Aussie airline Qantas, rarely absent from any top 10 list, moves up one place from 2015 to take ninth position.
ADEK BERRY/AFP/Getty Images
After making a debut in the top 10 airline chart last year, Taiwan's EVA Air climbed to eighth place this year. It was also named the best trans-Pacific airline.
Turkish Airline
Slightly down from last year (ranked fourth in 2015), Turkish Airlines was voted as the seventh best airline in the world. It's still the best airline in Europe, according to Skytrax.
Patrick Riviere/Getty Images/FILE
One of three major Middle East carriers in the top 10, Abu Dhabi's Etihad remains in sixth place this year.
KAZUHIRO NOGI/AFP/Getty Images
Japan's ANA All Nippon Airways takes the fifth spot. It also takes awards for the world's best airport services and Asia's best airline staff.
DALE de la REY/AFP/Getty Images
Hong Kong-based airline Cathay Pacific dropped from the third to fourth place this year.
Courtesy Singapore Airlines
Singapore Airlines, ranked third, is Asia's best airline. It also won the title for the best business class airline seat.
Qatar Airways
A 2015 winner, Qatar came second this year. It also has the world's best business class and business class lounge.
Courtesy Emirates
Emirates was named the best airline in this year's Skytrax awards -- a big leap from last year's fifth place. It's the fourth time the Dubai-based carrier has won the award.
AFP/Getty Images
SkyTrax also hands out a raft of other awards. AirAsia is named the world's best low-cost carrier. Its long-haul sister brand AirAsia X is said to have the best premium seat and cabin among budget airlines.
Norwegian Air
For the fourth successive year Norwegian Airline is voted the best low-cost airline in Europe. It's also the world's best low-cost airline for long haul flights.
Herb Lingl/aerialarchives.com/VIRGIN
"Virgin America continues dominating on the customer side in North America," said Edward Plaisted, Skytrax CEO. It won the awards for both best airline and best low-cost airline in North America.
GIANLUIGI GUERCIA/AFP/Getty Images/File
One of the oldest airlines in the world, South African Airways topped the best airlines chart in Africa. Other winners by regions include Finnair (Northern Europe), LAN Airlines (South America), Hainan Airlines (China) and Air Astana (Central Asia/India).
Star Alliance
With 27 member airlines, Star Alliance is the world's largest global airline alliance. It's named as the best airline alliance in the 2016 Skytrax awards.
courtesy Cathay Pacific
Cathay Pacific comes second to Etihad Airways in the category of world's best first class airlines, but its newly reopened first class lounge The Pier -- with a full-service bar -- came first.
Etihad Airways
It's hard to beat Etihad Airways when it comes to first class catering. The airline offers a chef to serve up in-flight meals to passengers.

It hasn’t always been like this.

For most of aviation history, airlines operated in a tightly regulated, uncompetitive environment, where air fares usually cost a small fortune.

Discounted tickets weren’t unheard of, but usually came with lots of strings attached, such as having to spend a certain number of nights at the destination.

International routes were usually operated by the flag carriers of the countries involved, who would take a gentlemanly approach to competition and fare-setting.

Deregulation – a global liberalization trend which began with the US Deregulation Act of 1978 – swept everything before it, from the industry structure to the way we think about air travel and airline fares.

Can you say cramped? Airplane seat patents that will make you gulp

Fiercely competitive

It’s now all about revenue management, says Robert W. Mann, a consultant and former airline planning executive.

And that’s something, he says, has become increasingly complex and fiercely competitive in the past few decades.

“The growth of the network airline and the drop in the cost of computing has brought revenue management to whole new levels of sophistication,” he tells CNN.

“Techniques such as Expected Marginal Seat Revenue (EMSR) look at the best ways to optimize fares in real time, not only on a given route, but taking into account revenue-generating opportunities across the whole airline network”.

This is why, for example, flying from London to Dubai may cost pretty much the same as flying all the way to Manila, also via Dubai.

That’s because the airline may prefer to keep seats on the London-Dubai leg for higher-value passengers that fly longer onward journeys, and will use pricing to discourage those aiming to fly shorter trips.

The world’s going flat-fee… so why not airlines?

06:25 - Source: CNN
Playing the points game: Airmiles explained

Customer profiling

But how does the airline know who the higher-value passengers are and how much to charge them?

Stuart Barwood, founder of Travercial, an airline consultancy firm, says airlines can make a number of reasonable assumptions about the profile of traffic on a certain route and then adjust their prices accordingly.

“The London to Majorca route, for example, has a marked leisure profile. This has implications not only for fare levels but also for the way pricing changes over time.

“If the airline assumes that leisure passengers will tend to book relatively early, months before their holidays, it may be tempted to start pricing seats on that route relatively high. It would then adjust them according to the market response.

“Meanwhile on a typical business route – let’s say London to Frankfurt – the airline may start with low prices to fill a minimum of capacity, then raise prices steeply for business travelers that book at the last minute.”

In fact, those last-minute high-value passengers are so precious that some airlines go the extra mile to make room for them.

For example, a service developed by Barcelona-based company Caravelo helps airlines identify those passengers most likely to accept a flight swap in exchange for compensation, such as vouchers or frequent flier miles, and offers to rebook them on a later flight.

With space then cleared, the high-fare passengers are then booked onto the previously full flight.

20 incredible vintage planes you can still fly in

Towards total customization

You might think of fare classes in terms of economy, business and first class, but the reality is airlines have dozens of subdivisions.

The airline will adjust the number of seats allocated to each fare class. When one class has been sold, the sale price will leap to the next one.

This is how most fares are currently set, but it’s still some way off from the ultimate goal: Airlines want to know their clients so well they’re able to offer fully personalized pricing.

Loyalty programs, registered users and cookie tracking can give airlines some valuable clues, but even when an airline has gathered a lot of data about its passengers they still might not be putting it to profitable use.

Helicopter tours: 5 great cities to see from just the right height

Adding up the extras

“In reality, it is quite common for passenger data to be scattered throughout several functional areas within an airline, kept in data silos where it is of little use to the revenue management department,” says Barwood.

Airlines might be lagging behind the likes of Amazon when it comes to personalized marketing, but Barwood says many are getting up to speed with data management and this is already being felt in pricing and marketing.

Revenue management systems will increasingly take into account not only the air fare itself, but the total value a passenger can generate for the airline, including ancillary revenue.

That’s all the extras that can be added to your base fare, and it’s a growing source of profit.

Using seat choice as an example, many airlines now charge for the privilege of picking your seats in advance.

This could, in theory, be managed dynamically. Why not base seat prices on the occupancy of a given flight? Or charge less to members of your loyalty program?

This kind of profiling might be beneficial to the loyalty program customer in this instance, but what about when a frequent business traveler is then consistently shown higher fares when they’re trying to book a family vacation?

It could well prompt a backlash among the sort of high value customers that every airline hopes to retain.

Airport lounges: How airlines are improving their ground game

Protecting the brand

06:33 - Source: CNN
The loophole letting passengers fly on the cheap

And while airlines may have good reasons not to overcharge their best customers, they also have to be careful not to undercharge the other classes of client.

The temptation is to aggressively lower prices when there are still empty seats left before a flight departs – but if this becomes the norm there’s a serious risk of undermining the brand and alienating higher-value passengers.

A number of companies, such as Bidflyer, Plusgrade and SeatFrog, have come up with applications that allow airlines to sell upgrades to the highest bidder through an auction mechanism – an efficient but anonymous way to get passengers to tell the airline how much they’re willing to pay for premium services.

How much would you pay for a flight upgrade?

Back to basics

The apparent randomness of airfares makes for an excellent conversation topic with friends and colleagues, but it can also be a source of anxiety for many travelers.

Perceptions that prices are immensely variable can add to the fear that customers may be overcharged for any extras they inadvertently purchase, or the worry that they might not be getting the best deal out there.

Which is why many airlines have opted for a different approach: go back to basics and offer branded fares – a bundle of services for a closed price.

This shouldn’t be confused with the rigid fare system that prevailed when the first low-cost airlines hit the scene.

This is more like an evolution of the low-cost fare system which lets customers choose the extras they want to add to the base fare.

This approach means rebundling a bunch of services – from checked-in luggage to a wider, more spacious seat — into a number of fare package options of varying complexity, all selling for a set price.

Think of it as like the menu options at a fast food joint.

Airline cabins of the future: A new golden age of travel?

The airfare arms race

Airlines might have a whole battery of tools to help them extract the most revenue from their passengers, but travelers can also call on their own arsenal of technological countermeasures.

Companies such as Skyscanner and Kayak have introduced fare alerts which allow you to monitor fares for specific flights and get automated alerts the moment they change.

Some companies are also developing fare prediction technology that promises to help travelers book their flights at the optimal moment, when the fare is likely to be lower.

In order to do this they rely on their own algorithms, plus a heap of historical data on air fares.

California-based FLYR uses its own proprietary fare prediction technology to offer fare lock-in insurance in partnership with TripAdvisor.

This service is similar to buying a financial option where you pay a relatively small premium in advance, to make sure you won’t pay more than a certain amount at a later date.

It also works with travel agents and other distribution partners to optimize bookings.

Stopover buddy can show you local sites during layover

Seizing the moment

FLYR’s founder, Dutch entrepreneur Alexander Mans, says that outside a 30-day window of a flight’s date of departure, there is a 60 to 70% chance that a specific air fare will drop in price at some point.

“It is practically impossible for someone to monitor this manually, but with our computing resources we can predict pretty accurately the chances of a fare coming down and advise on the best course of action.

“If we think a fare is going to be lower in the future, we recommend waiting, before hitting the ‘book’ button.”

Hopper is another company specializing in the field of airfare prediction. Its mobile app, which has been downloaded more than eight million times, uses big data technology to predict fares as much as 12 months in advance.

“Our system looks at six to eight billion air fares every day. Our database has five years of historical fares, that means trillions of prices!” Frederic Lalonde, Hopper’s founder and CEO, declares proudly.

He claims their algorithms are capable of accurately predicting an airfare within $5, up to six months before departure.

“We are confident enough in our system to predict actual figures and to tell our customers whether they are getting a good fare or not.

“We have tracked our accuracy to 95%. Whether people later follow our advice or not is another story…”

With this amount of computing power being thrown into the field of airline pricing and the expectation that artificial intelligence technology will go mainstream, it might ultimately be up to the robots to fight the airfare war.

This isn’t necessarily bad news – it may result in better choices and more efficient booking processes.

With virtually millions of different air fares – as many as the number of passengers airlines carry every year – what seems assured is that airline fares will continue to be a topic of conversation by the office cooler for years to come.

A light aircraft revolution takes off