{"id":80776,"date":"2025-08-22T14:31:02","date_gmt":"2025-08-22T13:31:02","guid":{"rendered":"https:\/\/proxidize.com\/?post_type=blog&#038;p=80776"},"modified":"2025-10-02T11:44:06","modified_gmt":"2025-10-02T10:44:06","slug":"price-comparison-sites","status":"publish","type":"blog","link":"https:\/\/proxidize.com\/blog\/price-comparison-sites\/","title":{"rendered":"How Do Price Comparison Sites Get an Edge?"},"content":{"rendered":"\n<p>It seems inevitable today that everyone\u2019s had at least one interaction with a price comparison site. From cars and apartments to hotels and flights, there\u2019s a price comparison site, also called a comparison shopping engine (CSE), dedicated to finding you the best price.<\/p>\n\n\n\n<p>In this article we\u2019ll discuss what sets CSEs apart from other price aggregators, how they make their money, and where they get their data from. Finally, we\u2019ll get to the heart of what fuels price comparison websites\u2019 competitive edge.<\/p>\n\n\n\n<p>As there are so many businesses in this industry, to help illustrate our points we\u2019ll specifically be using travel price comparison sites to illustrate our examples, although anything discussed here applies generally to the CSE industry as a whole.<\/p>\n\n\n\n<div style=\"height:24px\" aria-hidden=\"true\" class=\"wp-block-spacer\"><\/div>\n\n\n\n<figure class=\"wp-block-image aligncenter size-large is-resized centered\"><img fetchpriority=\"high\" decoding=\"async\" width=\"1024\" height=\"536\" src=\"https:\/\/proxidize.com\/wp-content\/uploads\/2025\/08\/what-is-a-price-comparison-site-img-1024x536.jpg\" alt=\"a magnifying glass held up to a price comparison site under the title &quot;What is a Price Comparison Website?&quot;\" class=\"wp-image-80790\" style=\"object-fit:cover\" srcset=\"https:\/\/proxidize.com\/wp-content\/uploads\/2025\/08\/what-is-a-price-comparison-site-img-1024x536.jpg 1024w, https:\/\/proxidize.com\/wp-content\/uploads\/2025\/08\/what-is-a-price-comparison-site-img-300x157.jpg 300w, https:\/\/proxidize.com\/wp-content\/uploads\/2025\/08\/what-is-a-price-comparison-site-img-768x402.jpg 768w, https:\/\/proxidize.com\/wp-content\/uploads\/2025\/08\/what-is-a-price-comparison-site-img-600x314.jpg 600w, https:\/\/proxidize.com\/wp-content\/uploads\/2025\/08\/what-is-a-price-comparison-site-img.jpg 1200w\" sizes=\"(max-width: 1024px) 100vw, 1024px\" \/><\/figure>\n\n\n\n<div style=\"height:24px\" aria-hidden=\"true\" class=\"wp-block-spacer\"><\/div>\n\n\n\n<h2 class=\"wp-block-heading\">What Is a Price Comparison Website?<\/h2>\n\n\n\n<p>On paper, price comparison sites (or CSEs as they\u2019re officially known) specialize in presenting you with products or services at the lowest price, based on your needs or parameters.<\/p>\n\n\n\n<p>Price comparison sites aren\u2019t online marketplaces, they\u2019re middlemen. They make money from the companies whose services and products they list advertisements for.<\/p>\n\n\n\n<p><a href=\"https:\/\/www.skyscanner.net\/\" target=\"_blank\" rel=\"noreferrer noopener\">Skyscanner<\/a>, for example, <a href=\"https:\/\/www.skyscanner.com\/tips-and-inspiration\/who-is-skyscanner\" target=\"_blank\" rel=\"noreferrer noopener\">defines<\/a> itself as \u201ca comparison website\u201d that generates revenue \u201cthrough a\u202fcombination of advertising and commission from our partners\u201d. It does this for flights, hotels, and car rental companies.<\/p>\n\n\n\n<p>A CSE doesn\u2019t make any purchases on your behalf, it only puts you into contact with the company offering you the service, whether it\u2019s an airline, hotel, car rental company, or travel agent.<\/p>\n\n\n\n<p>However, this begs the question: What\u2019s the difference between a price comparison site and an online marketplace?<\/p>\n\n\n\n<h3 class=\"wp-block-heading\">Price Comparison Sites vs Online Marketplaces<\/h3>\n\n\n\n<p>To the consumer, the difference between a price comparison site and an online marketplace as it relates to price aggregation is not a meaningful one. When you\u2019re trying to organize a holiday, the fact that <a href=\"https:\/\/www.booking.com\/\" target=\"_blank\" rel=\"noreferrer noopener\">Booking.com<\/a> and Skyscanner have two different business models \u2014 the former an online travel agent (OTA) and the latter a CSE \u2014 doesn\u2019t matter to you. As long as you\u2019re able to compare prices between hotels you\u2019re happy.<\/p>\n\n\n\n<p>A CSE\u2019s business model is exclusively price aggregation. By contrast, an online marketplace may offer price comparisons, but that is only part of its business model. The fact that many, if not most, CSEs and online marketplaces are <a href=\"https:\/\/en.wikipedia.org\/wiki\/Vertical_integration\" target=\"_blank\" rel=\"noreferrer noopener\">vertically integrated<\/a> adds to this confusion. The same company may own several CSEs and OTAs that cover every aspect of travel from flights to hotels and rentals across every continent.<\/p>\n\n\n\n<p>Let\u2019s take a side-by-side look at the differences between the two companies we mentioned to illustrate the differences.<\/p>\n\n\n\n<figure class=\"wp-block-table\"><table class=\"has-fixed-layout\"><thead><tr><th><strong>Feature<\/strong><\/th><th><strong>Booking<\/strong>.com<\/th><th><strong>Skyscanner<\/strong><\/th><\/tr><\/thead><tbody><tr><td><strong>Business Model<\/strong><\/td><td>OTA<\/td><td>CSE<\/td><\/tr><tr><td><strong>Core Function<\/strong><\/td><td>Transaction platform<\/td><td>Comparison engine<\/td><\/tr><tr><td><strong>Who Owns the Transaction?<\/strong><\/td><td>Booking.com<\/td><td>OTA, airline, hotel, etc.<\/td><\/tr><tr><td><strong>Revenue Model<\/strong><\/td><td>Commissions: hotels, airlines, and hosts pay per completed booking<\/td><td>Referral: partners pay per click\/redirect (CPC model)<\/td><\/tr><tr><td><strong>Incentives<\/strong><\/td><td>Maximize bookings completed on own platform<\/td><td>Maximize number of referrals to partners<\/td><\/tr><\/tbody><\/table><figcaption class=\"wp-element-caption\"><em>Source: <a href=\"https:\/\/proxidize.com\/blog\/price-comparison-sites\/\" data-type=\"link\" data-id=\"https:\/\/proxidize.com\/blog\/price-comparison-sites\/\">Proxidize<\/a><\/em><\/figcaption><\/figure>\n\n\n\n<h3 class=\"wp-block-heading\">Examples of Price Comparison Sites by Industry<\/h3>\n\n\n\n<p>To give you a selection of CSEs by industry, some of which might be familiar to you.<\/p>\n\n\n\n<ol class=\"wp-block-list\">\n<li><strong>Travel<\/strong>\n<ul class=\"wp-block-list\">\n<li>Skyscanner<br>Google Flights\/Google Hotels<br>Trivago<\/li>\n<\/ul>\n<\/li>\n\n\n\n<li><strong>Retail &amp; ecommerce<\/strong>\n<ul class=\"wp-block-list\">\n<li>Google Shopping<\/li>\n\n\n\n<li>Idealo<\/li>\n\n\n\n<li>PriceRunner<\/li>\n<\/ul>\n<\/li>\n\n\n\n<li><strong>Finance &amp; insurance<\/strong>\n<ul class=\"wp-block-list\">\n<li>CompareTheMarket<\/li>\n\n\n\n<li>NerdWallet<\/li>\n\n\n\n<li>Policygenius<\/li>\n<\/ul>\n<\/li>\n\n\n\n<li><strong>Consumer electronics &amp; specialized goods<\/strong>\n<ul class=\"wp-block-list\">\n<li>PriceGrabber<\/li>\n\n\n\n<li>Shopzilla<\/li>\n\n\n\n<li>Kelkoo<\/li>\n<\/ul>\n<\/li>\n<\/ol>\n\n\n\n<h3 class=\"wp-block-heading\">Examples of Sites That Aren\u2019t CSEs<\/h3>\n\n\n\n<p>To make the distinction clear, here are online marketplaces that are <strong>not CSEs<\/strong> but do engage in price aggregation.<\/p>\n\n\n\n<ol class=\"wp-block-list\">\n<li><strong>Travel:<\/strong> Booking.com<\/li>\n\n\n\n<li><strong>Retail &amp; ecommerce:<\/strong> Amazon<\/li>\n\n\n\n<li><strong>Finance &amp; insurance:<\/strong> LendingTree<\/li>\n\n\n\n<li><strong>Consumer electronics &amp; specialized goods:<\/strong> Newegg<\/li>\n<\/ol>\n\n\n\n<p>The key difference is that the transaction is happening <em>on their platform<\/em>.<\/p>\n\n\n\n<p>As we\u2019ve touched on, price comparison sites make money for every user that finds a partner through its site. Let\u2019s explore that more.<\/p>\n\n\n\n<div style=\"height:24px\" aria-hidden=\"true\" class=\"wp-block-spacer\"><\/div>\n\n\n\n<figure class=\"wp-block-image aligncenter size-large is-resized centered\"><img decoding=\"async\" width=\"1024\" height=\"536\" src=\"https:\/\/proxidize.com\/wp-content\/uploads\/2025\/08\/how-do-price-comparison-sites-make-money-img-1024x536.jpg\" alt=\"A diagram of clicks funneling into a coin and a screenshot of price comparison sites under the title &quot;How Do Price Comparison Sites Make Money?&quot;\" class=\"wp-image-80787\" style=\"object-fit:cover\" srcset=\"https:\/\/proxidize.com\/wp-content\/uploads\/2025\/08\/how-do-price-comparison-sites-make-money-img-1024x536.jpg 1024w, https:\/\/proxidize.com\/wp-content\/uploads\/2025\/08\/how-do-price-comparison-sites-make-money-img-300x157.jpg 300w, https:\/\/proxidize.com\/wp-content\/uploads\/2025\/08\/how-do-price-comparison-sites-make-money-img-768x402.jpg 768w, https:\/\/proxidize.com\/wp-content\/uploads\/2025\/08\/how-do-price-comparison-sites-make-money-img-600x314.jpg 600w, https:\/\/proxidize.com\/wp-content\/uploads\/2025\/08\/how-do-price-comparison-sites-make-money-img.jpg 1200w\" sizes=\"(max-width: 1024px) 100vw, 1024px\" \/><\/figure>\n\n\n\n<div style=\"height:24px\" aria-hidden=\"true\" class=\"wp-block-spacer\"><\/div>\n\n\n\n<h2 class=\"wp-block-heading\">How Do Price Comparison Sites Make Money?<\/h2>\n\n\n\n<p>CSEs rely on collecting lots of data on their respective industries to be able to offer as accurate a price comparison to users as possible. They theoretically have a vested interest in maximizing consumer\u2019s trust in the company and charge OTAs and other partners for every click, similar to many other platforms that use CPC (cost-per-click) pricing models.<\/p>\n\n\n\n<p>When you set your trip parameters into Skyscanner, for example, you won\u2019t necessarily find the cheapest flights automatically. Instead, you\u2019ll find the \u201cBest\u201d results listed by default. These are the partners that have won Skyscanner\u2019s <a href=\"https:\/\/www.investopedia.com\/terms\/c\/cpc.asp\" target=\"_blank\" rel=\"noreferrer noopener\">CPC bid<\/a>. This is where the money is.<\/p>\n\n\n\n<p>When you move on to booking a hotel, you\u2019ll find the following categories:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>Recommended<\/li>\n\n\n\n<li>Top reviews<\/li>\n\n\n\n<li>Lowest price<\/li>\n\n\n\n<li>Most stars<\/li>\n\n\n\n<li>Nearest first<\/li>\n<\/ul>\n\n\n\n<p>Skyscanner\u2019s \u201cRecommended\u201d section, which is selected by default, sorts \u201cdeals available on each property by price and our potential revenue.\u201d However, because their business model relies on user trust, you can of course sort by lowest price.<\/p>\n\n\n\n<p>As much as CSEs have a vested interest in presenting partners, they also have an incentive to present the most complete picture of available offerings. How do CSEs collect all their data though?<\/p>\n\n\n\n<div style=\"height:24px\" aria-hidden=\"true\" class=\"wp-block-spacer\"><\/div>\n\n\n\n<figure class=\"wp-block-image aligncenter size-large is-resized centered\"><img decoding=\"async\" width=\"1024\" height=\"536\" src=\"https:\/\/proxidize.com\/wp-content\/uploads\/2025\/08\/how-do-price-comparison-sites-get-their-data-img-1024x536.jpg\" alt=\"a spider, code, and a price comparison site under the title &quot;How Do Price Comparison Sites Get Their Data?&quot;\" class=\"wp-image-80786\" style=\"object-fit:cover\" srcset=\"https:\/\/proxidize.com\/wp-content\/uploads\/2025\/08\/how-do-price-comparison-sites-get-their-data-img-1024x536.jpg 1024w, https:\/\/proxidize.com\/wp-content\/uploads\/2025\/08\/how-do-price-comparison-sites-get-their-data-img-300x157.jpg 300w, https:\/\/proxidize.com\/wp-content\/uploads\/2025\/08\/how-do-price-comparison-sites-get-their-data-img-768x402.jpg 768w, https:\/\/proxidize.com\/wp-content\/uploads\/2025\/08\/how-do-price-comparison-sites-get-their-data-img-600x314.jpg 600w, https:\/\/proxidize.com\/wp-content\/uploads\/2025\/08\/how-do-price-comparison-sites-get-their-data-img.jpg 1200w\" sizes=\"(max-width: 1024px) 100vw, 1024px\" \/><\/figure>\n\n\n\n<div style=\"height:24px\" aria-hidden=\"true\" class=\"wp-block-spacer\"><\/div>\n\n\n\n<h2 class=\"wp-block-heading\">How Do Price Comparison Sites Get Their Data?<\/h2>\n\n\n\n<p>Both hotels and OTAs are incentivized to buy into price comparison platforms, but to set themselves apart from their competitors, price comparison sites need to go beyond relying solely on partners.<\/p>\n\n\n\n<p>Some airlines, hotels, car rental companies, and more, benefit from additional visibility and lose nothing by offering CSEs their data. For example, structured data markup is an internet standard for embedding metadata in a website\u2019s HTML to make it easier for search engines to understand context. This includes everything from articles and reviews to product descriptions and prices.<\/p>\n\n\n\n<p>Although not consistently applied, it can make it easier for CSEs to automate crawling websites and collecting the relevant data through web scraping. However, price comparison sites can\u2019t rely on markup that makes it easy to scrape. We have finally arrived at the purpose of this article.<\/p>\n\n\n\n<div style=\"height:24px\" aria-hidden=\"true\" class=\"wp-block-spacer\"><\/div>\n\n\n\n<figure class=\"wp-block-image aligncenter size-large is-resized centered\"><img loading=\"lazy\" decoding=\"async\" width=\"1024\" height=\"536\" src=\"https:\/\/proxidize.com\/wp-content\/uploads\/2025\/08\/price-comparison-sites-web-scraping-img-1024x536.jpg\" alt=\"a man typing at a computer and a price comparison site screenshot under the title &quot;Web Scraping: CSEs' Competitive Edge&quot;.\" class=\"wp-image-80789\" style=\"object-fit:cover\" srcset=\"https:\/\/proxidize.com\/wp-content\/uploads\/2025\/08\/price-comparison-sites-web-scraping-img-1024x536.jpg 1024w, https:\/\/proxidize.com\/wp-content\/uploads\/2025\/08\/price-comparison-sites-web-scraping-img-300x157.jpg 300w, https:\/\/proxidize.com\/wp-content\/uploads\/2025\/08\/price-comparison-sites-web-scraping-img-768x402.jpg 768w, https:\/\/proxidize.com\/wp-content\/uploads\/2025\/08\/price-comparison-sites-web-scraping-img-600x314.jpg 600w, https:\/\/proxidize.com\/wp-content\/uploads\/2025\/08\/price-comparison-sites-web-scraping-img.jpg 1200w\" sizes=\"(max-width: 1024px) 100vw, 1024px\" \/><\/figure>\n\n\n\n<div style=\"height:24px\" aria-hidden=\"true\" class=\"wp-block-spacer\"><\/div>\n\n\n\n<h2 class=\"wp-block-heading\">Web Scraping: CSEs\u2019 Competitive Edge<\/h2>\n\n\n\n<p>If the \u201ccompleteness\u201d of a price comparison site\u2019s offerings is the determining factor in whether users trust them, then CSEs have to invest heavily in finding every product or service and collecting every listing they have on offer.<\/p>\n\n\n\n<p>Let\u2019s continue using hotels as an example. Skyscanner benefits not only from working with OTAs like Booking.com but also from finding lesser-known hotels and hostels that might offer its users a \u201cunique\u201d experience they may not find anywhere else.<\/p>\n\n\n\n<p>Moreover, because the travel industry is so fiercely competitive, price fluctuations are nearly constant. Whether it\u2019s to outbid a competitor or to ensure 100% capacity, airlines and hotels constantly update their prices.<\/p>\n\n\n\n<p>This means that a CSE, Skyscanner in this case, doesn\u2019t only have to ensure it knows of the <em>existence<\/em> of every flight or hotel room, but also how much it costs <em>right now<\/em>. Furthermore, deals can be based on many factors, including but not limited to time of day, geographic location, and current occupancy.<\/p>\n\n\n\n<p>Indeed, we have evidence that companies like Skyscanner engage in large-scale web scraping and <a href=\"https:\/\/proxidize.com\/blog\/screen-scraping\/\" target=\"_blank\" rel=\"noreferrer noopener\">screen scraping<\/a> as the result of an <a href=\"https:\/\/www.irishtimes.com\/business\/transport-and-tourism\/ryanair-fails-to-win-injunction-against-skyscanner-1.4317873\" target=\"_blank\" rel=\"noreferrer noopener\">unsuccessful injunction<\/a> filed by Ryanair against a number of OTAs and CSEs.<\/p>\n\n\n\n<p>Every price aggregator, but especially CSEs, set themselves apart from their competitors with large-scale <a href=\"https:\/\/proxidize.com\/blog\/web-scraping\/\" target=\"_blank\" rel=\"noreferrer noopener\">web scraping<\/a> operations that search for as many relevant listings as possible, and scrape them as often as possible, specifically <a href=\"https:\/\/anakin.company\/en-us\/pricing-intelligence\/\" target=\"_blank\" rel=\"noreferrer noopener\">price scraping<\/a>, as listings are often priced dynamically to maximize revenue and occupancy.<\/p>\n\n\n\n<p>Another conclusion we can draw from Ryanair\u2019s injunction is that not every company wants their data to be scraped. As a consequence, many sites will employ anti-bot measures, which further requires CSE\u2019s web scraping to be able to bypass those measures.<\/p>\n\n\n\n<p>Of course, as several lawsuits have shown, some CSEs seek a competitive advantage through unfair business practices. In 2022, the Australian justice system <a href=\"https:\/\/www.accc.gov.au\/media-release\/trivago-to-pay-447-million-in-penalties-for-misleading-consumers-over-hotel-room-rates\" target=\"_blank\" rel=\"noreferrer noopener\">fined<\/a> Trivago AU$44.7 million for \u201cmisleading consumers\u201d, and CompareTheMarket, an insurance CSE, was fined \u00a317.9 million by British authorities for <a href=\"https:\/\/www.gov.uk\/government\/news\/cma-fines-comparethemarket-17-9m-for-competition-law-breach\" target=\"_blank\" rel=\"noreferrer noopener\">breaching competition law<\/a> in 2020.<\/p>\n\n\n\n<div style=\"height:24px\" aria-hidden=\"true\" class=\"wp-block-spacer\"><\/div>\n\n\n\n<h2 class=\"wp-block-heading\">Conclusion<\/h2>\n\n\n\n<p>At the end of the day, a CSE\u2019s advantage is driven by the completeness of their information. This is driven by an intense data collection process that serves as its driving force.<\/p>\n\n\n\n<p>All price aggregators, but especially CSEs set themselves apart by having more listings, more often, and more accurate than their competition. Whether they gather that data from partners directly or through a sophisticated web scraping operation \u2014 often both \u2014 price comparison sites rely on a steady flow of data.<\/p>\n\n\n\n<p><strong>Key Takeaways:<\/strong><\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li><strong>Price aggregation is a CSE\u2019s entire business model<\/strong>.<\/li>\n\n\n\n<li>Having <strong>more listings<\/strong> improves a CSE\u2019s position, as it negotiates from a position of strength, and makes it <strong>more attractive to partners and consumers<\/strong>.<\/li>\n\n\n\n<li>CSEs have to find a <strong>balance between improving user trust and maximizing revenue<\/strong> by promoting partners, which sometimes conflict.<\/li>\n\n\n\n<li>For price comparison websites, large-scale <strong>web scraping provides a competitive edge<\/strong>.<\/li>\n<\/ul>\n\n\n\n<p>Data and the increasing speed with which it can be acted upon will continue to develop. The implementation and adoption of <a href=\"https:\/\/anakin.company\/blogs\/dynamic-pricing-ecommerce-guide\" target=\"_blank\" rel=\"noreferrer noopener\">dynamic pricing<\/a> will only continue to expand as online marketplaces and individual businesses continue to seek their own competitive advantages.<\/p>\n\n\n\n<p>Furthermore, they\u2019ll be even more incentivized to make sure their websites aren\u2019t easy targets for web scrapers and data collectors. As a result, CSEs have their own vested interest in investing in advanced data collection.<\/p>\n","protected":false},"author":2284,"featured_media":80788,"parent":0,"menu_order":0,"comment_status":"closed","ping_status":"closed","template":"","format":"standard","categories":[262],"tags":[],"class_list":["post-80776","blog","type-blog","status-publish","format-standard","has-post-thumbnail","hentry","category-industry-news"],"acf":[],"_links":{"self":[{"href":"https:\/\/proxidize.com\/wp-json\/wp\/v2\/blog\/80776","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/proxidize.com\/wp-json\/wp\/v2\/blog"}],"about":[{"href":"https:\/\/proxidize.com\/wp-json\/wp\/v2\/types\/blog"}],"author":[{"embeddable":true,"href":"https:\/\/proxidize.com\/wp-json\/wp\/v2\/users\/2284"}],"replies":[{"embeddable":true,"href":"https:\/\/proxidize.com\/wp-json\/wp\/v2\/comments?post=80776"}],"version-history":[{"count":3,"href":"https:\/\/proxidize.com\/wp-json\/wp\/v2\/blog\/80776\/revisions"}],"predecessor-version":[{"id":84756,"href":"https:\/\/proxidize.com\/wp-json\/wp\/v2\/blog\/80776\/revisions\/84756"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/proxidize.com\/wp-json\/wp\/v2\/media\/80788"}],"wp:attachment":[{"href":"https:\/\/proxidize.com\/wp-json\/wp\/v2\/media?parent=80776"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/proxidize.com\/wp-json\/wp\/v2\/categories?post=80776"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/proxidize.com\/wp-json\/wp\/v2\/tags?post=80776"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}