The "bigger COP number wins" myth when comparing two heat pumps
Last month a client in the Dandenong Ranges sent me two spec sheets and asked which unit to buy. One listed a COP of 5.2. The other listed 4.1. "Easy," she said, "the 5.2 one, obviously." It wasn't obvious at all, and by the time we'd worked through it, the 4.1 unit was the better fit for her house on Sherbrooke Road. That conversation is the reason I'm writing this.
The myth I want to knock over isn't that COP is meaningless. It's the assumption that a single COP number is directly comparable between two different products, or even useful on its own, without knowing the conditions it was measured under. Manufacturers aren't lying when they print these numbers. But the test conditions behind them vary enough that "bigger number wins" is often just wrong.
What COP actually measures, and what it doesn't
Coefficient of performance is a ratio: heat energy delivered divided by electrical energy consumed, at one specific outdoor temperature, one specific indoor temperature, and one specific compressor speed. That's it. It's a snapshot, not a season.
A heat pump rated at COP 4.5 at 7°C outdoor air might drop to 2.2 at -5°C. Another unit rated at a lower headline COP might hold up far better in genuinely cold conditions because its compressor and refrigerant circuit were engineered for cold-climate operation rather than for winning a spec-sheet comparison at mild temperatures. I've covered how the rating-plate number diverges from real-world output in more depth over on the COP rating vs real-world performance piece, and it's worth reading alongside this one because the two myths compound each other.
The practical issue is that most consumer-facing spec sheets print the flattering number, usually the mild-weather COP, and bury (or omit) the cold-weather figure. If you're shopping in Melbourne's outer east, Canberra, or anywhere in the US Northeast or upper Midwest, that mild-weather number tells you almost nothing about your actual winter.
Same test standard, different test point
In Australia, heat pump performance is typically tested and reported under AS/NZS 3823, which does specify standardised conditions, but manufacturers can choose which conditions to headline in marketing material even when the full test data sits in an appendix. In the US, AHRI certifies performance under a defined set of temperature bins, and the more useful figure for cold-climate shoppers is HSPF2 (Heating Seasonal Performance Factor) rather than a single-point COP, because HSPF2 is a seasonal average across a range of outdoor temperatures rather than one flattering data point.
So when you're holding two spec sheets side by side, the first question isn't "which number is bigger," it's "were these numbers measured at the same outdoor temperature, same indoor set point, and same standard?" Nine times out of ten, when I actually dig into two competing sheets, they aren't directly comparable at all. One manufacturer might quote COP at 7°C, another at 2°C, and a straight number comparison between them is comparing two different questions, not two answers to the same one.
This is exactly the kind of thing the ENERGY STAR heat pump certification page tries to standardise for US buyers through its labelling requirements, and it's worth checking whether a unit carries that certification rather than trusting a manufacturer's own marketing PDF alone.
Why the mild-weather number is the one that gets printed
I don't think this is deliberate deception in most cases. Compressors are genuinely more efficient at smaller temperature differentials, so a COP measured at a mild 7°C outdoor / 20°C indoor split will always look better than one measured at -5°C outdoor. Printing the best-case number is standard industry practice, not a trick specific to one brand.
The problem is what it does to buyer psychology. A homeowner in a genuinely cold climate, comparing two brochures, gravitates to the bigger headline figure without realising that figure was generated under conditions their house will rarely experience for half the heating season. I'd argue this is a bigger source of buyer disappointment than defrost cycles or unit sizing, because it happens before the unit is even purchased. The design temperature discussion I wrote up separately, the design temperature mistake, is really the same underlying problem approached from the sizing side rather than the efficiency-labelling side.
What to actually compare instead
Ask for, or find in the technical datasheet appendix (not the marketing summary), the COP or capacity curve across a range of outdoor temperatures, ideally including something close to your region's 99% design temperature. That's the outdoor temperature your area only drops below roughly 1% of winter hours, which your installer's load calculation should already reference.
For US buyers, HSPF2 is the more honest seasonal metric because it's already averaged across a temperature bin distribution rather than being a single point. For Australian buyers, the AS/NZS 3823 test report (ask your installer to show it, not just quote you the number) usually lists performance at multiple conditions, and a "cold-climate rated" unit should show a smaller drop-off between the mild and cold test points. I've written separately about what that "cold-climate rated" label is actually certifying and what it isn't, over at what cold-climate rated on a heat pump spec sheet actually guarantees, because that label itself gets a bit oversold too.
What you're really hunting for is the shape of the curve, not the peak of it. A unit that starts at COP 4.0 and only falls to COP 2.8 at your coldest design temperature will beat, on your actual winter power bill, a unit that starts at COP 5.0 and craters to COP 1.9 at the same temperature. The area under that curve across your heating season is what shows up on the meter, not the number on the box.
How this plays out on an actual bill
Take a rough example. A 6kW heating load home in a climate with a design temperature around -3°C. Unit A headlines COP 5.0 at 7°C but only manages COP 2.3 at -3°C. Unit B headlines a less flashy COP 4.2 at 7°C, and holds COP 3.1 at -3°C. Across a full heating season, where a meaningful chunk of hours sit well below 7°C outdoor, Unit B will very likely use noticeably less electricity overall, despite losing the brochure comparison outright.
This is roughly the situation my Dandenong Ranges client was in, hence the recommendation against the bigger number. Her installer had actually pulled the full AHRI-style extended rating table (her unit was a US-manufactured model sold locally) and it showed exactly this crossover pattern once you got below about 2°C outdoor. Without that table, she'd have bought on the wrong number entirely.
If you're weighing a heat pump against gas as well as against another heat pump, the running-cost comparison gets a layer more complex again. I've broken that math down separately in how to actually compare running costs between heat pump and gas heating, which is a useful companion read if you're still deciding on the heating type before you get into brand comparisons.
What actually protects you at the point of purchase
Ask your installer, before signing anything, for the extended performance table down to at least your climate's design temperature, not just the marketing datasheet's single mild-weather COP. A properly licensed installer running a real load calculation, rather than eyeballing it, should have this on hand or be able to pull it from the manufacturer's technical portal in a few minutes. If they can't, or seem unfamiliar with the request, that's a reasonable signal to keep shopping, and it lines up with a lot of the other checks I'd push you toward in how to vet a heat pump installer.
Whether you land on a ducted system like the Zuba Central or a premium inverter ducted unit like the Premium Inverter Ducted FDYQ200LCV1, the same rule applies. The install-quality data and cold-weather curve matter more than the headline number on page one of the brochure. And if you're also weighing a heat pump hot water unit as part of the same electrification project, the same "check the whole curve, not just the top-line number" logic applies there too, something I go into in the heat pump hot water running-cost breakdown.
The honest bottom line on COP shopping
COP isn't a lie and it isn't useless. It's a snapshot taken under one specific condition, and treating it like a universal efficiency score is where buyers get burned. The Australian Institute of Refrigeration, Air Conditioning and Heating and equivalent US trade bodies have both pushed back on single-point efficiency marketing for years, without much success, because a bigger number on a shelf display still sells better than an honest curve buried in an appendix.
My rule of thumb after enough of these spec-sheet arguments to lose count: if a salesperson's entire pitch rests on one COP number, ask to see the curve. If they can produce it happily, that's a good sign about the rest of the sale too.
Common questions
- Is a higher COP always more efficient?
- Only at the specific temperature it was tested at. A unit with a lower headline COP can outperform a higher-rated one once outdoor temperatures drop, if its compressor and refrigerant system are built to hold performance in cold conditions rather than peak in mild ones.
- What's the difference between COP and HSPF2?
- COP is a single-point measurement at one outdoor and indoor temperature. HSPF2, used in the US under AHRI certification, is a seasonal average across a range of outdoor temperature bins, so it's generally a more honest figure for comparing cold-climate performance.
- How do I find a heat pump's cold-weather performance if it's not on the brochure?
- Ask your installer for the manufacturer's extended performance or capacity table, which usually lists COP and output at several outdoor temperatures down to well below freezing. This is standard technical documentation most manufacturers publish, even if it doesn't make the consumer brochure.
- Does AS/NZS 3823 guarantee cold-climate performance in Australia?
- It standardises how performance is tested and reported, but it doesn't force manufacturers to headline the coldest test point in their marketing. You may need to ask for the full test report rather than relying on the summary figure quoted in sales material.
Priya covers heat pump heating, cooling and hot water systems — sizing, running costs, and what actually changes between an Australian and a US install.
Mechanical engineering background; ex-HVAC design.
More from Priya Nathan
- The design temperature mistake that skews every heat pump quoteMost heat pump quotes size off the wrong outdoor temperature. Here's why design temperature, not average winter temp, decides if your system actually keeps up.
- The humidity myth that throws off heat pump cooling estimatesHeat pump cooling quotes focus on temperature drop, but humidity removal is the part that actually decides comfort and running cost.
- Why "heat pumps don't work in the cold" is the wrong myth to worry aboutHeat pumps do work in the cold. The real myth is believing minimum operating temperature is the number that matters for your install.
- Vetting a refrigerant handling licence before heat pump work startsBefore a heat pump installer touches refrigerant lines, check their handling licence. Here's what the card actually proves and what it doesn't.
- Why a return-on-investment number for a heat pump rarely survives real lifeMost heat pump payback calculations use one winter's gas price and a brochure COP. Here's why the real payback period almost never matches the quote.
- Vetting a ducted heat pump installer: the warranty registration trapMost heat pump warranties need the installer to register the system within days. Miss that step and the manufacturer owes you nothing.