The most efficient heat pump you can buy trades heat with the ground instead of the air, and the ground barely changes temperature between January and July. That stability is the entire pitch.
Every air-source heat pump's efficiency rises and falls with the outdoor temperature, because it's trading heat with air that swings from 20°F to 95°F over a year. A ground-source, or geothermal, heat pump instead runs its refrigerant loop against a buried loop of pipe sitting a few feet to a few hundred feet underground, where the ground stays somewhere around 50–55°F year-round almost everywhere in the continental US. Trading heat with a 50°F source in January and a 50°F source in July, instead of 20°F and 95°F air, is why these systems post the highest efficiency numbers in residential HVAC.
The buried piping is called the ground loop, and it comes in a few configurations. A horizontal closed loop is trenched a few feet down and needs the most land, cheapest to install per foot. A vertical closed loop is drilled, like a narrow well, one hundred to four hundred feet down, and is the answer for a smaller lot. An open loop draws groundwater directly from a well and returns it to another well or a pond, which is efficient where water rights and geology allow it but isn't an option everywhere.
Which configuration you can use is decided by your lot size, your local geology, and sometimes a well permit, before anyone talks about the equipment itself. That's the first call to make, not the last.
The heat pump unit itself, the part that sits in a mechanical closet, isn't dramatically more expensive than a high-end air-source system. What drives a geothermal install to $20,000–$40,000 or more is the excavation or drilling for the loop field, which is priced by the foot and depends entirely on your soil, rock, and available land. Two houses on the same street can get meaningfully different quotes because one sits on easy-digging soil and the other on bedrock.
The math favors people who plan to own the house for a long time, have the land for a horizontal loop or don't mind the drilling cost of a vertical one, and are building new or already tearing up the yard for another reason, since installing the loop field during construction or a major landscaping project avoids paying twice for the disruption. A twenty-plus-year time horizon is where the higher upfront cost and the lower running cost actually cross over.
It's also, quietly, the quietest option: there's no outdoor condenser fan blowing air across a hot or cold coil, since that heat exchange happens underground. For a small lot where the neighbor's window is ten feet from where a condenser would go, that's a real, if secondary, reason to look at it.
A geothermal heat pump still needs a correct Manual J load calculation, correct ductwork, and correct refrigerant charge on the indoor side, exactly like an air-source system. The ground loop solves the outdoor-side efficiency problem; it does nothing about an oversized, short-cycling indoor unit or leaky ducts. Don't let a genuinely impressive loop-field installation distract from checking the ordinary things that make any heat pump perform well.
