Pairing a tankless water heater with a water softener is one of the few upgrades that directly protects another appliance. Tankless units push all incoming water through a narrow heat exchanger, and dissolved calcium and magnesium bake onto those hot surfaces as scale. A softener removes that hardness before it reaches the heater, which keeps the exchanger clean, holds flow steady, and satisfies the maintenance expectations most tankless manufacturers write into their warranty terms.
Why tankless units suffer more from hard water than tank heaters
A tank heater has a large volume of standing water and a lot of surface area, so scale builds slowly and mostly settles as sediment at the bottom. A tankless unit is the opposite: every drop of water passes through tight copper or stainless passages that run hot on demand. Scale forms exactly where the heat transfer happens, so even a thin layer cuts efficiency, narrows the waterways, and trips error codes for overheating or low flow. The USGS defines hardness as dissolved calcium and magnesium, and it is precisely those minerals that come out of solution when water is heated quickly. That is why tankless manufacturers push descaling flushes on hard water, and why many installers refuse to warrant performance without treatment upstream.
Where the softener goes in the line
The softener treats the whole house, so it sits on the main line after the pressure tank or meter, before any branch feeds the tankless heater. Order matters: a sediment prefilter first if your water carries grit, then the softener, then the heater downstream receives softened water only. Keep the softener drain line unrestricted and leave service clearance around both units. If the heater already has scale inside, install the softener and then run a descaling flush on the heater so you start from a clean exchanger rather than locking existing scale in place.
What changes in maintenance once the pair is running
With softened water feeding the heater, the descaling flush interval stretches out dramatically, and many owners find the flush water comes out clean when they do run it. Your new routine centers on the softener instead: keep salt in the brine tank, check that regeneration is actually happening, and confirm soft water at a tap now and then with a simple hardness test strip. Sizing matters too, because a tankless unit can draw a high flow rate when multiple fixtures run, so pick a softener rated for your peak household flow rather than the smallest tank that fits. Our best water softener for tankless water heater comparison walks through models sized for exactly this job.
Questions people ask about tankless water heater with water softener
Does a tankless water heater require a water softener?
Not legally, but on hard water most manufacturers expect scale control, and some warranty terms reference water quality. A softener is the most reliable way to meet that expectation and avoid frequent descaling flushes.
Does the softener go before or after the tankless heater?
Before, always. The softener sits on the main line so the heater receives already softened water. Softening after the heater would leave the heat exchanger exposed to full hardness.
Will softened water damage a tankless water heater?
No. Softened water is standard supply water with the calcium and magnesium exchanged out. Heat exchangers tolerate it well, and the absence of scale is what preserves efficiency and flow.
Can I skip the softener and just flush the heater with vinegar?
You can, but on genuinely hard water you will be flushing often and the scale still forms between flushes. A softener prevents the deposit instead of dissolving it after the damage starts.