A tankless water heater passes water across a narrow heat exchanger and raises its temperature very quickly, which is precisely the condition that makes hardness minerals drop out of solution and plate onto the metal. That is why a softener and a tankless heater are so often specified together: the softener removes the calcium and magnesium before they ever reach the exchanger, and the heater keeps its rated output.
Why tankless units are so sensitive to hardness
Hardness is dissolved calcium and magnesium, and the USGS classes water as soft at 0 to 60 mg/L as calcium carbonate, moderately hard from 61 to 120, hard from 121 to 180, and very hard above 180 mg/L. Scale forms fastest where water is hottest and the surface is smallest, and a tankless exchanger is both. As the deposit builds, heat transfer falls, the burner or element works longer for the same outlet temperature, flow through the narrow passages drops, and eventually the unit starts short cycling or throwing a temperature fault. A storage tank tolerates the same water for far longer because its heating surface is large and its sediment settles harmlessly to the bottom.
What softening actually changes
Ion exchange removes the hardness ions rather than merely suspending them, so there is nothing left to plate onto the exchanger. In practice that means descaling flushes become far less frequent, the heater holds its rated flow at temperature, and the manufacturer's warranty conditions on water quality are satisfied, which matters because many tankless warranties are explicit about hardness limits and about keeping the descaling records. Softening also helps everything else on the hot side: shower heads, mixer cartridges and the dishwasher all stop furring. It does not do anything about chlorine taste, sediment or iron, which need their own stages.
Plumbing the two together
The softener goes on the incoming cold main, upstream of the water heater, after any sediment filtration and after iron treatment if you have it. Take the outside taps and, if you prefer, a drinking water tap off the line before the softener so you are not softening irrigation water or adding sodium to the glass. Give the heater isolation valves with service ports so it can still be flushed, and leave a bypass around the softener so the house keeps water during salt or resin work. Sizing the softener from your hardness and household use matters more here than usual, because a unit that runs out of capacity mid-week is delivering hard water straight to the exchanger.
Salt-free conditioners and the honest trade
Some tankless manufacturers accept a scale-control conditioner in place of a softener, and template assisted crystallisation genuinely reduces scale formation without salt, a drain or electricity. The limitation is that the minerals remain in the water, so the protection is a reduction rather than an elimination and it degrades on very hard water or where iron is present. Check what your heater's warranty actually requires before choosing, because some documents specify softened water. Whichever route you take, keep flushing the heater on the schedule in the manual, and our guide to the best water softener for a tankless water heater covers matching capacity to a household.
Questions people ask about water softener with tankless water heater
Do I still need to flush a tankless heater if I have a softener?
Yes, though far less often. Manufacturers usually require periodic flushing regardless, and keeping the records can matter if you ever make a warranty claim.
Should the softener go before or after the water heater?
Before. It sits on the incoming cold main so both the hot and cold sides are softened and no hardness ever reaches the heat exchanger.
Does softened water damage a tankless heater?
No. Softened water is standard for tankless installations. The concern people raise is corrosion from very aggressive low-mineral water, which is a reverse osmosis question, not a softener one.
Will a salt-free conditioner satisfy the warranty?
Sometimes. Some manufacturers accept scale-control systems and others specify softened water, so read the warranty conditions for your model before deciding.