The water softener tankless water heater question comes down to one component: the heat exchanger. A tankless unit heats a thin stream of water across a hot metal surface on demand, and that combination of high surface temperature and narrow passages is the ideal condition for hardness minerals to drop out of solution and cement themselves in place.
Why a tankless heater is unusually sensitive to hardness
Calcium carbonate becomes less soluble as water gets hotter, so it precipitates preferentially on the hottest surfaces. In a storage tank that means a slow crust on the bottom that steals efficiency. In a tankless unit it means scale forming inside narrow exchanger passages that are sized for a specific flow. The passage narrows, the burner has to work the water harder to hit its setpoint, the surface gets hotter still, and the deposition accelerates. That feedback loop is why manufacturers write water-quality expectations into their manuals and why scale is the leading cause of premature tankless failure.
Test the hardness before you decide anything
The decision is quantitative and cheap to inform. USGS classifies hardness by dissolved calcium and magnesium: soft is 0 to 60 mg/L as calcium carbonate, moderately hard is 61 to 120, hard is 121 to 180, and very hard is above 180 mg/L. Homes in the soft and moderately hard bands generally do not need a softener to protect a tankless unit, and periodic flushing is enough. In the hard and very hard bands the economics reverse quickly, because the softener costs less than the exchanger it is protecting. Run a drop titration test or pull the number from our home water testing guide before pricing equipment.
Salt-based softening versus conditioning
A salt-based ion exchange softener removes calcium and magnesium from the water, so there is nothing left to deposit anywhere downstream. A salt-free conditioner, usually template-assisted crystallization, leaves the minerals in the water but converts them into microscopic crystals that are far less inclined to stick to hot surfaces. Conditioners suit households that cannot discharge brine, have no drain near the entry point, or want no salt in the softened water. Where the water is very hard and the tankless unit is the main asset being protected, most installers still specify true softening.
Sizing the softener to the heater, not just the house
Softener sizing is normally driven by hardness times daily household water use, but a tankless heater adds a second constraint: peak flow. Tankless units are specified by the flow they can raise through a given temperature rise, and if the softener chokes the flow at that peak you get lukewarm showers and a heater blamed for a plumbing problem. Check the softener's service flow rating against the heater's maximum rated flow, size up rather than down where they are close, and make sure the bypass valve and the connecting pipework are not narrower than the rest of the run.
Softening does not retire the flush schedule
Even on softened water, a tankless heater accumulates a film over years, and every manufacturer still specifies a periodic descaling flush as a warranty condition. Softening extends the interval and makes each flush trivial rather than a rescue operation, but skipping it entirely is how people void coverage. Fit isolation valves with service ports on the hot and cold connections when the heater goes in. They cost very little at installation, they make the annual flush a thirty-minute job with a pump and a bucket, and retrofitting them later means cutting pipe.
Questions people ask about water softener tankless water heater
Does a tankless water heater require a water softener?
Not universally. Manufacturers set water-quality expectations rather than a blanket requirement, and on soft to moderately hard water regular flushing is usually enough. On hard and very hard water a softener is the cheaper way to protect the exchanger.
Will a salt-free conditioner protect a tankless heater?
It reduces the tendency of hardness minerals to bond to hot surfaces rather than removing them. That helps, but it does not deliver soft water, and on very hard supplies most installers still specify ion exchange.
Can softened water damage a tankless heater?
Correctly set up softening does not harm a modern exchanger. Problems come from a softener regenerating badly and passing slugs of brine, so set the salt dose and regeneration correctly and check the setup after commissioning.
Where does the softener go relative to the heater?
Upstream of it, on the main line after the meter or pressure tank, so both hot and cold sides of the house receive treated water and the exchanger never sees raw hardness.