A tankless water heater filter is fitted for one reason: the heat exchanger is a narrow coil heated hard and fast, and it is the place in your house where scale forms first and hurts most. A tank heater tolerates a layer of sediment on its floor for years. A tankless unit loses efficiency and eventually throws error codes when the same mineral coats the inside of its passages.
Scale is a hardness problem, so measure hardness first
The US Geological Survey defines hardness as dissolved calcium and magnesium expressed as calcium carbonate, and classifies water as soft at 0 to 60 mg/L, moderately hard at 61 to 120, hard at 121 to 180 and very hard above 180. Where you land decides everything. In genuinely soft water, a tankless unit needs no scale treatment at all and a simple sediment screen is enough. In hard and very hard water, scale is not a risk but a certainty, and most tankless manufacturers say so in their warranty terms. Test before spending, because a scale filter on soft water is money for nothing.
What the inline scale filters actually do
The cartridges sold as tankless scale filters are usually polyphosphate, which sequesters hardness so it stays in solution rather than plating out on hot surfaces, or a small bed of template assisted crystallization media, which converts hardness into suspended crystals that do not bond. Neither removes hardness. Both reduce the rate at which the exchanger fouls, both are modestly sized for the flow a tankless unit passes, and both are consumables that need replacing on schedule to keep working. They are a good, cheap insurance policy in moderately hard water and an inadequate one where hardness is severe.
When only a softener will do
In hard or very hard water, ion exchange is the answer that actually removes the calcium and magnesium, and it protects the tankless unit, the plumbing, the dishwasher and the fixtures at the same time. Many tankless manufacturers explicitly recommend softening above a stated hardness and may limit warranty coverage for scale damage without it. If you are treating the whole house anyway, the tankless heater stops being a special case and becomes just another appliance downstream. Our best water softener for tankless water heater guide covers sizing for the flow rates these heaters demand.
Sediment screens and the flush you still have to do
Separately from scale, tankless units are sensitive to debris, which is why most have a small inlet screen that needs periodic cleaning, and why a sediment filter ahead of the heater is sensible on a well or on old municipal pipework. Neither a filter nor a softener removes the need for the manufacturer's descaling flush, though soft water lengthens the interval considerably. Fitting isolation valves at the heater during installation is what makes that flush a thirty minute job instead of a plumbing project, and it is by far the cheapest thing on this page.
Questions people ask about tankless water heater filter
Does a tankless heater need a filter if my water is soft?
Not for scale. A sediment screen or filter still helps if you are on a well or old pipework, but scale treatment on soft water achieves nothing worth paying for.
Is an inline scale filter as good as a softener?
No. It slows scale formation but leaves the hardness in the water. In hard or very hard water a softener is the treatment that actually removes calcium and magnesium.
Will a scale filter void or protect my warranty?
Check the maker's terms. Many tankless warranties limit coverage for scale damage in hard water and specify softening or a scale prevention device above a stated hardness.
Do I still need to flush the heater?
Yes. Manufacturers specify a descaling flush regardless of treatment. Soft water lengthens the interval, and isolation valves at the heater make the job straightforward.