Tankless water heaters are unusually sensitive to hard water, and the reason is physical. Instead of heating a large volume slowly, they push water through a narrow heat exchanger and raise its temperature quickly, which is exactly the condition that drops hardness minerals out of solution onto the hottest surfaces. Protecting one is mostly a hardness question, with a sediment question attached.
Why tankless units scale so readily
Scale forms where water is hottest and where it changes temperature fastest. A tankless heat exchanger is a small passage with a high surface temperature and a rapid rise, so deposits build on the walls of the passage rather than settling in the bottom of a tank where they can be flushed out. As the layer thickens it insulates the exchanger, forcing higher firing to hit the set temperature, and it narrows the passage so flow drops. Manufacturers often make the warranty conditional on water hardness for exactly this reason.
Sediment filtration is necessary but not sufficient
A sediment filter ahead of the heater protects it from grit, rust flakes and pipe debris, all of which score the exchanger and block the inlet screen. On well water and on older municipal plumbing it is worth fitting regardless. But sediment filtration does nothing about dissolved hardness, and hardness is the reason tankless units fail early. A household fitting a sediment cartridge and believing the heater is protected has treated the smaller problem. Check the inlet screen at the same time, since many units have one and it silts up quietly.
What actually stops scale
The USGS classifies hardness as dissolved calcium and magnesium, with soft water at 0 to 60 mg/L as calcium carbonate, moderately hard 61 to 120, hard 121 to 180 and very hard above 180. In the hard bands, an ion exchange softener is the reliable answer: it removes the minerals, so there is nothing to deposit. Scale inhibitors and template assisted crystallization units are the alternative where a softener is impractical, and work by preventing crystals sticking rather than by removing hardness. Carbon filters and sediment filters do neither.
Descaling, and the maintenance the manual assumes
Even a protected unit is designed to be flushed periodically with a descaling solution through the service valves, which is why those valves exist and why they should be fitted at installation rather than added later. On hard water without softening, that flush becomes a frequent chore and the exchanger is losing efficiency between them. On softened water it becomes an occasional formality. Our tankless softener guide covers sizing a softener for a tankless installation and what the heater manufacturers actually ask for in the warranty conditions.
Questions people ask about filter for tankless water heater
Will a sediment filter stop scale in a tankless heater?
No. It stops grit and debris, which matters, but scale comes from dissolved hardness minerals that pass straight through any sediment cartridge.
Do tankless manufacturers require softened water?
Many make warranty coverage conditional on water hardness or on documented descaling, so it is worth reading the conditions before choosing treatment.
Are scale inhibitors as good as a softener?
They reduce scale adhesion rather than removing hardness. On very hard water a softener is the more reliable protection, though inhibitors suit installations where a softener will not fit.
How often should a tankless unit be flushed?
On the manufacturer's schedule, which shortens sharply as hardness rises. Softened water pushes the interval out; very hard water pulls it in.