If a heat recovery system is designed correctly, with a correctly sized unit that matches the size of your house, it will not be noisy.
The most common reason I’ve come across for noisy systems is that there are not enough outlets to spread the air flow throughout the house. Another reason might be that the unit is undersized, meaning the machine has to work harder to hit the desired flow rates.
When a system is undersized, by the homeowner or the installer, it is usually to keep the costs down. But the cheapest is not always the best, and choosing a low budget machine may lead to long term problems.