Water can pick up chemicals and a bad taste after it leaves a central distribution plant and travels through miles of pipes and then your own plumbing, according to Pauli Undesser, the Water Quality Association's technical director. For more extensive filtration, whole-house water filtering systems are available, Undesser says, and cost from $400 installed.