Riviera Beach has started building a new water treatment facility to address past water contamination issues and improve water quality.