If you are creating this
paver patio from concrete pavers, chances are you are noticing a byproduct of concrete called effloresence. If they are brick then it could effloresence being released from the concrete under the brick. I would use an effloresence cleaner first and if that doesn't work you might try muratic acid, just be sure to do a small test area first.