If you are creating this paver patio from concrete pavers, chances are you are noticing a byproduct of concrete called effloresence. If they are brick then it could effloresence being released from the concrete under the brick. I would use an effloresence cleaner first and if that doesn't work...