It sounds like you might be experiencing the affects of frost heave. Also, if you have expansive soils it will make that issue worse.
You can certainly use the method you described, but the fix might be short-lived. A more permanent option would be to remove the existing posts and concrete...