took me a few days, but I finished installing the exterior door. Now, there is no cold air leaking through the door and it's made a difference in interior comfort.
After removing all the frame, I found out that i had to do some filling in of mortar (it'll also help to make the opening strong and stable)
Building a new threshold and frame, install the door, shim, and insulate.
Here are some pics.