I ran into the same situation on multiple occassions in my backyard.
I found that the rock was concrete from an old fence post that had been relocated.
There are (2) ways that I know of to get them out.
1. The Easy Way
Rent a Jack Hammer from your local tool rental center.
This will...