need to remove this pesky soap holder

[nealtw]

We before I smashed the tile out, Some of those walls are interior walls. From the other side of the wall you can cut inspection holes, save the pieces for easy repair.
I would want to get a look at the area where the soap dish was and if you can get to the end where the plumbing is , down below the tub so you can see any wetness there and a good look at the floor below the tub.