Thanks for the advice! I poked the holes. Between 5 and 8 inches deep. I did not hit anything that felt like a pipe, more like sand/cement, so now I am more confident that they do not have an important function.
I am pretty sure it has not been a bathroom, there is a full wall original...