So I spoke with my foundation guy and he clarified and said to get more soil, water it in and tamp down as much as possible, then get decomposed granite and fill in on top. No need to fill in the gap underneath the house, the piers were designed to hold everything up.