So I went down into the inconspicuous cellar today. It looks a bit different to the last time I was down there; it was in complete chaos.
It looks like there are still chunks excavated to the first level, whereas other sections go down at least 20 blocks, such as the crater in the middle. There was also a big slime down there, so it looks like we're building on a slime chunk.