As long as you had good drainage and ventilation, it would be pretty much okay.
A lot of old-timey root cellars were just holes cut into hillsides and lined with bricks or boards.
Plus there's the added advantage of being able to suddenly jump out and scare the crap out of passers-by.
