In Southern NZ, there are hundreds of back country huts scattered throughout the glacial valleys. These guys cost about $35/night with running water and bunk beds. "Tramping" or backpacking in New Zealand is a must.