Armor, even the mage's robe, can mean the difference between surviving combat and game over. Armor gives useful defensive stats, as well as other bonuses like Water Breathing or foritfying a skill.