'It was the women who stayed'