I am not so sure. Look at what it really requires to have a complete and pure refuge, it is not such an easy thing. Many senior monks in India told me they still didn't fully understand the various presentations of the qualities and functions of the triple gem as explained in the texts and so found their practice of refuge lacking. Some were very well cultivated scholars. Faith in the triple gem is one (important) thing, but a full practice of refuge requires an understanding of the Triple Gem, and for example how many people know the different bodies of a Buddha and their function, the three baskets of the teachings (dharma jewel) really well, and the various levels of Arya Sangha?
In the biographies of great lamas you read about spirit obstacles with some regularity. Lama Tzongkhapa in his writings on Yamantaka speaks of the need of this sort of deity to pacify both the inner, mental obstacles as well as the outer obstacles of hindering spirits. These rituals within the Yamantaka corpus are practiced by many Gelug lamas of high realization.
In order to ensure my mind never comes under the power of the self-cherishing attitude,
I must obtain control over my own mind.
Therefore, amongst all empowerments, the empowerment that gives me control over my mind is the best,
and I have received the most profound empowerment with this teaching.
brtsal ba'i bkhra drin