Do you remember Agni's words when he teleported Brilith with him in Season 2? Only people with absolute faith in him can be moved safely. Non-believers turn into a pile of ashes. Of course, Agni's insight would filter out non-believers who are likely to be incinerated.

Season 3 Episode 7 Afterword