Mamizou Youkai

these are all tanuki disguised as youkai, not actual youkai

the red one with white hair and claws: しょうけら (shokera) but it also heavily appears to be a random red youkai from the Hyakki Yagyo Emaki (see pic related)
the red one with a pot lid on its head: ナベブタ (nabebuta) from the Hyakki Yagyo Emaki (the youkai actually doesn't have a name but it's a pot lid (nanebuta) tsukumogami)
the fish-looking one: いそがし (isogashi)
the cyclops: 一つ目 (hitotsume) or 山童 (yamawaro) or a random one-eyed youkai from one of the many art pieces depicting a hyakki yagyo
the small gray one: ぬっぺふほう (nuppefuhou)
the white paper lantern: 提灯お化け (chouchin-obake), specifically お岩 (oiwa)
the scorpion-like one: 網切 (amikiri)
the wheel: 輪入道 (wanyudou)
the ape: 覚 (satori) or 狒々 (hihi) or a random ape-like youkau from one of the many art pieces depicting a hyakki yagyo
the small black one: 毛羽毛現 (keukegen)
the white ghost: 狂骨 (kyoukotsu)
two 鬼 (oni) but the more cat-like one could be a kasha (火車) or some unamed youkai from one of the many art pieces depicting a hyakki yagyo
the skull: 目競 (mekurabe)
the tree: 西行妖 (saigyou ayakashi) (the youkai cherry tree that yuyuko's body was buried near in the netherworld)
the blue-haired woman: 雪女 (yuki-onna)
the giant bug-like woman: 絡新婦 (jorougumo)
the man with the biwa (lute): 琵琶法師 (biwahoshi) but also a possible reference to the 琵琶牧々 (biwa-bokuboku) which appears in a lot of hyakki yagyo scrolls

then, obviously, the ones that mamizou uses in her attacks
umbrella: karakasa/kasa-obake/karakasakozo (からかさ小僧)
one-eyed lantern: chouchin-obake (提灯お化け)
well bucket: tsurube-otoshi (釣瓶落とし)
wall: nurikabe (塗壁)

aliens from the gachapon capsules
humanoid: gray (グレイ)
octopus: japanese martian/"kaseijin" (火星人)
robot: flatwoods monster (フラットウッズ モンスター)