But not in the physical sense. In terms of fighting power, only Loki familia could cause them problems. It's the structure of the familia itself that seems weak.
Freya familia as a whole seems like a house of cards ready to collapse. None of the executives actually like each other. The glue that binds them together is Freya, but as she becomes more and more mortal-like, the glue weakens.
The one who understands Freya the most - Helun - tried to kill Bell because of how much his presence was changing Freya. If Freya changes too much (in a way they find unfavorable), what reason do they have to continue worshipping her? And if they don't worship her, what's even holding the familia together?
We've seen some hints that Ottar finds Freya's decisions questionable. If Allen and Anya manage to talk, Freya may become much less important in his life. Hedin's and Hogni's mindsets are unclear; it's fitting that they're on the cover.
Ultimately, just give Freya a slight push towards being even more mortal-like and they'll fall apart of their own free will.