The trouble here is who does the deciding, and where they are coming from, the devil as usual, is in the details. I know of one case where *adult* protective services was as guilty of malfeasance as any CPS has been - tossed a woman out of her home, and displaced (out of a job) the man who was living there (a distant relative, a good guy, and personal friend) who was taking care of her - the trigger? Her own frigging kids who wanted her declared incompetant so they could inherit her home and money - she was paying my friend pizza money and a room, he was taking good care of her - we talked frequently on G+ vid chats and she was fine and not incompetent - but kids with a lawyer and a paid doctor...
As far as kids go, I kinda was involved as a substitute parent for a couple of kids whose parents were pretty "out there" - one just a slob, the other a health-freak of the worst kind (eating nothing is better, eating stupid stuff to flush you out is good, and so on). You know what? They are grown now and are just fine, though one parent, the slob, wound up cooking meth and more or less killed himself with his own product (the man), while the woman, finally freed to live her dream, did kill herself with her weird ideas of nutrition. Kids are fine. You could have made a great case for CPS to take them, and what I've seen of that - the new "parents" ruin any kid with initiative who is a little wild.
I've also seen CPS take kids because of a fairly normal party behavior by parents. We all know drug users who merely chip away and do no harm, and those who are just doing the slow (or fast) suicide thing - I think we take kids from the latter, but sure as hell not the former, heck, they are practically a majority. The way it's going, if you smoke tobacco, they'll take your kids, that's totally, utterly, out of line with any idea of freedom, and I really object to that sort of thing. It's fucking none of their business. I do NOT believe in forcing everyone into a mold - diversity is a GOOD THING (tm). We don't know what new challenges the next generations will face, therefore it's merely our vanity that says we know best how to prepare them for the mess we've made, and the next messes.
Kids are in fact very resilient and adaptive. I say let them, they'll need the practice going forward.