turning it off probably is good enough for most devices, but its easy to bump the button and turn it back on. DIY faraday bag is possible but not as trivial as it sounds. You'd want to test it carefully and make sure it wasn't getting signal in the bag, probably by doing things like calling it or locating it from a computer with "find my". There are probably more ways to test but that's a start