Lining a bag with foil won't make things worse, but it's not sufficient on it's own. Make sure your phone is put in airplane mode with all radios turned off, then turn the phone off. We don't fully know what kind of information snooping tools the security forces have right now so it's better to be paranoid/precautionary principle.