I do not dismiss it but wouldn’t overestimate it either. Airplane mode is like “Incognito mode” in Chrome browser. It depends on provider’s definition of “privacy”. 

Physical switch, faraday bag, leaving your phone in other location provide better protection but they are not that convenient to use.