How to stop cards showing when in priority? topic

So when I have my watch and phone in priority only, I keep getting cards that pop up on my 360. They go away when I set my phone to silent, or, "none." Is there any way to make it so I can put my watch and phone in priority (so I still get alarms) but it won't show cards? I don't want to uncheck show cards in the wear app, because I'd have to re-enable it when turning the volume back up. I don't want cards showing on the face when at work. I want it to just be a watch that i can swipe up to see cards. But when I leave work and the volume is turned up (tasker triggered by location) the cards will display on watch. Thanks for any help!