GRANDPA will surely have stern words for you if he catches you without your trusty RIFLE at the ready. That's just what you need, another one of his blustering mustachioed diatribes. You are rolling your eyes in advance, getting them warmed up.
But ideally you can evade him altogether. All you have to do is get past the FIREPLACE and out the front door, and you will be scot-free.