You’re turning an offhand comment into something it was never meant to be. Let it go.