Not wanting to hurt someone is more problematic than being upfront. Be honest about where sentiments lie. It’s not like you’re saying something this person doesn’t already know.