You’re afraid that if you don’t say yes then the assignment will go to someone else. And it probably will. But you’re busy enough as is and this person won’t do as great a job as you.