Colleagues say you’re being too critical, but you may have good reason given their underwhelming performance.