Meh, get used to it. If you're draining everyone's wages for your security service (that you're not even required by law to provide) then those people are going to have an opinion on your performance and be angry when you don't live up to their expectations.