You do what is best and do not care what others speak of you:
"We hope that there will be said likewise of Us, those words which His enemies used of Our Divine Redeemer: 'We know that thou art a true speaker, and teachest the way of God in truth, neither carest thou for any man' [Matt. 22:16]."
-Ven. Pius XII (Miranda Prorsus, 25).