If you are someone that lives in fear, I encourage you to pray and ask God to deliver you from it. The devil instills fear in people so that they don’t enjoy freedom and joy God want’s them to have.
Don’t think of what people might think of you. Their opinions doesn’t matter. God’s report about you does. (Read Isaiah 53:).

Remember that does hating you will give an account of their deeds on the Judgement Day. Pray that they see you the way God sees you.