As bloggers we're constantly putting ourselves “out there” as personal style bloggers we're putting our images out there, as fashion bloggers we're putting our opinions out there, it can get pretty personal sometimes. It puts us in a vulnerable place, open to judgement and criticism, even if we don't do anything wrong, someone can disagree.
The truth is, no matter what we do, people can or will judge. If we do nothing, we'd be judged for not taking enough chances, if we push the envelope we'd be judged for being controversial. If we conform we'd be judged for being to bland, and so forth.
So what does it matter what “other people” think? They'll think whatever they do anyway, so don't let their issues stop you from being who you are, and doing what you love.