Some wisdom that came to me while watching the Rocky Horror Picture Show...
It's OK to create something that's outside the norm. That's wierd. That's not for everyone.
It's also OK to tell someone, "That's OK, maybe this isn't for you."
What's not ok is to water down the weird so that it appeals to a wider audience. You're letting the faithful down when you do that.
You don't need everyone to like what you do, you only need the ones that get it.