There is no fault in giving something a try. There is no fault in taking a chance on someone and marrying him or her.
There certainly, though, is fault in never trying and avoiding. There certainly, though, is fault in being afraid to fail so much that you don't ever take a chance.
You tried. So the shamers say you didn't try enough. So the random public might wonder if you quit. It doesn't matter. You know you tried. That's what matters.