If you're looking for a deep philosophical answer, I'm probably not the one to give it to you. I'm just going to speak from my own experience and maybe it will help. I believe that there is a Higher Power and that He wants us to choose to cling to Him, but it's not something that comes easy. I've been fighting this for close to ten years now. When it all started I was too young to even know what it was or that it was wrong. Then in the past ten years there were two periods that it seemed like all my problems slipped away. I fell in love with two girls (a few years apart when I was in the dating scene ready to get married) and they both inspired me to be better. Things didn't work out with both of them for specific reasons and it was so tough. Not only was it tough because I lost two people I loved, but it was also tough because I got lonely and slipped right back to where I was. But looking back I know Hashem had a plan for me. It's true I was sulking over losing these girls for a long time (One broke up with me and the other I broke up with), and I mean a really long time. I felt like I could never be the person I wanted to be. But looking back, I see how much I have grown in the past few years because I had to deal with the heart ache. I became a more sensitive person to others. I became more spiritual. Most importantly, I started to deal with the fact that I can be a good person and an Eved Hashem without someone attached to me. I would love to get married, but I had to learn to be comfortable with who I was, and going through all that helped me.
I don't know if telling you all this is going to help you, but for me, I try to look back at things that really seemed bad at the time they happened (probably better that a good amount of time has lapsed already), and think about ways I've changed or things I had to learn, and tell myself that's what Hashem wanted from me. So you're right, things may look bad now, but there is a reason we're all here. We're the soldiers and we are put in this battle, because we can win. Hashem wouldn't give us a challenge that we could not win Once you get in the habit of looking back for something you've learned, every challenge you face will inspire you to look for a hidden lesson.
Like I said, I was just speaking from my own experience. It works for me. If it helps you, then great. But I'm also aware that not everyone has to work the same way, so if it doesn't, don't give up, and come back, avoid my comments, and get some inspiration from people who know how to give it.