I think it all depends. If you tend to get fat when bulking, it could be a great tool to stay leaner and to increase appetite. If you have a fast metabolism and have a hard time gaining muscle, it may hold you back. But the only way to know what works for you is to try. Bodybuilding is one big experiment and everyone is different. I can get a guy ripped using my methods, but someone else can get that guy ripped using a totally different plan. I encourage that everyone here at the QA dares to get creative. Spend time learning from me and others that have been around, and then figure out how that knowledge applies to you. Science is a big part of bodybuilding, but the truly passionate guys are artist. They use scince to create their vision. So think outside of the box. I used to train arms for 8-12 reps. My biceps grew and my tri's did not. So I tried increasing the reps. I went to 16 reps and started to see improvement. I added more and saw better gains yet. Now I know, my triceps will blow up, when I work them in the 16-24 rep range. When I figured that out, it was far from the standard "8-12 reps" that I had been told to do. 

So I know I've gone off on a tangent here, but you get the point. It sounds like you like the way it is making you feel. There is something to that. Listen to your body but remember that science does come into play. There is going to be a limit at which fasted cadio would effect your gains, but you may be able to find a sweet spot, doing just enough to get a positive benefit while still making great gains. 

BTW, great question. I'd like to see more of these exercise and workout questions (hint hint guys haha!)