So to answer your title question: there is a difference for you, but not for the people that the gay culture has had to fight against, in order for you to be free to define yourself the way you see fit on "the spectrum".
Just be aware that if all gay men were like you, you would probably not be able to fully enjoy the human rights you enjoy today. You might even be under the threat of prosecution, that could only be avoided by "not being visible, ever", in other words you would be forced in a closet with the permanent risk of prosecution on a whim.
The sexual minority you belong to is only closer to full social equality thanks to its "visible" gay section. One might argue that visible section is the cause of persecution. One would be badly wrong!
Otherwise, the difference is purely semantic and can never be permanently established.
I still think it is good for you if you have been able to crystallize your identity around that dialectic differentiation. I also think that when things have settled and you have matured, you may wonder why it ever mattered to you in the first place, why you prefer a clinical term to a more socially and historically significant one.
In the meantime, as long as you dot try to convert others or enforce that distinction as being absolute or even meaningful, I can only wish you a happy life.