How do you stop using references?

Its really annoying/discouraging when i cant draw anything but an eye without a reference, and always using references takes away from how accomplished i feel in my art, but i just cant think of something to put on the paper, or even if i can i just cant execute it. i also have that thing where i cant visualize ANYTHING in my head, so im sure that contributes. but if anyone has advice id kill to hear it