This definitely sounds like you are on the right track. I’d like to help provide some suttas that you might find inspiring.
Brahmin, there’s a time when your heart is overcome and mired in sensual desire and you don’t truly understand the escape from sensual desire that has arisen. At that time you don’t truly know or see what is good for yourself, good for another, or good for both…
…Suppose there was a bowl of water that was mixed with dye such as red lac, turmeric, indigo, or rose madder. Even a person with clear eyes checking their own reflection wouldn’t truly know it or see it.
Linked Discourses 46.55
I like to keep in mind that we are trying to develop right view, and see things clearly for what they are. Sensual pleasures are not evil or anything, it’s just that they lead to suffering and so they are unskillful. We can’t see clearly when we are under the control of sensual desire.
A place where we get the similes to reflect on regarding sensual desire is here: MN54
I really recommend you check that out to help you reflect on the dangers of sensual desire and see in line with how the Buddha saw this.
I also recommend to view the whole sensory world as unreliable and suffering as one big idea, versus fighting individual desires one by one. Reflecting and understanding these similes will help.
Also, another sutta that describes seeing the whole sensory world as problematic is SN47.7
There are other similar suttas of course, but this one the Buddha tells us:
So, mendicants, don’t roam out of your own territory into the domain of others. If you roam out of your own territory into the domain of others, Māra will find a vulnerability and get hold of you.
And what is not a mendicant’s own territory but the domain of others? It’s the five kinds of sensual stimulation. What five? Sights known by the eye that are likable, desirable, agreeable, pleasant, sensual, and arousing. Sounds known by the ear … Smells known by the nose … Tastes known by the tongue … Touches known by the body that are likable, desirable, agreeable, pleasant, sensual, and arousing. This is not a mendicant’s own territory but the domain of others.
You should roam inside your own territory, the domain of your fathers. If you roam inside your own territory, the domain of your fathers, Māra won’t find a vulnerability or get hold of you.
And what is a mendicant’s own territory, the domain of the fathers? It’s the four kinds of mindfulness meditation. What four? It’s when a mendicant meditates by observing an aspect of the body—keen, aware, and mindful, rid of covetousness and displeasure for the world. They meditate observing an aspect of feelings … mind … principles—keen, aware, and mindful, rid of covetousness and displeasure for the world. This is a mendicant’s own territory, the domain of the fathers.
Another last point to add is that we can’t just let go of the sensory world and sensual pleasure without gaining anything. Nobody can do that because as humans we will always want pleasure and happiness. We must also enjoy and take pleasure in the spiritual path, in meditation and in generosity etc.
So be careful with making sure to gradually move over onto the spiritual happiness of meditation and at the same time let go of the worldly happiness. It takes time but it should be done though wisdom and reflection.
I hope that helps!