That is true. I do this. After physical intimacy, you always want to be touch or having that person around when the emotional connection remains.
I left one night after a casual hookup because I really didn't want to sleep next to someone, I wanted to be alone. It was a mistake I made and I didn't understand it before. Now I do.
I think one thing that I do is I hold you closer and I might press my lips against your neck and kiss you. I've done this in my past relationships.