He's holding on to you... but keeping you at a distance... holding you at a distance... right in a very specific spot. With all of these specifics it would seem that he as lot of constraints in his life in which he is meandering you through.
Maybe he is in a committed relationship, or maybe he is just awful with time management... either way, neither of these are qualities you want in a guy. A cheater or a guy with no sense of priorities and time management will do you no good.
You can give him more time if you want... or you can save time and bail out now. This guy is going in circles... and taking you nowhere.
"The weakest soul, knowing its own weakness, and believing this truth that strength can only be developed by effort and practice, will, thus believing, at once begin to exert itself, and, adding effort to effort, patience to patience, and strength to strength, will never cease to develop, and will at last grow divinely strong."
- James Allen