Sounds like this is causing you anxiety, if he isn't at the same level of desire to communicate that will make things hard for you. I'd recommend keeping an ear open but to move on and see if you can find someone else