SHOULD I ASK HIM OUT?HELP PLEASE!?

I had a boyfriend and while i was taken,i traversed HIM by all means that it was at least rude.I have strong moral principles,that's why i did that and now i know i was wrong,i shouldn't push away person like him...U know,i am a girl,everybody knew i have a boyfriend,they know he likes me,bla bla bla. Now i am single.In some way,i am sure that he likes me,it is kinda obvious for itself for more than a half year now...I caught him staring at me when i bite my lips,he defended me at work for a few times,a few days ago he was on a drink with his guy friends when he saw me he had this stoned face,kinda scared,and when i came closer he smiled so that i could saw all his 32 teeth,i could tell by his friends,our colleagues,his gaze...It really is obvious.3 days ago he gave me his phone number and said:"Okay,so u have my phone number,talk to u soon".The thing is that i gave him my phone number first,it's been a few days and when i asked him what does he think about it,he gave me his phone number!What does it mean?May it be that he doesn't want to give up easy,because i gave him some really hard time and i always start from myself,i would probably do the same...Could i at least ask him for a coffee or not?I am so confused,HELP!