If a guy asks for you number how long should you wait for him to call ?

he came up to me , said i was the most beautiful girl in the world , then asked for my number . i told him i wasnt sure and told him to wait ( this was at work ) he waited so i gave it to him . he asked me when i was done with work and so on , then tried to kiss me , but i said no , but i did shake his hand , this was on thursday its saturday , should i give up ?