Im just about to give up on him?

Don't give up but don't get your hopes up either, if you do feel he might like you, tell him how you feel and maybe he'll open up to how he feels about you. It sometimes is better to let people know how you feel about them. But be careful, if he doesn't return those feelings..your friendship might turn awkward.