He invited me over for sex? What should I do?

Ew! Don't lower your standards for some pervert. Please, just simply ignore this guy. If he starts to harass you, threaten him with the police. You can also block his number, delete him as a Facebook friend, etc.