Listen to your gut. ... and what everyone else said.
You can always go to his place at any time later down the line when a sense of trust and familiarity has been established. IF your gut feeling is telling you that it's not right, then it usually is so. If he respects you and is interested in establishing something serious, he will respect his boundaries. You should not feel pressured in any way to do what you don't want to do.
This is by far the most simple, practical thing one can or should do when meeting someone you are not familiar with:
SECURITY AT ALL TIME : Always leave his/her name and address and contact info off the site with someone who is likely to miss you, and get someone to ring you, to make sure you are ok on the date - Simple security for men and women.