This guy wanted to "hangout" at a hotel, I declined. Was I being rude?

No it's not rude, if you didn't feel it was what you wanted, then you've done the right thing. Its harder to be different, but you don't want to be the same as everyone else, you made a good choice for you