How can I tell if my apartments walls are concrete or drywall?

I can drill into them with a standard screw pretty easily after hammering them just a bit to get them started. I'm uming since I don't need a masonry bit these must be drywall but I want to be sure.