I still buy a fair amount of new vinyl from the usual internet outlets - Music Direct, Acoustic Sounds and Elusive Disc. I also have a co-worker who lives in the UK and he sends me an occasional "Care Package" of new vinyl. He sent me the new Kate Bush album about two months ago.
Here in Denver I have a friend who owns a used vinyl and book store called Black+Read. He has an assortment of new vinyl in most genres, but a much larger (say 25,000 units) assortment of used vinyl. I've found a few Columbia "six eyes", some RCA "shaded dogs" and even an original Mercury "Living Prsesence" there, all in very good shape. It's where I go to treasure hunt, and Danny (the owner) trys to give me a call whenever a particularly good looking collection comes in.
We also have a store called Wax Tracks and another called Twist & Shout, both of which have seperate storefronts carrying both new and used vinyl. They both cater more to the Rap/Hip-Hop/Trance/Electronic/House/Metal crowd, but I've also stumbled upon some good Alternative and Rock imports and domestic Jazz as well.
Yes, I have noticed the rising price of collectable originals. I attribute it to the fact that the format is continuing to enjoy an active resurgence; basic market demand. Makes me wish I was paying attention when I was about 10 and started collecting then!