How do I control non-asp file access in ASP?

How do I limit access to control access to jpgs and pdfs in ASP.net?
I know I can put them in a folder that denies anonymous access, but then how do I allow some users to access them?
I want to allow some users to access them, but deny others. 
...