Edit: 2014-02-03 Most of these providers are no longer, but I'll keep this table here for reference.
I was in the neighborhood in buying VPS but I wanted something under $10 a month. Anyway, here are some choices for VPS's under $10/month (all in USD).