Records and CDs
Victoria is home to some really quality record stores, man. Seriously, if you're down with vinyl (DJ or just acute listener), there is a great selection. All these shops have CDs, too. So I mean, you really should hook yourself and your friends up with decent record players, but if you're a Discman kid, you're still allowed to have fun in these shops. Nobody will, you know, make faces or anything.
Ditch
A local favourite, seriously, they have everything. It's hard to fathom how they could fit pretty much whatever you'd like to listen to from almost every genre (well, except modern pop, modern rock and Top-40, naturally), into such a nicely-sized shop. Not too small, not too big. Their selection is pretty evenly split between records and CDs. This is where you'll end up getting tickets to and finding out about the city's coolest rock events: anything that involves singing, songwriting, twangy guitars, old drum kits, big amps etc. This is where you'll get info about it. Talk to the staff. Be like "Hey I really like _____, what other record should I check out? Any cool shows happening soon?" They'll know. Heck, they'll be going themselves! 
635 Johnson Street (map) 250-386-5874
Lyle's Place
This compact place have one week rentals DVD's, low prices for used CDs, over 1,200 different posters and they also promise to buy your used CDs and DVDs for the best prices in town! Note: they have T-shirts with the shop’s cool logo on them, sweet.
770 Yates Street (map) 250-382-8422
Old Town Strings
These guys buy, sell and repair guitars, banjos, mandolins, violins and folk instruments. They stock accessories, strings and bows, music, books and videos. They have music lessons and individual instruction for guitar, fiddle, bluegrass banjo, mandolin, pennywhistle and Irish flute. What more could a musician ask for?
1034 Hillside Avenue (map) 250-383-3413
The Turntable
Now let's rewind to 1970. Mom's away for the weekend, and you and your dad are toking up in the garage, rocking out to the best rock n roll ever on Dad's old record player. When your dad got a white-collar job, stopped smoking pot and sold his record collection, it ended up at The Turntable. Now you have the chance to buy all that awesome vinyl back!
The Turntable has the most rockin' collection of rock, pop, funk, jazz, singer-songwriter stuff, folk, even vintage electronica... and the staff is great. They know where it's at.
#107-3 Fan Tan Alley (map) 250-382-5543
