I think 'having a life' is having a range of responsibilties and interests so if you display that, then having a life is not really in question. But, being into Buffy does somehow tend to put you outside the mainstream. There's a real Buffyist vibe you get off people who have never watched the show when you bring it up.
At the height of my obsession, around 18 months ago, I really couldn't help quoting from Buffy or telling the guys I work with all about it. Which was a problem because I'm a mechanic in a factory with whole bunch of blokey blokes as my main audience and that, and possibly the fact that I sometimes like to sing songs from The Sound of Music, I'm sure had them questioning my sexuallity if not the fact that I had no life. So I've eased off on the Buffy and I've always got an opinion on cricket, aussie rules football, movies and they know I play golf every weekend so I think I'm okay with them.
Still, I cop a ribbing when one of them will catch a look at the Buffy wallpaper on my mobile phone or inadvertently comment on Buffy. And I know now, that no matter what I say to them about how good it is or how hot the chicks are in it or whatever, none of them will ever give it chance. That knowledge is disappointing, but I have to keep reminding myself that its their loss and, even if they do think I have no life because I'm into Buffy/Angel, the most important thing is that I know my life is actually richer for it.