It wouldn't make any sense. Xander has never been what you would call fond of Angel, plus he'd rather be with his best friends, Willow & Buffy, wouldn't he? The only thing that might make Xander stay is Cordelia, assuming they could ever restart their relationship. Or perhaps he'd start lusting after Fred, 'cause...I mean, who wouldn't? 😉