Agreed. They had great chemistry. It's interesting that during the memory loss, the ones Giles thought he had the closest connections to were Anya (ex-demon) and Spike (vampire).
They represented 'family' to him, while he didn't seem to have an intuitive relationship with any of the others.