Durant never formed the bond with the Warriors that he was hoping for