Elite club that rules the diamond world is starting to crack