So I think we can say that the general consensus is that the anime is not canon, any scene that expand on a panel but are not present in the manga are also not canon. The only canon things are strictly what have been revealed already in the manga. However for panels that may have multiple or ambiguous meaning are clarified by the anime for example King bleeding from Marco's attack or Zoro attacking Apoo from the front instead of sneak attacking Apoo etc.