Hybrid materials combining gold nanoparticles (GNP) of variable diameter and an organic thin layer of photochromic diarylethenes were achieved. Solid-state photoswitching based on ring-closure/ring-opening reaction was carried out under alternate UV and visible irradiations. In addition to the spectral changes due to the photochromism itself, the surface plasmon resonance related to the GNP is significantly modified, influenced by a photoinduced change in the refractive index of its environment. These two contributions were sorted out, showing the possibility of probing a photochromic switch by following the plasmon band. The shape change of the plasmon band was consistently compared to calculations based on the Mie theory. Additionally, with one given diarylethene compound, both UV-visible spectroscopy and surface enhanced Raman scattering (SERS) spectroscopy showed an acceleration of the ring-opening photochromic reaction in the presence of GNP.