This can happen for example when using Roon, Audirvana or any other popular music/media library applications. Most probably this can be fixed by experimenting with the "Audio buffer size" in the Dirac Processor's "Audio Settings".
Some applications would prefer a larger buffer size, and some would prefer a smaller buffer size. Try to set it to anywhere between 64 samples to 2048 samples while playing audio and listen for any changes.