I have disabled it an now it's fine! What is also interesting that this is happening with two different laptops. The Sound Device btw is a USB DAC that is connected through the USB-C hub. Maybe this is what is causing the issues.
This issue is relatively new, what I am experiencing is "reaching" the USB DAC Sound Device is getting slower and slower. Maybe this is a driver issue in Windows.