Pfff feeling like a complete idiot, I fixed the issue.
After many days of failing to notice this small configuration issue it is fixed.
The problem was that somehow the:
* Default Order Status
* Error Order Status
Were the same status
Which let Adyen and Vendr believe that there was an error so it sends us to the error page.
Everything works perfectly the way it should..
Sorry for the inconvenience 😅