I did install the driver from AMDs website but otherwise I’m pretty much at a loss.
thats actually your first issue, don't do that if you want to use it for gaming
the amd driver included in your linux kernel out of the box is already the best option for gaming
anyway checkout https://gitlab.com/corectrl/corectrl
which allows you to restrain the power usage (which is probably your issue?) and/or underclock the GPU
you can run Corectrl at boot so it automatically applies its settings