I think another issue is that Tesla isn't seen as an innovator in the EV market or even the automotive industry as a whole anymore. There's also the production quality issues. Musk doesn't seem to be spending enough attention on solving even these issues over the years.
If the Tesla Semi-Trucks fail (and I think that they probably will fail after the initial orders are met) Tesla is going to have a serious problem if Musk remains at the helm and at least the big investors are probably thinking the same thing. It'll just be another Cybertruck fiasco.
I suppose it could also be argued that Musk tends to say things that may alienate his demographic while embracing those that are more likely to want to drive rolling coal modded trucks but I think that's just a smaller piece to the bigger problem. Another piece is probably that people are starting to see that he isn't some genius.
tldr;
The big problem, I think, is that people just don't trust Tesla and they don't want to pay a premium for shit quality EVs that have nothing to really write home about versus the competition and Musk just doesn't seem to be trying to put a lot of energy into solving that.