It's a bug with Lemmy that I had hoped would be resolved with this version, but still hasn't been. Sessions don't terminate properly for some folk.
The work arounds that people have had (inconsistent) luck with include using a different browser, using incognito mode and clearing all site based cookies.
Until it's fixed though, there doesn't appear to be a completely reliable solution.