in short: we tried to fix a Lemmy issue that started on 9/13 and is causing or has caused problems with apps for the software. we're aware of basically all of them besides Sync exhibiting some sort of problematic behavior since this issue arose. however: attempting to fix this issue on our side of things did not go well.

i am not qualified to make a formal write-up of the exact mechanism of what went wrong here--and in this case the mechanism isn't really important for your informational purposes, although @Penguincoder@beehaw.org can elaborate as needed--but basically we made a fix that seemed fine in testing and was not fine when actually applied. when it became obvious something was wrong, we tried restoring literally everything but the database. that, unfortunately, did not work, so eventually we just pulled the trigger on restoring from a backup. this has lost at least some posts, but probably no more than 8 hours of them by our estimation.

hopefully this will not happen again, either upstream or on our side of things.

you are viewing a single comment's thread
view the rest of the comments

[–] realChem 9 points 1 year ago (2 children)

Did the fix end up working in the end, or did restoring everything from backups mean that the fix didn't work out either? (I don't use Jerboa or any other lemmy apps, so mainly just curious.)

[–] alyaza 11 points 1 year ago* (last edited 1 year ago)

still broken; any changes in app functionality would be from apps patching the issue.

[–] Penguincoder 11 points 1 year ago

This was the initially issue I was trying to fix; apps not loading. Tracked it down to the timezone handling of lemmy. The 'fix' (upgrading to upstream lemmy code) didn't work, and broke a lot else.