It seems like they are down for a longer time now. How will they recover? Does longer down mean they will have to do more catching up with other instances? Can I get updates somewhere?
It’s weird being part of broad communities like technology or games again. On reddit I unsubbed all the default subs and subscribed to more niche things like 3D printing or weird games. It’s quite a change to see people talking about things like mainstream AAA games. Intellectually I knew that a lot of people had to get hyped about the latest Bethesda game or Apple products or whatever, but I think part of me stopped believing it, because it still surprises me whenever I see it.
I also can’t stand all these fuckin’ normies. 🙃
Not sure where they host but AWS is currently in the middle of a pretty big outage so it could be related.
After doing a WHOIS, it appears that Lemmy.ml is hosted on OVHCloud.
Edit:
As follow up on that, OVH cloud does appear to be doing some maintenance on their infrastructure: https://www.status-ovhcloud.com/
In short, yes it will take longer to “catch up”.
The longer answer, be patient. This is an issue that will be resolved. I’m sure that the admins are doing their best to get the instance up & running ASAP.
From my experience during the great Twitter migration to Mastodon, you saw the same thing. Especially the “main instance(s)”, mastodon.online and mastodon.social in this case, were overloaded to the brim. After a day or two, the sysadmins and developers were able to stabilize the instance.
The sysadmins in this case were responsible to keep the servers up and running (and scale up where needed). The developers because their code hasn’t been “battle tested” for this level of interaction. So changes were needed, to optimize and squash bugs.
I hope this helps 😊
Edit: fat fingers, ie fixed typo
This is a fantastic point. I watched several migration waves from Twitter to the Mastodon/*oma/*key network over the course of Nov-Feb and each became less impactful as instances and developers understood better how that traffic would flow. Consider also that those platforms had also been around for a few years already.
Lemmy and kbin are very, very young still, so it will be great to see them develop over the course of the coming months. I expect the next couple weeks leading to the June 30 3PA closures on Reddit will be spent preparing for another wave.
Oh definitely that the next couple of weeks will be spent preparing for a new wave. I wouldn’t be surprised if that was the reason why Lemmy.ml was down. Yes I know that it was because of a server migration but, that server migration also didn’t happen for no reason ;-)
The first migration wave to Mastodon was very bad. I still remember, that following a person was nearly impossible. Not to mention the fact that, even if you could follow someone, it didn’t automatically meant their messages ended up in your feed.
I know for example that version 0.17.4 of Lemmy (that was released 2 days ago) already has some database optimizations.
Used Reddit for 13 years, tried out Kbin and Lemmy yesterday and settled on Lemmy.
Long story short, I’m going back to Reddit.
- There needs to be ONE site, Lemmy.com, that people goto. This entire thing about having .whateveryouwant is VERY off putting. Most internet users have been trained to be extremely wary of odd or unusual things, so having anything besides .com/.net/.org will turn away a huge portion of users.
I initially setup an account on Lemmy.world, then realized that I couldn’t migrate it to another server and that when I deleted that account on that server all my comments were deleted.
-
Deciphering the distributed nature of it took me, a relatively tech-friendly person, almost the entire day and several ‘What the fuck?’ posts. I now understand it more. There are some very low-level guides that have been haphazardly put together, but there absolutely needs to be a MUCH smoother guide/explanation to this whole thing. That learning process will turn people away for sure.
-
BECAUSE I understand it more now, I’m left feeling VERY uncomfortable about my data security. If this is going to become a mainstream thing, as it reaches and before it gets to that critical mass of users, there’s going to be SO. MANY. SECURITY ISSUES. There’s no 2fa at all, hacking and user-account hacking is just going to run rampant, and I’m left wondering ‘Where is my username and password actually stored?’. The answer, sadly, is wherever the dude who’s running the instance/server is. In the ‘Fediverse’ your server instance might be hosted in a US or EU data center with proper digital and physical security, or it could be Joe Blows basement in Iowa running off a NAS. The easy-to-see future here is that Lemmy will fail to attract a critical mass of people because they’ll initially arrive, after a few months their instances will just cease to exist/get shut down/the hosts will decide its no longer a fun hobby to do.
With a large corporation, they have the staff and resources to secure and maintain the servers physically and digitally, and keep staff up-to-date on current infosec threats and get out in front of them. Beyond that, if there IS a breach, they have the ability to recognize it, understand the legalities and requirements of reporting it, and can be held accountable by regulatory bodies. Joe doesn’t have the resources to really maintain and keep a server running, nor the knowledge of his responsibilities for keeping the data safe digitally or physically.
On top of that, if Joe’s basement loses power/gets hacked/Joe decides he’s moving to San Fransisco and can’t bring his NAS with him and the server goes down, and that’s where my instance is hosted well there goes my entire account/comments/data.
-
Finding and subbing to communities is painfully difficult. It should be one-click, but somewhere I need to goto an external list, find what I want, and then copy/paste the URL into the search… and then 50% of the time, it doesn’t work. This is an understandable growing pain and can likely be fixed by UI/UX upgrades, but for now it’s a definite turn-off.
-
There simply is no content. I’m not a creator, I want content aggregated for me, and I’ve gotten used to having a single place to get it from that floods me with thousands of different articles/memes/posts/etc every minute. Until the user base arrives in one single place and starts generating content, there’s no reason for most people like me to be there as by far the larger number of users never create anything at all and only exist to consume the content generated.
Thats not the point of being federated. It is very simple to understand once you get over the learning curve. The analogies to countries/states communicating to each other but being seperate helped me
A large open source project is generally more secure than a closed source one as it has more developers working on it and more security experts reading the code or testing it. If you want an example look at how many developers are working on Linux vs Windows and there security history. Once lemmy is big enough it has the potential to be more secure than things like Facebook or Twitter even.
You apparently don’t understand how password hashes work. Nobody is storing your password on any well implemented website. You can’t just grab someone’s password if there is a breach, provided the people who built the website aren’t completely incompetent.
With these misunderstandings and the fact federation was confusing to you I am not sure I believe your claim that you are a “tech-friendly” person. You sound like someone who has above average exposure to technology rather than someone who is actually skilled in it. There is nothing wrong with this in itself but please don’t claim to be proficient when you aren’t.
There needs to be ONE site, Lemmy.com, that people goto. This entire thing about having .whateveryouwant is VERY off putting.
The main feature of a federated system is that there’s no one “owner” of the entire system; each admin uses their own servers and their own domain names. There’s nothing stopping a server admin from using a .com domain name…
There’s no 2fa at all
There’s basic TOTP 2FA now: https://github.com/LemmyNet/lemmy/issues/2363 but it hasn’t been released yet (it’s only available in the latest server beta). “Next-gen” TOTP (Webauthn/FIDO) is coming later: https://github.com/LemmyNet/lemmy/issues/3059
‘Where is my username and password actually stored?’. The answer, sadly, is wherever the dude who’s running the instance/server is. In the ‘Fediverse’ your server instance might be hosted in a US or EU data center with proper digital and physical security, or it could be Joe Blows basement in Iowa running off a NAS.
You should get to know your server admin, then. You have the freedom to pick any server you like :)
There simply is no content
Have you subscribed to many communities yet? You can browse other Lemmy servers to find interesting communities, and subscribe to them on your instance.
On a similar note, would it be possible to have something like “sharding” where one server has multiple synched copies on several people’s machines? So lets say if one machine goes down for whatever reason there are others to still serve content? This could also help with distributing load across multiple machines so its less stressful on one, and we don’t have situations such as whats going on with lemmy.ml now, where so many users are joining it that its frequently down and subscription statuses are stuck on pending
This is usually referred to as “high availability”, where you’d have a hot failover to swap to in case the main server goes down. This is usually implemented with a load balancer that checks if the upstream server is alive before sending requests to it. If the upstream server isn’t responding, switch to the other one.
A load balancer could also spread the load evenly across multiple machines, at least for reads. Generally there’s far more reads than writes, and reads are more easily scalable since you can have database replicas that just need to sync in one direction.
I don’t think Lemmy supports any of this yet though.
The other approach is to split the large instances into multiple smaller instances. For Fediverse stuff, I don’t know which approach is considered “better”.
Sites don’t store passwords, they store password hashes. There is no reason to give any personal info you aren’t comfortable giving. You can use the site just fine without posting any
Hacking an account is still a valid concern though for various reasons , and hashes can still be used against password lists. Additionally, Two factor authentication is a necessity for sure. Now don’t get me wrong, I completely understand this feature is coming and that this is a developing service but many of these concerns do seem valid to me.
Working for me (from UK).
EDIT: seems they migrated to a new server earlier today to handle their increased load. Maybe a hiccup related to that, or your DNS server is still pointing to the old instance or something (in which case it should eventually fix itself)
Lemmy.ml did a server migration which was posted about 8 hours ago which was pinned on lemmy.ml meta. It appears in the comments that some users have experienced a 502 error, which was related to “iCloud’s Private Relay”. They were able to bypass the issue using a VPN, although I haven’t had any issues accessing lemmy.ml on my pc. I also read something about AWS us-east-1 being down, so it could also be related to that.
us-east-1 must not be completely down, or I’d be having a much worse day!
Saw it on https://lemmy.world/post/105778
Ah, their incident page says it was mostly lambda, my infra is mostly all on EKS/EC2.
Following communities could be another issue entirely, sometimes you have to subscribe then unsubscribe multiple times in order to get it to work.
@Sleeping I can’t subscribe in the 1st place. Guess I’ll just have to note down the community and try subscribing tomorrow again as it’s late around here 😁
Oh! Hmm, I’ve never run into that issue before. Although I have noticed on some instances it works faster and more reliable than others.
@Sleeping I am on Friendica. It shows like this.
I’ve never used Friendica, so I’m honestly not sure. Maybe this could be related to the ipv6 issue that the instance hoster would need to fix.
@Sleeping Thanks!