Incident with Pull Requests, Git Operations and Issues

(githubstatus.com)

63 points | by kevcampb 1 hour ago

19 comments

  • a-squirrel-comm 1 minute ago
    It looks like today there was maintenance scheduled to deprecate support for certain categories of SSH keys: https://github.blog/changelog/2026-09-22-security-improvemen...

    > November 4, 2026: We’ll have a brownout of the removal of the ssh-rsa signature type (i.e., RSA keys using SHA-1) and the diffie-hellman-group-exchange-sha256 key exchange algorithm.

    I guess something went sideways.

  • malikolivier 2 minutes ago
    GitHub outages can be a drain on productivity. If your stack is pulling artifacts from GitHub, and this consistently fails during GitHub outage, you can consider having a file-cache in between.

    Some of our customers unexpectedly started using the service we're running as a file-cache around GitHub to mitigate GitHub outages.

    We wrote about this use case in our blog: https://www.stablebuild.com/blog/protect-your-builds-from-gi...

  • marvstazar 9 minutes ago
    Pretty good timing now that Rails has released a security update :|

    https://rubyonrails.org/2026/11/4/Rails-8.0.5.2-and-8.1.4.1-...

  • eknkc 48 minutes ago
    Our deploys are tied to GitHub actions and it is becoming a liability at this point. What alternatives do people use? I mean for FOSS there are some decent stuff but we need a reliable provider for private repos.
    • myaccountonhn 10 minutes ago
      Post receive hook on a bare git repo with gitolite for access control.
    • pelagicAustral 41 minutes ago
      My deployments are tied to their container registry, so I'm equally screwed... Been thinking of going back to Dokku, I started working on a third wrapper around Dokku (yeah, I've literally done this twice already), and then self-host and self-provision... I honestly thinking seriously about this.
    • misswaterfairy 43 minutes ago
      Genuine question: if you're hosting private repos, is self-hosting an option?

      Gitea Enterprise would be worth looking at.

      https://about.gitea.com/products/gitea-enterprise/

      • eknkc 25 minutes ago
        Honestly, not really wanna deal with self hosting it. Would rather pay for a decent service at this point.
        • import 22 minutes ago
          There is already a blacksmith sh if you don't want to selfhost your runners. Or codeberg as a full solution if I am not mistaken.
          • michaelbuckbee 15 minutes ago
            +1 for Blacksmith. You need to have a Github org to use it as it won't work on personal accounts, but it feels like a magic want that just makes runners 2x as fast.

            I have it for all my stuff (dozens of repos and hundreds of PRs/builds per week) and it's only once in the last year that I've exceeded the free resource levels. I don't know if it's just extra capacity or they're burning VC dollars in the hopes of inspiring posts like this, but either way I feel like I'm taking advantage of them at this point.

          • crote 11 minutes ago
            Codeberg only allows F/LOSS software, for most companies that's a dealbreaker.
    • saturn_vk 28 minutes ago
      Self-hosted Forgejo with a bunch of runners might also be interesting for you. The workflow syntax is _almost_ identical to the github one.
    • rozularen 18 minutes ago
      self hosted forgejo has been my saviour. im thinking in acquiring a new NUC server to increase compute and storage to my homelab to add some new runners
    • import 24 minutes ago
      gitea is amazing.
  • cashbreaker 28 minutes ago
    I was thinking I'm going crazy with me ssh keys not working on both of my machines.
  • misnome 10 minutes ago
    At this point, even when there isn't an incident, push/pull have been so unreliable as to fail about 30% of the time.

    I can live with the occasional outage but this is a constant problem.

    • w3ll_w3ll_w3ll 3 minutes ago
      I feel there is a problem with your connectivity or with the Github datacenter you are being routed to. That has not been my experience.
  • thesdev 1 hour ago
    Finally a GitHub outage during European workday. Yaaay.
  • sognetic 56 minutes ago
    Can't even pull no more using my key. That's a new low, I'm used to the website being janky nowadays but this is seriously essential
    • ayhanfuat 43 minutes ago
      At least they have a very clear error message so you know what is going on.

      > git@github.com: Permission denied (publickey). fatal: Could not read from remote repository.

      Please make sure you have the correct access rights and the repository exists.

      • chinathrow 30 minutes ago
        That's standard git, not coming from GH.
    • b1tshift 30 minutes ago
      Just rolled new keys and though I'm going crazy that it's not working
  • rarisma 22 minutes ago

           - - >  i wake up - -
           |                  |
           |                  V
           github has an outage
  • feukon 26 minutes ago
    The day GitHub will no longer be free is approaching... they just can't support the abnormal amount of things being pushed rn
    • crote 15 minutes ago
      For most people here GitHub is already a paid platform. Our companies rely on it as a core part of our development workflows, and we pay a decent bunch of money for it. If it was only the free part of GH having issues, it wouldn't get even remotely near this kind of exposure.

      Developers are expensive. If I can't ship a feature on time because GitHub issues keeps forcing me to switch to different tasks to work around git/PR/ticket/Actions downtime, then that costs my company real money - despite us not being the source of the AI DDoS that GitHub has happily been welcoming.

      To me, the situation is very simple: either 1) rein in the AI deluge, or 2) isolate paying customers from it, or we'll move to an alternative.

      For businesses the current state of unreliability would be unacceptable if it was completely free, the fact that it is actually paid just adds insult to injury.

  • igleria 52 minutes ago
    Can't they just... sell github back like when the germans sold the nuclear plant back to mr burns?
    • solyin 45 minutes ago
      As of 2026-11-04T10:25:34Z the domain MicrosoftPleaseGiveGithubToGoogle.com is still unclaimed.
      • selectnull 39 minutes ago
        Yes, really at this point it would be best if MS sold Github to Google and they kill it within a year.
  • fauzanhilmi 47 minutes ago
    For a moment I thought my ssh key got breached. Fricking hell Github!
  • jonathanbull 34 minutes ago
  • grishka 14 minutes ago
    I managed to push a commit over ssh but then the client threw an error before the push fully completed. I can see the commit on the web, but my client still thinks it isn't pushed. And now when I try to fetch I get "access denied" after a long wait, which is scary. I first thought something got hacked.

    Maybe they need a better AI model for their vibe coding. That'll fix everything, right? At least that's what my friends keep telling me when I say that the free LLMs I played around with a bit are incredibly dumb.

  • chinathrow 58 minutes ago
    git clone works sometimes, sometimes not.
    • computerfriend 36 minutes ago
      Unauthenticated fetches seem ok. Not sure what you mean about git checkout, it's purely local.
  • esher 1 hour ago
    Again and again?
    • crote 13 minutes ago
      GitHub is down only on days ending in -day.
    • anon7000 48 minutes ago
      That is how explosive demand growth works after all. They just aren’t keeping up with increasing capacity or rate limiting people
  • dude250711 37 minutes ago
    These days, perhaps, normal undisrupted operation should start counting as an incident...
  • rvz 9 minutes ago
    Another incident. Last time we had one was 5 days ago [0]

    It's up to you if you want more of this instability. Perhaps you should consider a self-hosted alternative.

    [0] https://news.ycombinator.com/item?id=50307843

  • larsnystrom 27 minutes ago
    Why haven’t they asked an AI agent to fix all their bugs yet? /s
    • refactor_master 18 minutes ago
      Prompting the wrong things is just a skill issue.