Railway Status

This incident has been resolved. We found the issue pertaining to a single host in our fleet with elevated connections exhausting access in both the private and public network.

18Wed

17Tue

Suspected hardware failure affecting a subset of deployments in EU West10:57 AM

This incident has been resolved.

16Mon

Outbound networking issues for a subset of hosts7:34 AM

This incident has been resolved. We identified a subset of misconfigured hosts primarily in Asia that were failing to route outbound traffic correctly during 0620 UTC \~ 0735 UTC and have applied a fix. We are adding additional monitoring to detect this class of issue earlier. We apologize for any disruption. If you continue to experience issues, please contact support at <https://station.railway.com>.

15Sun

Issues with networking on a subset of hosts9:27 AM

This incident has been resolved.

14Sat

13Fri

Logs loading slowly3:25 PM

This incident has been resolved.

12Thu

Some repos may fail to snapshot code with metal builders8:29 PM

This incident has been resolved.

Issues with Dockerfile build configs8:30 AM

This incident has been resolved.

11Wed

10Tue

Deployment slowness3:19 PM

This incident has been resolved.

09Mon

Deployments stuck10:16 PM

This incident has been resolved. New deployments for free, trial and hobby have been re-enabled.

Deployments may fail to go out3:26 PM

This incident has been resolved.

TCP Proxy connectivity issues4:00 PM

This incident has been resolved.

08Sun

07Sat

06Fri

05Thu

Dashboard may fail to load for some people4:41 PM

This incident has been resolved.

Degraded performance on public networking9:36 AM

This incident has been resolved.

04Wed

Issue with deployments11:05 PM

This incident has been resolved.

03Tue

Issue with deployments11:05 PM

This incident has been resolved.

02Mon

Dashboard slow to load6:18 PM

This incident has been resolved.

Slow build and deployment times5:38 PM

This incident has been resolved.

01Sun

Elevated error rates on Edge Network8:43 PM

The elevated 503 error rates across all regions have been resolved. All traffic is now flowing normally through the edge network. We apologize for any disruption. If you continue to experience issues, please contact support at <https://station.railway.com>.

February98.84% uptime

28Sat

27Fri

26Thu

We're experiencing an elevated error rate in our edge network9:18 PM

This incident has been resolved.

25Wed

Builds and deployments are slow to progress.6:16 PM

This incident has been resolved.

24Tue

23Mon

22Sun

21Sat

A subset of domains are failing with a 503 error page.5:34 AM

This incident has been resolved.

DNS resolution is failing for some domains.6:24 PM

This incident has been resolved. <https://www.cloudflarestatus.com/incidents/kwy3dt82bwbt>

20Fri

DNS resolution is failing for some domains.6:24 PM

This incident has been resolved. <https://www.cloudflarestatus.com/incidents/kwy3dt82bwbt>

19Thu

Public networking traffic may time out.2:18 PM

This incident has been resolved.

18Wed

Public networking traffic may time out.1:47 PM

This incident has been resolved.

Builds temporarily paused.3:06 AM

Build issues have been resolved, and we are seeing a full recovery from the backlog.

17Tue

16Mon

15Sun

14Sat

13Fri

Some users might not be able to log in.1:00 AM

This incident has been resolved.

12Thu

11Wed

We're investigating degraded performance on internal networking5:24 PM

This incident has been resolved.

10Tue

09Mon

GitHub is experiencing degraded performance issues7:08 PM

This incident has been resolved.

GitHub is experiencing degraded performance issues 4:41 PM

This incident has been resolved.

Deploys may fail to go through2:28 PM

Our fix is live and customers report deploys working again!

08Sun

07Sat

06Fri

05Thu

04Wed

Metrics may be unavailable for some users5:01 PM

This incident has been resolved.

Metrics may be unavailable for certain users10:12 PM

We merged a fix and reports point to metrics being healthy.

03Tue

Builds may experience failure5:53 PM

This incident has been resolved.

GitHub is reporting degraded performance with GitHub actions4:43 PM

Github reported full system recovery

GitHub is reporting major outages with GitHub Actions10:44 PM

GitHub reports suspected full recovery. <https://www.githubstatus.com/incidents/xwn6hjps36ty>

Metrics may be unavailable for certain users10:12 PM

We merged a fix and reports point to metrics being healthy.

02Mon

GitHub is reporting major outages with GitHub Actions10:44 PM

GitHub reports suspected full recovery. <https://www.githubstatus.com/incidents/xwn6hjps36ty>

01Sun

January100.00% uptime

31Sat

30Fri

29Thu

GitHub operations are being rate-limited. Users may be unable to log-in or add GitHub repos. We are working on resolution for this issue.3:06 PM

Our monitors have shown that we have good effect on our changes, although we have improvement, we are still monitoring the impact for all customers.

GitHub logins or deployments may timeout due to downstream rate limits. We are working on long term resolution for our customers.6:02 PM

We have confirmed that GitHub login, and repo access is working for all customers on the platform. We apologize for the impact and we will publish a public retro.

NPM is having degraded performance Installing and Viewing Packages8:08 PM

This incident has been resolved.

28Wed

Applying staged changes might take longer than usual4:48 PM

Staged changes are applying for all customers on the platform.

Some workloads may have delayed or no logs. We are investigating the cause.7:13 PM

Logs are working nominally.

GitHub logins or deployments may timeout due to downstream rate limits. We are working on long term resolution for our customers.6:02 PM

We have confirmed that GitHub login, and repo access is working for all customers on the platform. We apologize for the impact and we will publish a public retro.

27Tue

26Mon

Node Yarn PKG mirror is unavailible causing failed builds.8:58 PM

The yarn mirror is operational.

25Sun

24Sat

23Fri

22Thu

21Wed

Log delivery delay across all regions8:30 PM

This incident has been resolved. Some build and deploy logs may have been dropped during this incident window. We apologize for any inconvenience caused. Please reach out to us at <https://station.railway.com/> if you are still experiencing issues with build or deploy logs.

20Tue

19Mon

18Sun

17Sat

16Fri

Elevated Build Times10:36 PM

This incident has been resolved. Free, trial and hobby deployments have been re-enabled.

15Thu

14Wed

Elevated build times for services on Metal Build Environment8:45 PM

This incident has been resolved.

13Tue