I don't know the last time the entire BART system got shut down. There was a loud explosion earlier this morning, which may or may not be related, but there aren't any power outages.
No information as to the actual cause right now. Easy to speculate that it's a cyberattack, but I'm going to go for the free square and wildly guess it is a DNS issue.
Best wishes and godspeed to the folks who are working on fixing the issue, whatever it is.
My free square is one of their control computers’ parallel ports frying out and now they’re unable to find a replacement because they buy them all as old stock off of ebay [1].
The ports are used as hard realtime GPIO so if some of the electrical isolation failed downstream, it could take out the motherboard. Back before Vista’s security model change, drivers could fill DMA buffers to the parallel ports controller and get hard realtime time outputs on Windows so there’s a quite lot of old industrial control systems running on a thread.
Wow that takes me back. My graduate physics experiment ran on two MS-DOS computers with Turbo Pascal programs exercising the parallel ports. Each machine had a grotesque board that I made, with multiple ADC and DAC channels. I finished in 1993. By that time, of course, everything was obsolete, but I wasn't going to delay my project by upgrading.
> My free square is one of their control computers’ parallel ports frying out and now they’re unable to find a replacement because they buy them all as old stock off of ebay
The last time I experienced a BART shutdown, the cause was that someone had found a box in one of the stations somewhere, and they (1) assumed it was a bomb; and (2) shut down the entire system. I'm not sure what stopping the trains while you investigate the bomb you've found accomplishes, but I don't think there were efforts to find additional bombs. (The box was not actually a bomb.)
Forgive my arrogance, but nothing presented in that article should be such a big blocker. Spare parts for the traction gear sure, but none of the computing "problems" make any sense.
It's not like hard real time systems aren't available. More concretely, they talk about running a DOS virtual machine on a laptop to download logs from the cars, but there's no way that protocol is so complicated it couldn't be re-implemented reasonably.
This sounds more like "It's cheaper to just buy old stuff off ebay than it is to actually care about this system"
Riding around in Waymos here, in the Jaguar models there is a button on the console labeled "DNS" and I have no desire to grab the steering wheel or adjust any other control, except every time I climb in, I am sorely, sorely tempted to press this "DNS" button because (1) I do not know what it does and (2) I have always had a soft spot in my sysadmin's heart for DNS in particular.
Please do not reply to tell me what "DNS" means in a motor vehicle, because you will ruin the mystique.
I don't see any reason other than sheer speculation to suspect a cyberattack. It can just as easily have been some car crashed into a fiber optic thingy.
The last time in recent memory there was a large BART disruption it had been caused by a motorcyclist who somehow flung himself over a fence into the trackway and died. That stopped service in and north of Oakland, which is more than half of the system by riders.
All sheer speculation--the reference to cyberattack was from a now dead comment suggesting it was ransomware.
It doesn't seem likely to be a physical obstruction on the tracks, though, as the entire system is down and trains aren't running anywhere. I don't know if that's happened before.
Last year in Paris Russian operations shut down the rail yards by tossing small wires over the rails - the train detector circuits work by shorting the rails together, so a handful of people were able to tell the rail network "do not proceed, stuck train ahead!"
> There was a loud explosion earlier this morning, which may or may not be related, but there aren't any power outages.
Loud explosions happen all the time in SF. Particularly in the Lower Nob Hill / Tenderloin area.
I lived an Lower Nob Hill for many years and heard countless explosions, most often in the middle of the night (2am-4am) or early hours (6am). Often times these explosions M80s-M1000s being dropped and detonated.
Someone was arrested back in 2019 and the explosions reduced dramatically.
Wow, you might have called the DNS issue. Nice. Can't be DNS, can't be DNS... It's DNS.
From the article: "Once the crews isolated that exact section that had the devices that were not properly communicating to each other, they were able to just simply disconnect them,” she told KQED. “That is what allowed us to finally get service back up and running.”
I used to live in Oakland, and am really sad to see continued failures of BART. They had started significant expansions right before the pandemic, allowing a long (but no traffic) ride possible from Oakland to San Jose.
A key challenge for BART is that they depend a lot more on ticket sales than subsidies, and as a result, have been hit much harder with lower ridership.
As an occasional BART rider, the changes they've made since the pandemic have been in the right direction. I'm mostly indifferent to the new trains and payment cards, but they've increased the frequency so that missing a train doesn't mean you can be waiting for over 30 minutes, which can be longer than your entire trip.
The main problem which BART cannot fix is that the trains usually don't go to where you want to go.
I think this is overstated, at least from an operations point of view. My mom has been using BART to commute to work for over a year and I can't recall many incidents like this.
> They had started significant expansions right before the pandemic, allowing a long (but no traffic) ride possible from Oakland to San Jose.
They're still working on this, with four more stations planned beyond Berryessa (Little Portugal, Downtown San José, Diridon, and Santa Clara), plus an additional infill station on the Berryessa line. I think that would be really cool. Unfortunately it looks like this new extension won't be that competitive with Caltrain as a way to get to San Jose from San Francisco. Maybe at non-express times.
Also, it looks like it won't be complete until 2040!?
i mean yeah if you’re in SF caltrain is super convenient, so its fine. Getting from oakland to south bay without a car was hell though. This line would make it so much better.
Plus: Oakland is actually building homes for people while SF remains laughably behind on building quotas.
This is pretty common among transit agencies, I got on the wrong platform in Japan once and couldn't get back out until I talked to a station agent, the fare gate gave an error and wouldn't open the gates. Not sure if that's better or worse behavior than charging a fare.
It's called an "excursion fare", which is meant for those that just ride the train without getting off and come back to the same station. You can talk to a BART station agent (assuming you can find one) and they'll let you out, or call customer service and they'll reverse the charge.
Modern fare systems should be able to figure out when you've exited right after entering and not charge you. BART is supposed to be adding a 30 minute grace period so if you go in and out of the station within 30 minutes, you won't be charged.
Fun fact: the reason it's like that is because both levels were envisioned for BART usage before the Peninsula lines got cut. In the original design both levels would have been the same fare area and you would have been able to walk between them instead of having to take the big escalators down to BART caged off from the Muni level. It's comical to watch one of the Muni trains crawl to one end of the giant platform that was sized for 10-car BART trains.
I too learned that the hard way when dropping a family member off. I naively assumed it wouldn't charge me if I tapped out at the same station 10 minutes later.
I don't see how it ever comes back. You used to have business people and engineers riding the train. But with Covid the enforcement policies got really bad and the trains and atmosphere are so trashy now. It's far easier for the aforementioned group to just hire an Uber than deal with the crime and trashiness that's plaguing the system now.
I ride the system all the time and I don't think it's trashy. Also there are the new gates all over that block people from jumping in as easily and that has been cut down quite a bit. I think it's tough for Bart to probably come back still because people don't need to be in downtown SF as much as they used to because a lot of people work from home now, but yeah I just don't think it's fair to say that the system is some trashy system. I think it's mostly pretty nice.
BART is unfortunately doomed. It had been running on federal aid, and with a deficit. Ridership is down 60% from 2019 (50 million vs 118 million). Now with San Francisco and Oakland in a long, slow downturn, it is unlikely to improve.
I'd say the BART administrators overpaying themselves is the bigger moneysink. Not to mention the spending 73M dollars to overhaul the gates to stop fare evaders, when it SHOULD just be free for bay area residents.
The problem is that the Bay Area needs a single transit agency. All the agencies fighting each other for funding doesn’t help. It’s a much easier task to levy a minuscule tax on the entire region that pays for free public transit. If BART wants to do that at the moment, they can’t.
> when it SHOULD just be free for bay area residents.
There was a study done on this. It turns out that the median income of someone riding under the Bay Bridge in BART is higher than someone driving a car across it.
In other words the wealthier people are using BART. So if you made it free, you'd be subsidizing the wealthy.
>The root cause of the disruption was related to network devices having intermittent connectivity. Staff in the Operations Control Center lacked the visibility of the track circuits and the train positions necessary for safe operations. Visibility of this system in the Operations Control Center is required to run service.
> BART’s Network Engineering team identified and isolated a redundant sector of the network that was causing intermittent visibility and disconnected it. This allowed service to begin.
Very poor countries also have exceptional public water wells where people can draw water with buckets.
That is because those are inconvenient, slow but necessary amenities in the areas where most people are poor. And that is why US currently doesn't need either.
Source: lived in a poor country with exceptional public transit and didn't ever drive till 29; and carried water with buckets from a well only a block away for an aggregate of 1-2 years.
But rich cities can also have great public transit. New York, London, Paris, Berlin, Tokyo, Seoul, Beijing, Singapore... in fact rich cities with transit as awful as the Bay Area seem to be the exception, not the rule
Equating having access to public transport with lack of running water is wild to me. A rich country is not one where poor people drive but rather one where rich people take public transport.
>“Once the crews isolated that exact section that had the devices that were not properly communicating to each other, they were able to just simply disconnect them,” she told KQED. “That is what allowed us to finally get service back up and running.”
Should it not be "they were able to just simply reconnect them"?
Surprise to see no exact problem been given in the article and comments section. Curious to see is it a legit computer networking problem, and if yes what they actually were? Could they install a proper fail over connection to prevent the outage in the first place?
Readit News
No information as to the actual cause right now. Easy to speculate that it's a cyberattack, but I'm going to go for the free square and wildly guess it is a DNS issue.
Best wishes and godspeed to the folks who are working on fixing the issue, whatever it is.
The ports are used as hard realtime GPIO so if some of the electrical isolation failed downstream, it could take out the motherboard. Back before Vista’s security model change, drivers could fill DMA buffers to the parallel ports controller and get hard realtime time outputs on Windows so there’s a quite lot of old industrial control systems running on a thread.
[1] https://www.mercurynews.com/2022/09/17/how-clever-mechanics-...
The last time I experienced a BART shutdown, the cause was that someone had found a box in one of the stations somewhere, and they (1) assumed it was a bomb; and (2) shut down the entire system. I'm not sure what stopping the trains while you investigate the bomb you've found accomplishes, but I don't think there were efforts to find additional bombs. (The box was not actually a bomb.)
It's not like hard real time systems aren't available. More concretely, they talk about running a DOS virtual machine on a laptop to download logs from the cars, but there's no way that protocol is so complicated it couldn't be re-implemented reasonably.
This sounds more like "It's cheaper to just buy old stuff off ebay than it is to actually care about this system"
Riding around in Waymos here, in the Jaguar models there is a button on the console labeled "DNS" and I have no desire to grab the steering wheel or adjust any other control, except every time I climb in, I am sorely, sorely tempted to press this "DNS" button because (1) I do not know what it does and (2) I have always had a soft spot in my sysadmin's heart for DNS in particular.
Please do not reply to tell me what "DNS" means in a motor vehicle, because you will ruin the mystique.
It's Do Not Schedule, carry over from when there was a human behind the wheel.
The last time in recent memory there was a large BART disruption it had been caused by a motorcyclist who somehow flung himself over a fence into the trackway and died. That stopped service in and north of Oakland, which is more than half of the system by riders.
It doesn't seem likely to be a physical obstruction on the tracks, though, as the entire system is down and trains aren't running anywhere. I don't know if that's happened before.
Loud explosions happen all the time in SF. Particularly in the Lower Nob Hill / Tenderloin area.
I lived an Lower Nob Hill for many years and heard countless explosions, most often in the middle of the night (2am-4am) or early hours (6am). Often times these explosions M80s-M1000s being dropped and detonated.
Someone was arrested back in 2019 and the explosions reduced dramatically.
This article[0] goes into detail about it.
[0]: https://maxleanne.medium.com/tracking-san-franciscos-mythica...
From the article: "Once the crews isolated that exact section that had the devices that were not properly communicating to each other, they were able to just simply disconnect them,” she told KQED. “That is what allowed us to finally get service back up and running.”
https://www.sfchronicle.com/bayarea/article/bart-shut-down-t... (https://archive.ph/LnvJ1)
https://sfstandard.com/2025/05/09/bart-service-shuts-down-co...
https://www.nytimes.com/2025/05/09/us/bart-train-shutdown.ht... (https://web.archive.org/web/20250509152319/https://www.nytim...)
https://abc7news.com/post/systemwide-bart-shutdown-due-train...
Dead Comment
The main problem which BART cannot fix is that the trains usually don't go to where you want to go.
I think this is overstated, at least from an operations point of view. My mom has been using BART to commute to work for over a year and I can't recall many incidents like this.
They're still working on this, with four more stations planned beyond Berryessa (Little Portugal, Downtown San José, Diridon, and Santa Clara), plus an additional infill station on the Berryessa line. I think that would be really cool. Unfortunately it looks like this new extension won't be that competitive with Caltrain as a way to get to San Jose from San Francisco. Maybe at non-express times.
Also, it looks like it won't be complete until 2040!?
[1]: https://www.youtube.com/watch?v=LZrrtF8Iy8k
Plus: Oakland is actually building homes for people while SF remains laughably behind on building quotas.
Of course most of Silicon Valley is closer to the San Francisco - Santa Cruz line, making the ferry service redundant.
It’s too bad they ripped all this stuff out, and will never rebuild it!
It's called an "excursion fare", which is meant for those that just ride the train without getting off and come back to the same station. You can talk to a BART station agent (assuming you can find one) and they'll let you out, or call customer service and they'll reverse the charge.
Modern fare systems should be able to figure out when you've exited right after entering and not charge you. BART is supposed to be adding a 30 minute grace period so if you go in and out of the station within 30 minutes, you won't be charged.
https://www.bart.gov/guide/faq#3
Dead Comment
There was a study done on this. It turns out that the median income of someone riding under the Bay Bridge in BART is higher than someone driving a car across it.
In other words the wealthier people are using BART. So if you made it free, you'd be subsidizing the wealthy.
Absolutely not.
>The root cause of the disruption was related to network devices having intermittent connectivity. Staff in the Operations Control Center lacked the visibility of the track circuits and the train positions necessary for safe operations. Visibility of this system in the Operations Control Center is required to run service.
> BART’s Network Engineering team identified and isolated a redundant sector of the network that was causing intermittent visibility and disconnected it. This allowed service to begin.
https://tracker.debian.org/pkg/palbart
http://www.pdp8online.com/ftp/software/palbart/
How about fix the country public transport first instead of spending 2 Trillion on BS AI?
That is because those are inconvenient, slow but necessary amenities in the areas where most people are poor. And that is why US currently doesn't need either.
Source: lived in a poor country with exceptional public transit and didn't ever drive till 29; and carried water with buckets from a well only a block away for an aggregate of 1-2 years.
Dead Comment
That's worth a screenshot.
Any idea whether the political and technical will is there, to post-mortem this, and make the system more robust and resilient?
Should it not be "they were able to just simply reconnect them"?
Surprise to see no exact problem been given in the article and comments section. Curious to see is it a legit computer networking problem, and if yes what they actually were? Could they install a proper fail over connection to prevent the outage in the first place?