A Federal Aviation Administration official was supervising a contractor in rural Arkansas as he switched vital air traffic communications lines from an old copper-wire network to a new fiber-optic one, even testing the finished product and signing off on the work, according to a person close to the investigation.
Just eight minutes later Friday afternoon, the radio network for much of the United States’ air traffic control centers began to falter. As aviation officials hunted for the source of the trouble, the FAA ordered a rare nationwide ground stop that paralyzed much of the nation’s plane traffic for 4½ hours.
The precise cause of the communications outage remains a mystery, said the person close to the investigation, who spoke on the condition of anonymity to talk about sensitive issues they were not authorized to discuss.
Blame for the outage has centered on the work performed by L3Harris Technologies, the contractor hired to help modernize what’s known as the FAA’s communications backbone by replacing ancient copper wires with new fiber-optic ones. L3Harris is a major defense contractor and tech services provider.
Transportation Secretary Sean P. Duffy has repeatedly said the ground stop was caused by L3Harris’s work Friday at a remote communications facility in El Dorado, Arkansas. On Saturday, Duffy said the FAA was working to determine whether it was “incompetence” by L3Harris or a faulty router.
But the person close to the investigation said Duffy’s characterizations were “inflammatory” and “insulting” and overlooked the FAA’s prominent role in the work performed in Arkansas.
“We’re working really hard to get to a root cause,” this person said, adding, “Right now, everyone is jumping to conclusions.”
The FAA responded to a request for comment by pointing to a news conference that Duffy and FAA Administrator Bryan Bedford gave Tuesday at the Capitol. Duffy said he wanted L3Harris to “hire better minds” for the work and is looking at bringing in other companies to help with the remaining contract.
The danger that led to Friday’s ground stop was that planes flying at high altitude were struggling to communicate with air traffic controllers. Duffy has said this was caused by the new router in Arkansas flooding the system with more than 1,000 connection attempts every few seconds, creating instability.
The FAA and L3Harris are examining the router at a lab in Florida.
L3Harris is continuing its work on replacing and updating communications lines while the inquiry continues. But the company has stopped using what are known as Juniper routers, the kind implicated in Friday’s outage. So far 68 Juniper routers have been installed.
“Based on what we know and have been told by others, our equipment was working as configured,” said Adam Bauer, a spokesman for HPE, the company that makes the Juniper circuit-to-packet devices.
L3Harris’s work is continuing using other routers, the person familiar with the investigation said.
The job in Arkansas was one small piece of an effort to switch the nation’s air traffic control communications from ancient copper lines to modern fiber. L3Harris is the main contractor on that job, which FAA officials have said is now 70 percent complete and could be finished late next year.
L3Harris in recent years has done more than 4,600 installations of equipment related to the FAA’s modernization effort. And these are not quick or simple jobs, the person said.
The work is necessary because telecommunications companies are rapidly decommissioning their copper lines — meaning the FAA would lose the connections entirely if they weren’t changed over to fiber-optic cables.
An L3Harris executive talked about this pressure in a March interview with Global Airspace Radar. Chris Collings, a company vice president, said the potential copper-line shutdowns “created a hard deadline, and the momentum over the past year has been significant.”
The work at the remote communications site in Arkansas began in October and followed the standard procedure for L3Harris’s modernization efforts, the person said. That includes detailed step-by-step plans and discussions with the FAA. They talk about what services could be lost and plan work-arounds. The FAA approved all of that, the person said.
The first step was installing new hardware alongside the existing equipment. The new gear was not immediately hooked up to the air traffic communication system. Meanwhile, a telecommunications carrier installed the new fiber-optic cable.
Then, on Friday, the L3Harris contractor and an FAA official returned to the site in Arkansas.
As to why the work was allowed to start ahead of a busy aviation weekend, the person said the FAA performed an operational risk assessment and gave the green light.
“This site is very small. There are very few services. It was not considered a risk,” the person said.
Plus, this person said, “there are not enough overnights and weekends to finish the task.”
When the L3Harris contractor finished their work, it was time for the turnover, when the old equipment is turned off and the new equipment is turned on, the person said. The FAA official tested the new gear and signed off on the job.
Everything looked like it was working perfectly, the person said.
The post FAA oversaw and signed off on repair work before nationwide ground stop appeared first on Washington Post.




