Enhanced vision fused with synthetic vison - Boeing test - Curt Lewis

NASA, Boeing Testing Synthetic Vision Technologies

Synthetic vision cockpit display in Research Flight Deck simulator at NASA Langley Research Center in Hampton, Virginia.

NASA and Boeing are working together under a new Space Act Agreement to improve flight training and aviation safety using NASA's synthetic vision technologies and Boeing's 787 simulators.

The research will test pilots' awareness and reactions to unplanned situations. NASA research technical lead Kyle Ellis says the agreement opens the door to exciting new research opportunities.

"This is just the first of many potential experiments that we can conduct using this collaborative environment," said Ellis. "We're looking at training for attention management, advanced upset recovery technologies and combined vision technologies."

Pilots deal with more challenges than ever - higher levels of aviation traffic, bad weather and the addition of new challenges (such as unpiloted vehicles) into the global air space.

"We want to equip them with the greatest intelligent flight systems available to be able to cope with all of these different adverse conditions," said Ellis.

Synthetic vision technologies can be part of that solution.

"We've developed technology that allows us to be 'weather independent,'" said Ellis. "Synthetic vision systems are essentially weather-immune displays that allows you to see what the world looks like in perfect weather conditions all the time."

It's a powerful tool that can effectively negate the visual penalties associated with even severe weather in a clear, intuitive manner. The technology offers the potential to improve aviation system safety and increase the efficiency of aircraft operations.

"Essentially what we're doing is we're taking away the old attitude indicators - that blue-over-brown attitude indicator that shows where the horizon is - which is critical to flying safely, especially in poor weather conditions. That dates all the way back to Doolittle," says Ellis. We're basically piggybacking on top of that attitude reference system and throwing a real-world image on it."

The pilots who will participate in these tests fly for Avianca Airlines in Colombia, and they're something of an extraordinary test group. Typically, research study participants are highly experienced pilots with tens of thousands of flight hours logged. The Avianca pilots are a group of 24 junior pilots. They represent the changing face of global aviation.

"The international pilot community is getting younger, so the idea is to get them accustomed to what's possible in an airplane sooner," says Capt. Jim Wilkerson, Boeing flight crew training instructor. "And this training does that."

Testing at Boeing's Miami training facilities will begin in late 2017.

Today, Ellis and his research team are working with Boeing to test and certify synthetic vision systems for attitude state awareness. He sees it as a stepping stone toward a larger goal, anticipating a future in which technologies that give pilots vision far beyond what the eye can see. That kind of cockpit technology has a name - combined vision systems.

A combined vision system is a merger of synthetic vision (i.e., systems that generate rendered environments in real time based on stored database information) and enhanced flight vision systems (i.e., displays that use forward-looking infrared systems and millimeter wave radar to give pilots a live look at the world around the aircraft). It can give pilots a best-of-both-worlds representation of the world and their orientation within it.

Under stressful situations, it's much harder for pilots to absorb essential information and execute the appropriate actions. Synthetic Vision systems look just like the world outside the window, and that makes them more intuitive - more believable - for pilots.

"Seeing is believing," says Ellis. With this technology, pilots will be able to believe what they see, trust it and follow that to safety.

Space Acts
The Space Act Agreement between NASA and Boeing supports the Commercial Aviation Safety Team, a partnership between the U.S. government and the aviation industry developed to reduce the commercial aviation fatality rate in the United States. NASA and Boeing are members.

Space Act Agreements are, in a sense, strategic alliances. They are the primary vehicle NASA uses to partner with the external community, and they give NASA access to technologies and capabilities that are not in its core portfolio. These partnerships expand NASA's ability to meet technical challenges, often at virtually no cost to taxpayers. As NASA advances its goals, Space Act Agreement partnerships can also advance the mission of our partners.