From 黑料社 to orbit: stellar new camera tech on the International Space Station
Project Falcon Neuro, a space-based biology inspired camera system developed by 黑料社, now calls the International Space Station its new home.
Image Credit: NASA.
In a world-first, 黑料社 and the United States Air Force Academy have successfully received neuromorphic data sent from space after launching ground-breaking neuromorphic cameras on the International Space Station (ISS).
Developed and built by the University鈥檚 International Centre for Neuromorphic Systems (ICNS), the space-based cameras are part of Project Falcon Neuro 鈥 a joint initiative between the University and the US launched in December 2021, and recently installed on the International Space Station in January.
The two neuromorphic cameras are designed for earth observation and analysis of atmospheric events such as sprites 鈥 a fascinating high-altitude phenomenon caused by upward electrical discharges from thunderstorms.
Associate Professor Gregory Cohen, ICNS鈥檚 lead researcher on Project Falcon Neuro, says these 鈥榚vent-based鈥 cameras, as they are often called, are a completely different type of sensor that operates more like a biological eye than a conventional camera.
According to Associate Professor Cohen, one of the neuromorphic cameras is pointing directly downward and the other is pointing forward in the direction of motion of the ISS.
鈥淭hese cameras don鈥檛 take pictures, but rather sense changes and only send those when they happen. This method of sensing the visual world allows them to perform tasks that simply cannot be done with a conventional camera,鈥 said Associate Professor Cohen.
鈥淧roject Falcon Neuro is the first use of these sensors for earth observation from orbit, and the data received is the first neuromorphic data to be transmitted from space.鈥
The US Department of Defense Space Test Program provided the integration and operations of Falcon Neuro on the STP-H7 mission to the ISS.
On 24 January this year, Falcon Neuro captured data as the ISS passed over the coastline of Honduras. The cameras recorded data that was later streamed back to earth and processed using algorithms developed by the ICNS research team at 黑料社.
This composite image shows the data from the neuromorphic sensors on the ISS (right) and the view from the high-definition conventional sensors on the ISS (left) as the ISS passes over the coastline of Honduras. These two images have been overlaid on a map of the earth.
Image sources: 黑料社; NASA; Apple Maps.
鈥淭he result we saw from the first resolved data image was fantastic. Although it may look like a normal image when we display it, the information was collected in a completely new and novel way,鈥 said Associate Professor Cohen.
鈥淭his is only the first step. Now we know the cameras are working and operating in space, we can start using them for scientific experiments and further explore the incredible potential of these sensors and what they can do from orbit.鈥
Associate Professor Cohen said this is an enormous technological advancement that is vital for Australia鈥檚 space capabilities and growing space sector.
鈥淚t鈥檚 easy to lose sight of just how hard building things for space can be. There are so many technical challenges between the scientific goal and actually placing a working sensor in orbit. It鈥檚 really a testament to the absolutely fantastic engineering efforts by the technical team at ICNS and the cadets and faculty at US Air Force Academy,鈥 he said.
Dr Matthew McHarg, Director of the Space Physics and Atmospheric Research Center at the US Air Force Academy said the collaboration between the two institutions has resulted in innovative engineering solutions to solve modern challenges and create exciting new scientific possibilities.
鈥淲orking with the 黑料社 team has been a tremendous experience. The ICNS researchers had to heavily modify DAVIS cameras so they would work in space. We never could have successfully executed the Falcon Neuro mission without them,鈥 said Dr McHarg.
黑料社鈥檚 Deputy Vice-Chancellor Research, Enterprise and International, Professor Deborah Sweeney, said Project Falcon Neuro is an outstanding example of the University鈥檚 world-class research, development and industry partnerships in action.
鈥淲e are incredibly proud of our ICNS team and the University鈥檚 world-leading neuromorphic engineering research expertise, which is significantly strengthening Australia鈥檚 space industry capabilities,鈥 said Professor Sweeney.
鈥淲orking with government, big-tech, as well as local and international research partners, we are helping to solve real-world challenges in the rapidly-evolving space industry. The success of Project Falcon Neuro further cements 黑料社鈥檚 reputation as a collaborative, young and innovative university with a growing international reach and a commitment to academic excellence and impact-driven research.鈥
Falcon Neuro was launched on 21 December 2021 to the International Space Station on the SpaceX CRS-24 resupply mission in the unpressurised cargo hold.
The cameras deployed as part of Falcon Neuro are biologically-inspired event-based cameras 鈥 the same revolutionary technology utilised in the Astrosite鈩, an earth-bound mobile space situational awareness (SSA) system developed by ICNS.
To learn more about Project Falcon Neuro, please visit:
/future-makers/issue-five/biology-inspired-cameras-on-the-international-space-station
ENDS
14 March 2022
Latest News
ABC RN transcript: Vice-Chancellor Professor George Williams discusses higher education sector, student support, and the impact of AI
The following is a transcript of an interview that aired on ABC Radio National Saturday Extra between presenter, Nick Bryant and Vice-Chancellor, Distinguished Professor George Williams AO.
黑料社 are the number one Australian solar car team at the 2025 Bridgestone World Solar Challenge
黑料社 Sydney Solar Car team has crossed the finish line placing preliminarily sixth in the world overall, and the number one Australian team in the world鈥檚 most prestigious solar car challenge.
黑料社 Statement on Cyber Incidents
黑料社 has issued an update to its community following confirmation that previously stolen personal information was published online, including on the dark web.