The complete system, currently being designed by an international consortium, will process raw observations of distant stars and galaxies and turn them into a form that can be analysed by astronomers around the world.
“It is known as the SKA Science Data Processor, or the ‘brain’ of the telescope,” said Professor Andreas Wicenec, head of data-intensive astronomy at the International Centre for Radio Astronomy Research (ICRAR).
The successful deployment of the prototype science data processor execution framework on the Tianhe-2 supercomputer was conducted by an international team led by Professor Tao An from Shanghai Astronomical Observatory in China and Professor Wicenec in Western Australia.
The execution framework provides the control and monitoring environment to execute millions of tasks, consuming and producing millions of data items on many thousands of individual computers.
This is the scale of processing required for every single SKA observation obtained within six to 12 hours.
“Whenever a data item is ready, that’s triggering the next task — the task is not running idle, waiting for anything,” he said.
Professor An said the prototype was initially run on 500 compute nodes of the supercomputer and then extended to 1,000 nodes.
“The next step is to ramp up the number of individual items we’re deploying and then increase the number of compute nodes to what we are expecting for the SKA computer, which is about 8,500,” he said.
Professor Wicenec said the system is now running 66,000 items and the next stage will be a few million.
“Then we’ll run between 50 and 60 million items on 8,500 or 10,000 nodes,” he said.
Tianhe-2 was deployed on National Super Computing Center in Guangzhou, China, which has 16,000 computer nodes and can perform quadrillions of calculations per second. It was the world’s fastest supercomputer from June 2013 until June 2016.
“The most important part is the co-design and co-optimisation of SKA data processing software set and supercomputers such as Tianhe-2, preparing for the faster computers in a few years from now,” Tianhe-2 director Professor Yutong Lu said.
The SKA is arguably the world’s largest science project, with the low-frequency part of the telescope alone set to have more than a quarter of a million antennas facing the sky.
Each of the two SKA telescopes will produce enough data to fill a typical laptop hard drive every second.
The world’s largest single-dish radio telescope is the Five hundred metre Aperture Spherical Telescope (FAST) in the Guizhou Province of southwest China that was completed in July 2016. Follow this link to our online story about FAST and the Australian technology that helped make it possible.
