Summary of information related to WP13
This Work Package determines how the EISCAT_3D data system will be implemented on the e-infrastructure which currently exists in northern Scandinavia (or that which is planned for the near future). Carried out by Uppsala University (UU), hosting the Swedish National Infrastructure for Computing (SNIC) together with Umeå University, third party of UU, it will engage with the national providers of networking, storage and high performance computing to ensure that the requirements of the project can be optimally satisfied. SNIC will perform this work interacting with EISCAT Scientific Association, University of Oulu, STFC and National Instruments.
In the FP6 Design Study an extensive Work Package was devoted to the design of a two-tier data system, in which high volume data would be held close to the array before being optimally processed into lower-volume data products for transfer into a long-term data archive. It was shown that systems of the required capacity could be realised with existing technology. However, such systems are expensive and their operation is quite resource intensive for a small organization such as EISCAT.
In this Work Package the following activities will be performed:
- Determining how to address the networking requirements, using existing fibre networks as far as possible.
- Examination of any changes to the data-handling philosophy which might be required if the Software
- Defined Radio philosophy is adopted for the signal processing and beam-forming.
- Examination of the potential of existing resource providers to help address the storage and computing requirements for the EISCAT_3D system.
This Work Package will be carried out in close collaboration with WP2, WP3 and WP11, in order to ensure that the demands of the data system are consistent with the EISCAT_3D hardware and software, that they are matched to the availability of local infrastructure, and that the products available from the data system match the requirements of the future EISCAT_3D users, including those in areas such as applications and modelling.
Deliverables
Deliverable 13.1: Report on the analysis of the different data products
April 8, 2013
In the original plan for EISCAT_3D Preparatory Phase, Task 13.3 (Interaction with other ESFRI projects) and Task 13.5 (Analysis of data products and services) would interact with other ESFRI projects and would synthesize the outputs from Work Package 3 and the technical Work Packages in this project.
These activities will take place within other projects such as ESPAS, ENVRI and COOPEUS, where EISCAT and EISCAT_3D participates. This means that Deliverable 13.1 will not be produced inside the EISCAT_3D Preparatory Phase project.
Deliverable 13.2: Final report on all the activities in WP13
April 8, 2013
Work Package 13 in the EISCAT_3D Preparatory Phase FP7 project analyses the requirements and implementation of the data processing and datahandling in EISCAT_3D. The advanced nature of the EISCAT_3D instrument poses genuine challenges for data handling and processing. This report contains suggestions for the organisation of an EISCAT_3D data centre in order to meet these challenges.
Milestones>/h2>
Milestone 13.1: Report on the networking requirements and provision aspects to the identified sites task completed
February 29, 2012
Task 13.1 of the EISCAT_3D Preparatory Phase project was to determine how to address the networking requirements for the EISCAT_3D system, using existing fibre networks as far as possible.
This Milestone was reached in July 2013 and results are included in a document prepared by EISCAT for the EGI project in August 2013.
Milestone 13.2: Report on consequences of signal processing strategy
June 18, 2012
Task 13.2 of the EISCAT_3D Preparatory Phase project involved an examination of any changes to the data-handling philosophy which might be required if the Software-Defined Radio philosophy is adopted for the signal processing and beam-forming
A report was scheduled for presentation during the EISCAT_3D Technical Meeting in Kiruna, 5 November 2013 but it had to be cancelled due to travel problems. The report was then presented in a meeting with EISCAT_3D stakeholders in January 2014, together with recommendations regarding data distribution, archiving, services and analysis (Milestone 13.3).
This Milestone was thus reached in January 2014.
Milestone 13.3: Recommendations regarding data distribution, archiving, services and analysis
April 8, 2013
Task 13.4 of the EISCAT_3D Preparatory Phase involved an examination of the potential of existing resource providers to help address the data storage and computing requirements for the EISCAT_3D system.
The recommendations were presented to the representatives of e-infrastructure institutions and network providers in the EISCAT host countries in a meeting 14 January 2014 in Stockholm, during which the participants agreed to continue the discussion on the project and support the preparation of the work package deliverable.
The participants at this meeting were:
- Börje Josefsson, SUNET
- Mats Nylén, SNIC – HPC2N
- Arild Halsetronning, UNINETT Sigma
- Vidar Faltinsen, UNINETT
- Lars Fischer, NORDUnet
- Ingrid Mann, EISCAT
- Ingemar Häggström, EISCAT
- Antti Pursula, CSC
- Juha Oinonen, CSC, FUNET
- Per Öster, CSC
- Gudmund Höst, NeIC
- Michaela Barth, NeIC
- Jacko Koster, SNIC
- Ann-Charlotte Sonnhammer, SNIC
Attachments
Documents related to WP13 can be found in our external library.