EU EIP sub-activity 4.1 “Determining Quality of European ITS Services” has been dedicated to establish frameworks for quality assessment in several ITS data and service domains.
A major milestone of this sub-activity is a brand-new quality framework for the C-ITS domain. This framework, called the C-ITS Quality Package, adds quality aspects to parallel implementation and pilot projects across Europe.
The newest draft of the C-ITS Quality Package is now ready for the C-ITS audience and can be downloaded here.
The C-ITS Quality Package was presented to about 40 C-ITS stakeholders during an EU EIP Online Workshop on December 14, 2020.
The workshop goals were to:
- learn about the current elaboration of the C-ITS Quality Framework,
- learn how “quality criteria”, “quality requirements” and “assessment methods” could be defined,
- discuss quality aspects and issues with the EU EIP team and other stakeholders, and
- give input for the upcoming work by EU EIP.
In the first part, Peter Lubrich from the EU EIP Quality group presented the background, motivation and working structure for the C-ITS Quality Package, see his presentation.
One basic element of the Quality Package is a set of definitions in terms of various Quality Criteria. Realising that data ecosystems in C-ITS may be very complex and diverse, the EU EIP activity started with a “zooming-in” approach, looking at specific communication chains and specific use cases. This way, some preliminary quality definitions were developed for those specific cases. The resulting Quality Criteria (e.g., latency) were quantified with (minimum) requirements per use case. In addition, these Quality Criteria were correlated with data elements from ETSI specifications (defining message contents in C-ITS) as well as evaluation techniques in current C-ITS deployment projects.
To reflect how Quality aspects are covered in European C-ITS projects so far, a “mini talk show” is held with the question “What quality aspects did you encounter in your C-ITS project?”. Partners from the projects C-Roads Germany [https://www.c-roads-germany.de/deutsch/pilotprojekt-hessen/], Nordic Way 2 [https://www.nordicway.net/] and C The Difference [http://c-thedifference.eu/] replied to this, linking to the individual projects elaborations, e.g. explaining how certain Quality Criteria were assessed within the project evaluations.
Next, an open session was opened to review the approach of the EU EIP activity and explore requirements by present C-ITS experts. The following questions were discussed:
- Are the EU EIP quality definitions sufficient for a common understanding on C-ITS quality?
- How to embed the EU EIP Quality definitions into the technology set-ups of C-ITS deployments?
- Which part of the communication value chain should we focus on?
- What is the way forward for the EU EIP Quality Package?
The feedback on these questions was collected using a Miro Board, see here for results. Accordingly, the audience put much attention on the necessary differentiation of technologies, communication actors and use cases, when describing and defining Quality Criteria. For example, the choice of a specific communication technology clearly affects the definition and setting of many Quality Criteria. The EU EIP Quality group will consider the need for such differentiation when further working on the C-ITS Quality Package.
As one of the workshop benefits, new relationships were built between the EU EIP Quality group and dedicated C-ITS experts and actors. This way, relevant documents and outcomes from other C-ITS groups and activities were recommended to the EU EIP Quality group to be considered, and some participants showed interest in future exchange in terms of Quality issues.
All in all, the workshop served as an important milestone for the EU EIP Quality activity, giving some orientation when developing the C-ITS Quality Package, and bringing this elaboration closer to the on-going C-ITS deployments across Europe.