Announcing the final competition metric
- This topic is empty.
-
Dear Competitors,
Please find below the information about the final competition metric.
After discussions with our colleagues from AEMET, we have decided that the official competition metric used to score your submissions in the Weather4cast Core, Transfer, and Nowcasting leaderboards will be the mean Critical Success Index (CSI).
We calculate it for the following thresholds: 0.2, 1, 5, 10, and 15, and then take the average of all computed values.
Also, while calculating the final score, we assume that any radar measurement below 0.2 value results from instrument artifacts, and therefore, we map those values to 0
You can read about the CSI metric, for example, here: https://en.wikipedia.org/wiki/Jaccard_index
Please note that all previous submissions to the CORE Leaderboard have been recalculated to the new metric.
Best wishes,
Aleksandra
- You must be logged in to reply to this topic.