Based on our experience with a dataset in KIT, we need to add an additional stage before crawling datasets into Solr. This will ensure that the dataset is healthy and ready for the crawling process.

One of the biggest challenges is checking for time-overlapping coordinates. This needs to be addressed and logged to the data provider to prevent these errors from occurring in production.