[CI Tests] Check differences in trajectories between commits
I think it would be beneficial to add some tests to the CI pipeline to see whether trajectories change significantly between commits for all implemented models. In addition, I think it would be helpful to save the differences between commits.
Maybe, as a start, we could compare trajectories without any elevated metrics but just step per step. If you are aware that you're modification changes the trajectories, you can still commit it and update the tests. But, more importantly, you will be notified if your commit had a impact on parts that were not be changed.
Comment from @hm-lehmberg from xref #278 (closed):
• work: because we always test against reference trajectories. I.e. we need to remember to update it if we change the model. • thoughts: there are different trajectory metrics and there is no set of standard metrics that we use, yet.
This is meant to be a discussion at first: @BZoennchen @hm-kleinmei @hm-lehmberg @stsc @hm-mayr9
Do you think this will be helpful or mainly more work? Happy to hear your thoughts.
(I would hope that it wouldn't increase the workload since currently none of us is changing locomotion models.)