Currently, we are making a lot of cascading updates of milestone when we update milestones. But we also have to do similar cascading updates when we delete a milestone, as it can cause changing other milestones start/end dates. And start/end date for the whole timeline.
Here is a related issue about cascading updates on milestones adding #378