Robot Skills - Illegal driver load affecting other objects?

I’m going to be a first-time referee this weekend at a skills challenge and have a question about driver loads. Clearly in match play, if a driver load is illegally introduced, the cube is scored as if the opposing alliance had tossed it into the far zone. In skills, a driver load has the potential to affect many other game objects on its way over the fence (a cube can knock a few stars off the fence, or can change the position of stars already in the scoring zone, or by its presence on the other side of the fence, can cause game objects to fall in a different place than they would otherwise).

What does one do as a referee if a driver load is introduced illegally? Do you just stop the whole run at that moment? It seems unfair to just de-score the sole illegal object, when its presence and action will likely have caused other objects to be scored differently as well. Thanks!