You probably have the Orders Updated event registered in addition to other order events.

The Orders Updated event will send a notification to Slack for any change in the order. So if you want to get notified of all changes to the order, you can use this event on its own and remove the others. If you want to be notified of just certain events (such as Orders Created or Orders Cancelled), then it's best to just use those events and not use this one.