Microsoft Teams security events can now be dismissed, similarly to other security events.
To dismiss events click on the 'dismiss' action on the actions column.