Celtics coach Doc Rivers was upset with the combined effect of the fight and the loss.