Like I said before, the only thing to change is the game in a way that people know it is fair. Instant replay.
People that don't know the game don't know why the ref blew the whistle. If people don't feel they are getting a fair chance there gone, for good.
Look at tennis for an example of the replay being used.