Jenkins admin console does not offer a good way to remove Plugin. You need to uninstall plugin one at a time and it can be cumbersome at times. However, you can just go to $JENKINS_HOME directory, navigate to plugins directory.This contains all the files for plugins:

You just need to remove the directories/files associated with the plugin in reference and restart jenkins service. This will remove the related plugin in reference.