Look for the exact name of the installed rpm you want to remove
rpm -aq | grep -i XYZ
Copy the complete line of the rpm you want to remove and issue the following to remove
rpm -e XYZ
Note: Make sure that the rpm you are removing isn’t a dependency of another program. Messing around with these could break your server.