You can remove it in the Device manager.
Just look in the Imaging Devices , right click the Xerox driver and choose Properties. You may be able to just click uninstall, then reboot and install it again, but I would do the overkill and select Driver details and take note of each file and make sure they actually have been removed.
