You will loose autoconfiguration of retroarch by doing that – you should reinstall emulationstation from binary to restore the script hook for triggering controller configs.