This would allow users to exchange currencies right on your site resulting in a lower bounce rate.
Fewer clicks to get the information they want.
No, the plugin is small and should not slow down the load time of your site.
Yes. You can add and remove the plugin as you please.