However, would the security issue be that some one could put something malicious on a card and insert it ?

no, AFAIK, android phones never execute any program code that is stored on an external SD card.