Smart cards are protected by a PIN or a biometric, typically a fingerprint.  If you lose your smart card, notify your health insurance company or the company who issued you the card.  They will deactivate your lost card and issue a new one to you.  Since the finder of your card requires knowledge of your PIN or even your fingerprint to access the information on the card, your information is safe.