Without seing the electronic schematic for the LED, I would say it is only staying on for a little while after power off due to capacitor discharge.  This would be normal and not related to the fault.