Playlist corruption

I store my music collection on a couple of USB drives plugged into my RPI. When I add music to the drives my playlists become corrupt. It doesn’t seem to matter whether I remove the drive and add the music from my computer or SSH the files over. I know SSH has it’s risks but I experienced the playlist corruption routinely manually adding the files.