My lawyer tells me to relax; the physical description on the license will help deter the problem. (My fingerprints are on file with numerous federal agencies due to previous background security checks so that would also help.) He also told me that the information is out there and if anyone wanted it, they could have already gotten it. Since I've already taken the steps to protect ourselves (according to him) I'm one step ahead of the game.
I have to agree with your lawyer . . . you have done everything that you should to protect yourself.
If you are like me, even knowing all of this, you will still worry, but some of us just worry more than others.