Not it you're careful. Easiest way to replicate the texture would be to make a "stamp". Take a little Aves Clay or Sculpt, mix it, and let it sit for about an hour and 1/2. Less if you live in a warm climate. Once the putty has set a bit, wet an area of the texture you want to copy, and then press the putty on top for a couple of seconds. Pull the putty straight up, and you should have a perfect copy of the texture. If not, just repeat until you get it right. Set the putty aside to fully cure.
When you're ready to redo the texture you removed, simply add a little Aves to the area, wet the stamp, then press it into the putty. You should have replicated the exact texture you removed, meaning you should not have to do any sanding!