Your phone should use the SD card as a WORM drive, which shouldn’t cause too much wear. The Pi can’t do that if it’s the only storage medium present. Still, back up your stuff, just because it’s there now doesn’t mean it can’t be gone in an instant, flash storage usually does in an instant without warning