I don’t do Windows, but I happily sync directories between my Android phones and my Linux PCs (especially a cloud server I lease) with rsync over ssh within Termux.

If you can set up an rsync server on Windows that should work. Besides actually implementing robust and efficient sync, rsync is also smart about platform differences.

For the specific case of Windows to Android, I’ve heard of people scripting up tools to shove all the contents of a directory over adb push.