SFTP - a more secure successor to FTP
To exchange files with a server, simply use SFTP, which is part of SSH and thus the access data for SFTP is the same as for SSH.
Additionally, we do not need to install anything, everything is already ready to go on a fresh VPS, just use a client such as WinSCP (recommended) or FileZilla and use the same credentials as for SSH.