File transfer from and to Linux and Mac OS
From ALICE Documentation
File transfer from and to Linux and Mac OS
Before you can transfer files you need access to the ALICE file transfer node. For details on setting up ssh login, see Login to cluster. Once you have successfully set up the ssh configuration, you can use two different methods to transfer data: SCP and SFTP.
SCP file transfer
You need to know to which file systems on ALICE you want to (and are allowed to) copy your files. See the Summary of available file systems for detail on which directory structures are available to you. Once you know where to/from you want to copy data use the Unix SCP command to perform the copy operation. Note: you have successfully setup key-based authentication and made an ssh configuration hostname hpc1:
scp <local_file_name> hpc1:/data/<username>/
where you have previously created a directory on the /data file system
mkdir /data/<username>
where <username> is your account name. This copies a local file to ALICE. To copy a file on an ALICE file system back to your local desktop or storage medium use:
scp hpc1:/data<username>/<remote-file-name> .
where the . is representing the current directory. For more details on how to use scp te:
man scp
SFTP file transfer
Data can also be transferred using the sftp copy program. Again we presume you have successfully configured the ssh login with key based authentication. In that case you can simply type:
$ sftp hpc1: ############################################################# Welkom bij de SSH Gateway van de Universiteit Leiden Deze gateway dient slechts als SSH toegang tot achterliggende systemen. Oneigenlijk gebruik van deze server kan leiden tot het ontzeggen van toegang. Welcome to the SSH Gateway of the University of Leiden The only purpose of this gateway is SSH access to other systems. Improper use can lead to denial of access. N.B. Public Key authentication and more is possible, see for this SSH-README.txt Use screen at the destination. Voor vragen/For questions: issc.leidenuniv.nl
############################################################# Connected to hpc1. Changing to: /home/deuler/. sftp>
We can then use various commands to traverse and manipulate both file systems. A list of commands are listed below:
Command | Function | Example |
---|---|---|
cd | Changes the directory of the remote computer | cd remote_directory |
lcd | Changes the directory of the local computer | lcd local_directory |
ls | Lists the contents of the remote directory | ls |
lls | Lists the contents of the local directory | lls |
pwd | Prints working directory of the remote computer | pwd |
lpwd | Prints working directory of the local computer | lpwd |
get | Copies a file from the remote directory to the local directory | get remote_file |
put | Copies a file from the local directory to the remote directory | put local_file |
exit | Closes the connection to the remote computer and exits the program | exit |
help | Displays application information on using commands | help |