This page contains the instructions relevant for the party that wishes to provide data in SANE, a role we shall further refer to as the 'data provider'. The data provider is the only role that can upload data, give access to the data, and release output results. 

1. Accept the SANE Collaboration invite

The researcher has been given the task of initiating the request for a SANE collaboration (see Requesting a SANE project). This is done intentionally for two reasons: 1) to alleviate the effort from the data provider, 2) to make sure funding is available through the researcher (the data providers should not need to have their own budget) Once these steps are completed, you will receive an invitation to the SANE Collaboration, which you should accept.

2. Invite data provider(s)

As a data provider, you might want to add more data providers to the project. The steps to achieve this are as follows:

  1. Go to the Admins tab on your SRAM Collaboration page
  2. Click on "Invite admins"
  3. Add the e-mail address(es) of the data provider(s) in the Invitees section
  4. Make sure the Admin option is selected for the role
  5. Make sure the following groups are selected in the "Group membership":
    • src_co_admin
    • src_co_developer.
  6. Click on the Invite button

3. Prepare the upload environment

  1. Go to the SURF Research Cloud portal and log in
    Please note: If you only see messages saying ‘You need a wallet to create new workspace’, please wait a moment — Research Cloud is still syncing. This usually happens if you just accepted the collaboration and are logging in for the first time. Refresh the page after a few minutes

  2. If this is your first time using Research Cloud you will likely need to set up your Time-based One Time Password

  3. Click on the "Networks (advanced)" tab and then click on the "+" button to create a new internal network
    1. Select the Collaboration from step 1 ("Starting a Collaboration")
    2. Select in the Cloud Provider tab: "SURF HPC Cloud Network" (this step may be skipped if there's only one option)
    3. Give the network a name (e.g. SANE network) and finish the wizard

  4. Go to "Profile" → Expand the tile of the Collaboration from step 1
    1. Click on the "Secrets" tab
    2. Click on the "+" button to add a Secret with the name "SANE_SMBPW" and a random value
    3. Click on the "+" button to add a Secret with the name "SANE_SMBUSER" and a random value (the random value must comply with the standards imposed by POSIX and Ubuntu as outlined here)
    4. Go back to the homepage

  5. Click on the "Create new" button in the 'Create new storage' tile
    1. Select the Collaboration from step 1 ("Starting a Collaboration")
    2. Select in the Cloud Provider tab: "SURF HPC Cloud volume" (this step may be skipped if there's only one option)
    3. Select a flavour that is large enough to store the sensitive data (and any generated output results of the research)
    4. Give the volume a name (e.g. SANE volume) and finish the wizard

  6. Click on the "Create new" button in the 'Create new workspace' tile
    1. Search and select the "SANE Data server" catalog item
    2. In the "Options" tab select the internal network and storage you created in step 2 and step 4
    3. Finish the wizard

  7. (Optional) If you want to upload data using ResearchDrive you need to connect your Research Drive account before starting the "SANE Data Provider Portal"
    1. Connect Research Drive

  8. Once the data server is running, click on the "Create new" button in the 'Create new workspace' tile
    1. Search and select the "SANE Data Provider Portal" catalog item
    2. In the "Options" tab select the internal network you created in step 2
    3. Finish the wizard

4. (Optional) Add Python packages to Tinker SANE user workspace

Researchers often need additional packages to extend the functionality of their analysis software or to perform specific tasks. If they are using Tinker SANE, you can simplify this process by automatically installing a predefined list of Python packages in the researcher’s new environment.

We provide a default list of essential Python packages, commonly used for data analysis and scientific research. Researchers can also create their own custom lists of required packages by following the same file format.

If you decide to accept a user’s request to add a custom list of Python packages, please consult the detailed guide: Adding Python packages to Tinker SANE

We plan to introduce support for R packages by 2025, which will allow similar functionality for researchers working in R. This update will extend the flexibility of Tinker SANE environments to cover multiple programming languages.

  • Adding packages from a list is only possible in newly created Tinker SANE environments. For existing environments, you can either create a new environment or manually install the required packages (see Step 6). This limitation exists because adding packages to an existing environment might interfere with the current package setup.
  • This feature is currently only available for Tinker SANE environments and is not supported in Blind SANE environments.

To manually add Python or other programming language packages (such as R), follow the instructions outlined in Step 6 for package installation.

5. Upload the sensitive data and packages

  1. From the Research Cloud portal, log into the Data Provider Portal. There are three options: 
    • Use the "Access" button in a browser with TOTP
    • Copy the IP address to any Remote Desktop client
    • Use a terminal to log in with SSH

  2. Use the Data Provider Portal to copy sensitive data and, if applicable, data received from the researcher (which you have accepted) as well as software to the data server.
    • The SANE data server can be found in the Data Provider Portal at /data/sane-data 
      • You can copy data to the /data/sane-data/source folder
      • You can copy the software packages or scripts to the /data/sane-data/scripts folder
    • Copy the data using for example Cyberduck, rsync, or ResearchDrive (other options can be winSCP or scp on the command line)


The data is now made available in the SANE data server, which can be attached to the SANE analysis environments (either Tinker or Blind) by the researcher. The researcher will namely connect their analysis environment to the private network that was created in Step 3.

6. Invite researcher(s)

Now that the basic setup for a SANE project has been set, it is time to invite researchers who have the right to access the data in this SANE Collaboration.

  1. Go to the Members tab on your SRAM Collaboration page
  2. Click on "Invite members"
  3. Add the e-mail address(es) of the researcher(s) in the Invitees section
  4. Make sure the Member is selected for the role, and make sure no groups are selected in the "Group membership" (the groups that a Researcher belongs to will be automatically assigned)
  5. Click on the Invite button

The researchers can now follow the Researcher instructions. Go ahead and notify the researcher that the data is ready to be analysed.

7. Review output results

The researcher (in the case of Tinker SANE) or the script (in the case of Blind SANE) will place the output results in the folder located in the directory /sane-data/results  and will request the data provider to disclose the results (e.g. via e-mail). The data provider uses the SANE Data Provider Portal to review these output results. The data provider can download approved output data using the same procedure as upload data, and send them to the researcher outside of SANE (e.g. via e-mail or SURF Filesender). 


  • No labels