Performance and status of Transfer Services


Table of Contents

Transfer status page

Check your network performance

  1. Using Janet Network Performance Test Facilities
  2. https://www.speedtest.net/ from Ookla
  3. https://fast.com/ from Netflix 

Check specific transfer protocols

Note: Do not use private or human data for your performance tests

Globus

  1. While you can use the Globus Tutorial Collections, they will likely be of minimal help, as the collections have a 5MB quota.
  2. The ESNet collections (list of available Guest Collections here) may be of interest, as they provide larger datasets for testing purposes; however, ESNet limits access to "Science and Engineering" networks only, depending on whether ESNet has designated you (as well as the network that the GCP Endpoint resides on) as falling in this category, the Collections may not be accessible.
     
    Speaking of ESNet, they're our go-to resource when it comes to DTN tuning and performance testing and provide some tools and guidance on testing (and tools) outside of Globus Transfers, which may be of interest as well: https://fasterdata.es.net/performance-testing/

Aspera

  1. How to transfer files to and from EMBL-EBI using IBM Aspera
  2. Ensure you don't run with the debug flag activated; it impacts performance.
  3. Follow the instructions in How to transfer files to and from EMBL-EBI using IBM Aspera
  4. https://test-connect.ibmaspera.com/
  5. Using the Aspera demo server to test your configuration: https://download.asperasoft.com/download/docs/client/3.5.6/client_admin_linux/webhelp/dita/testing_locally_initiated_transfer.html

HTTP/s

  1. For HTTP, you can use these third-party tools. 
    1. https://www.speedtest.net/ from Ookla
    2. https://fast.com/ from Netflix 
    3. https://speed.cloudflare.com/ from Cloudflare

FTP

  1. The FTP services found to benchmark the ftp performance are not too reliable; they only offer connectivity and functionality validation, but they are not in any way a performance benchmark
    1. https://dlptest.com/ftp-test/
    2. https://sftpcloud.io/tools/free-ftp-server

Rsync

  1. Like FTP, rsync tests are oriented to connectivity and functionality validation
    1. rsync -av --progress rsync://rsync.kernel.org/pub/README /dev/null

 

Other related documents