学习
路无止境!

没有伞的孩子要学会努力奔跑!


  • 首页

  • 归档

  • 关于我

  • 公益404

  • 搜索

AzCopy Test

  • Blob bw Regions test

    e6ee24019153b3c3724fd82996b3c100.jpeg

    序号说明测试 1测试 2测试 3平均值
    1EA client → SA Container0.23340.2334
    2SA Container → EU client1.02631.26751.01481.10286667
    3SA Container → EU client @ peer created1.12091.24491.14831.17136667
    4SA Container → EU Container4.16814.3354.63514.3794
    2 Hours Later1.43381.86731.65055
    5EU Contaner → SA Container1.00030.93360.96695
    6EU client → EU Container0.7670.76690.7670.76696667
    7EU Container → EU Client, VM disk iops limited0.88140.8814
    8EA client →EU Container0.53350.70020.61685
    9EU container → EA container0.40010.4001

    结论:

    1. Client 跨Region 获取 Container 中文件,在 Blog 选择微软内网优先的情况下,Region间是否使用 Peer 对等对传输效率基本无影响;
    2. Container 的文件直接跨 Region 传输效率与选择的 Region以及时机/方向 有关,一段时间保持稳定;
    3. 同 Region 传输效率高;
    • 原始数据
      1. EA client → SA Container

        root@ubuntu0:/home/zyi# azcopy copy 1.zip https://sastorageac0.blob.core.windows.net/sacontainer
        INFO: Scanning...
        INFO: Autologin not specified.
        INFO: Authenticating to destination using Azure AD
        INFO: Any empty folders will not be processed, because source and/or destination doesn't have full folder support
        
        Job f631ebf2-8060-6b47-7164-58044ee0c43c has started
        Log file is located at: /root/.azcopy/f631ebf2-8060-6b47-7164-58044ee0c43c.log
        
        100.0 %, 1 Done, 0 Failed, 0 Pending, 0 Skipped, 1 Total,                                   
        
        Job f631ebf2-8060-6b47-7164-58044ee0c43c summary
        Elapsed Time (Minutes): 0.2334
        Number of File Transfers: 1
        Number of Folder Property Transfers: 0
        Number of Symlink Transfers: 0
        Total Number of Transfers: 1
        Number of File Transfers Completed: 1
        Number of Folder Transfers Completed: 0
        Number of File Transfers Failed: 0
        Number of Folder Transfers Failed: 0
        Number of File Transfers Skipped: 0
        Number of Folder Transfers Skipped: 0
        TotalBytesTransferred: 10519930170
        Final Job Status: Completed
        
      2. SA Container → EU client

        root@eu-ubuntu0:/home/zyi# azcopy copy https://sastorageac0.blob.core.windows.net/sacontainer/1.zip .
        INFO: Scanning...
        INFO: Autologin not specified.
        INFO: Authenticating to source using Azure AD
        INFO: Any empty folders will not be processed, because source and/or destination doesn't have full folder support
        
        Job bf9d0ff0-6066-2140-4cb9-8716e4272028 has started
        Log file is located at: /root/.azcopy/bf9d0ff0-6066-2140-4cb9-8716e4272028.log
        
        0.0 %, 0 Done, 0 Failed, 1 Pending, 0 Skipped, 1 Total, 2-sec Throughput (Mb/s):0.0 %, 0 Done, 0 Failed, 1 Pending, 0 Skipped, 1 Total,                         2.1 %, 0 Done, 0 Failed, 1 Pending, 0 Skipped, 1 Total, 2-sec Throughput (Mb/s):6.2 %, 0 Done, 0 Failed, 1 Pending, 0 Skipped, 1 Total, 2-sec Throughput (Mb/s):11.0 %, 0 Done, 0 Failed, 1 Pending, 0 Skipped, 1 Total, 2-sec Throughput (Mb/s)15.9 %, 0 Done, 0 Failed, 1 Pending, 0 Skipped, 1 Total, 2-sec Throughput (Mb/s)20.3 %, 0 Done, 0 Failed, 1 Pending, 0 Skipped, 1 Total, 2-sec Throughput (Mb/s)24.6 %, 0 Done, 0 Failed, 1 Pending, 0 Skipped, 1 Total, 2-sec Throughput (Mb/s)29.1 %, 0 Done, 0 Failed, 1 Pending, 0 Skipped, 1 Total, 2-sec Throughput (Mb/s)33.7 %, 0 Done, 0 Failed, 1 Pending, 0 Skipped, 1 Total, 2-sec Throughput (Mb/s)38.4 %, 0 Done, 0 Failed, 1 Pending, 0 Skipped, 1 Total, 2-sec Throughput (Mb/s)42.4 %, 0 Done, 0 Failed, 1 Pending, 0 Skipped, 1 Total, 2-sec Throughput (Mb/s)46.9 %, 0 Done, 0 Failed, 1 Pending, 0 Skipped, 1 Total, 2-sec Throughput (Mb/s)51.4 %, 0 Done, 0 Failed, 1 Pending, 0 Skipped, 1 Total, 2-sec Throughput (Mb/s)55.3 %, 0 Done, 0 Failed, 1 Pending, 0 Skipped, 1 Total, 2-sec Throughput (Mb/s)59.7 %, 0 Done, 0 Failed, 1 Pending, 0 Skipped, 1 Total, 2-sec Throughput (Mb/s)64.4 %, 0 68.9 %, 0 Done, 0 Failed, 1 Pending, 0 Skipped, 1 Total, 2-sec Throughput (Mb/s): 1710.624 (Disk may be l73.4 %, 0 Done, 0 Failed, 1 Pending, 0 Skipped, 1 Total, 2-sec Throughput (Mb/s): 1845.0545 (77.3 %, 0 Done, 0 Failed, 1 Pending, 0 Skipped, 1 Total, 2-sec Throughput (Mb/s): 1440.6049  82.5 %, 0 Done, 0 Failed, 1 Pending, 0 Skipped, 1 Total, 100.0 %, 1 Done, 0 Failed, 0 Pending, 0 Skipped, 1 Total,                                                               
        
        Job bf9d0ff0-6066-2140-4cb9-8716e4272028 summary
        Elapsed Time (Minutes): 1.0263
        Number of File Transfers: 1
        Number of Folder Property Transfers: 0
        Number of Symlink Transfers: 0
        Total Number of Transfers: 1
        Number of File Transfers Completed: 1
        Number of Folder Transfers Completed: 0
        Number of File Transfers Failed: 0
        Number of Folder Transfers Failed: 0
        Number of File Transfers Skipped: 0
        Number of Folder Transfers Skipped: 0
        TotalBytesTransferred: 10519930170
        Final Job Status: Completed
        
        #download 2
        
        root@eu-ubuntu0:/home/zyi# azcopy copy https://sastorageac0.blob.core.windows.net/sacontainer/1.zip .
        INFO: Scanning...
        INFO: Autologin not specified.
        INFO: Authenticating to source using Azure AD
        INFO: Any empty folders will not be processed, because source and/or destination doesn't have full folder support
        
        Job 732e37c9-9e99-364a-4a4e-fa7484fac927 has started
        Log file is located at: /root/.azcopy/732e37c9-9e99-364a-4a4e-fa7484fac927.log
        
        100.0 %, 1 Done, 0 Failed, 0 Pending, 0 Skipped, 1 Total,                                  
        
        Job 732e37c9-9e99-364a-4a4e-fa7484fac927 summary
        Elapsed Time (Minutes): 1.2675
        Number of File Transfers: 1
        Number of Folder Property Transfers: 0
        Number of Symlink Transfers: 0
        Total Number of Transfers: 1
        Number of File Transfers Completed: 1
        Number of Folder Transfers Completed: 0
        Number of File Transfers Failed: 0
        Number of Folder Transfers Failed: 0
        Number of File Transfers Skipped: 0
        Number of Folder Transfers Skipped: 0
        TotalBytesTransferred: 10519930170
        Final Job Status: Completed
        
        #download 3
        ^[[Aroot@eu-ubuntu0:/home/zyi# azcopy copy https://sastorageac0.blob.core.windows.net/sacontainer/1.zip .
        INFO: Scanning...
        INFO: Autologin not specified.
        INFO: Authenticating to source using Azure AD
        INFO: Any empty folders will not be processed, because source and/or destination doesn't have full folder support
        
        Job 05c9210a-e503-c046-6f9b-853d6c9a3c4e has started
        Log file is located at: /root/.azcopy/05c9210a-e503-c046-6f9b-853d6c9a3c4e.log
        
        100.0 %, 1 Done, 0 Failed, 0 Pending, 0 Skipped, 1 Total,                                                               
        
        Job 05c9210a-e503-c046-6f9b-853d6c9a3c4e summary
        Elapsed Time (Minutes): 1.0148
        Number of File Transfers: 1
        Number of Folder Property Transfers: 0
        Number of Symlink Transfers: 0
        Total Number of Transfers: 1
        Number of File Transfers Completed: 1
        Number of Folder Transfers Completed: 0
        Number of File Transfers Failed: 0
        Number of Folder Transfers Failed: 0
        Number of File Transfers Skipped: 0
        Number of Folder Transfers Skipped: 0
        TotalBytesTransferred: 10519930170
        Final Job Status: Completed
        
      3. SA Container → EU client @ peer created

        root@eu-ubuntu0:/home/zyi# azcopy copy https://sastorageac0.blob.core.windows.net/sacontainer/1.zip .
        INFO: Scanning...
        INFO: Autologin not specified.
        INFO: Authenticating to source using Azure AD
        INFO: Any empty folders will not be processed, because source and/or destination doesn't have full folder support
        
        Job b1d8da46-9358-6b4c-66d4-bb8cb8d53e1f has started
        Log file is located at: /root/.azcopy/b1d8da46-9358-6b4c-66d4-bb8cb8d53e1f.log
        
        100.0 %, 1 Done, 0 Failed, 0 Pending, 0 Skipped, 1 Total,                                  
        
        Job b1d8da46-9358-6b4c-66d4-bb8cb8d53e1f summary
        Elapsed Time (Minutes): 1.1209
        Number of File Transfers: 1
        Number of Folder Property Transfers: 0
        Number of Symlink Transfers: 0
        Total Number of Transfers: 1
        Number of File Transfers Completed: 1
        Number of Folder Transfers Completed: 0
        Number of File Transfers Failed: 0
        Number of Folder Transfers Failed: 0
        Number of File Transfers Skipped: 0
        Number of Folder Transfers Skipped: 0
        TotalBytesTransferred: 10519930170
        Final Job Status: Completed
        
        #2
        root@eu-ubuntu0:/home/zyi# azcopy copy https://sastorageac0.blob.core.windows.net/sacontainer/1.zip .
        INFO: Scanning...
        INFO: Autologin not specified.
        INFO: Authenticating to source using Azure AD
        INFO: Any empty folders will not be processed, because source and/or destination doesn't have full folder support
        
        Job b646e5c1-af07-6c41-7a0c-641ecfd5d1cd has started
        Log file is located at: /root/.azcopy/b646e5c1-af07-6c41-7a0c-641ecfd5d1cd.log
        
        100.0 %, 1 Done, 0 Failed, 0 Pending, 0 Skipped, 1 Total,                                  
        
        Job b646e5c1-af07-6c41-7a0c-641ecfd5d1cd summary
        Elapsed Time (Minutes): 1.2449
        Number of File Transfers: 1
        Number of Folder Property Transfers: 0
        Number of Symlink Transfers: 0
        Total Number of Transfers: 1
        Number of File Transfers Completed: 1
        Number of Folder Transfers Completed: 0
        Number of File Transfers Failed: 0
        Number of Folder Transfers Failed: 0
        Number of File Transfers Skipped: 0
        Number of Folder Transfers Skipped: 0
        TotalBytesTransferred: 10519930170
        Final Job Status: Completed
        
        root@eu-ubuntu0:/home/zyi# azcopy copy https://sastorageac0.blob.core.windows.net/sacontainer/1.zip .
        INFO: Scanning...
        INFO: Autologin not specified.
        INFO: Authenticating to source using Azure AD
        INFO: Any empty folders will not be processed, because source and/or destination doesn't have full folder support
        
        Job 30f70c4e-fdd1-9a4b-6e89-c5e7406970de has started
        Log file is located at: /root/.azcopy/30f70c4e-fdd1-9a4b-6e89-c5e7406970de.log
        
        100.0 %, 1 Done, 0 Failed, 0 Pending, 0 Skipped, 1 Total,                                                               
        
        Job 30f70c4e-fdd1-9a4b-6e89-c5e7406970de summary
        Elapsed Time (Minutes): 1.1483
        Number of File Transfers: 1
        Number of Folder Property Transfers: 0
        Number of Symlink Transfers: 0
        Total Number of Transfers: 1
        Number of File Transfers Completed: 1
        Number of Folder Transfers Completed: 0
        Number of File Transfers Failed: 0
        Number of Folder Transfers Failed: 0
        Number of File Transfers Skipped: 0
        Number of Folder Transfers Skipped: 0
        TotalBytesTransferred: 10519930170
        Final Job Status: Completed
        
      4. SA Container → EU Container

        root@eu-ubuntu0:/home/zyi# azcopy copy https://sastorageac0.blob.core.windows.net/sacontainer/1.zip https://eustorageac0.blob.core.windows.net/eucontainer/1.zip 
        INFO: Scanning...
        INFO: Autologin not specified.
        INFO: Authenticating to destination using Azure AD
        INFO: Authenticating to source using Azure AD
        INFO: Any empty folders will not be processed, because source and/or destination doesn't have full folder support
        
        Job 9168f92f-2da4-6742-6862-8e5696b52a41 has started
        Log file is located at: /root/.azcopy/9168f92f-2da4-6742-6862-8e5696b52a41.log
        
        INFO: Transfers could fail because AzCopy could not verify if the destination supports tiers.
        100.0 %, 1 Done, 0 Failed, 0 Pending, 0 Skipped, 1 Total, 
        
        Job 9168f92f-2da4-6742-6862-8e5696b52a41 summary
        Elapsed Time (Minutes): 4.1681
        Number of File Transfers: 1
        Number of Folder Property Transfers: 0
        Number of Symlink Transfers: 0
        Total Number of Transfers: 1
        Number of File Transfers Completed: 1
        Number of Folder Transfers Completed: 0
        Number of File Transfers Failed: 0
        Number of Folder Transfers Failed: 0
        Number of File Transfers Skipped: 0
        Number of Folder Transfers Skipped: 0
        TotalBytesTransferred: 10519930170
        Final Job Status: Completed
        
        root@eu-ubuntu0:/home/zyi# azcopy copy https://sastorageac0.blob.core.windows.net/sacontainer/1.zip https://eustorageac0.blob.core.windows.net/eucontainer/10.zip 
        INFO: Scanning...
        INFO: Autologin not specified.
        INFO: Authenticating to destination using Azure AD
        INFO: Authenticating to source using Azure AD
        INFO: Any empty folders will not be processed, because source and/or destination doesn't have full folder support
        
        Job 7cca86e8-11b6-164d-7b33-887d9cf10183 has started
        Log file is located at: /root/.azcopy/7cca86e8-11b6-164d-7b33-887d9cf10183.log
        
        INFO: Transfers could fail because AzCopy could not verify if the destination supports tiers.
        100.0 %, 1 Done, 0 Failed, 0 Pending, 0 Skipped, 1 Total, 
        
        Job 7cca86e8-11b6-164d-7b33-887d9cf10183 summary
        Elapsed Time (Minutes): 4.335
        Number of File Transfers: 1
        Number of Folder Property Transfers: 0
        Number of Symlink Transfers: 0
        Total Number of Transfers: 1
        Number of File Transfers Completed: 1
        Number of Folder Transfers Completed: 0
        Number of File Transfers Failed: 0
        Number of Folder Transfers Failed: 0
        Number of File Transfers Skipped: 0
        Number of Folder Transfers Skipped: 0
        TotalBytesTransferred: 10519930170
        Final Job Status: Completed
        
        #3
        root@eu-ubuntu0:/home/zyi# azcopy copy https://sastorageac0.blob.core.windows.net/sacontainer/1.zip https://eustorageac0.blob.core.windows.net/eucontainer/1.zip 
        INFO: Scanning...
        INFO: Autologin not specified.
        INFO: Authenticating to destination using Azure AD
        INFO: Authenticating to source using Azure AD
        INFO: Any empty folders will not be processed, because source and/or destination doesn't have full folder support
        
        Job c4366598-5822-b946-45b9-6ee9d6f6df15 has started
        Log file is located at: /root/.azcopy/c4366598-5822-b946-45b9-6ee9d6f6df15.log
        
        INFO: Transfers could fail because AzCopy could not verify if the destination supports tiers.
        100.0 %, 1 Done, 0 Failed, 0 Pending, 0 Skipped, 1 Total, 
        
        Job c4366598-5822-b946-45b9-6ee9d6f6df15 summary
        Elapsed Time (Minutes): 4.6351
        Number of File Transfers: 1
        Number of Folder Property Transfers: 0
        Number of Symlink Transfers: 0
        Total Number of Transfers: 1
        Number of File Transfers Completed: 1
        Number of Folder Transfers Completed: 0
        Number of File Transfers Failed: 0
        Number of Folder Transfers Failed: 0
        Number of File Transfers Skipped: 0
        Number of Folder Transfers Skipped: 0
        TotalBytesTransferred: 10519930170
        Final Job Status: Completed
        
        #4
        root@ubuntu0:/home/zyi# azcopy copy https://sastorageac0.blob.core.windows.net/sacontainer/1.zip https://eustorageac0.blob.core.windows.net/eucontainer/1.zip
        INFO: Scanning...
        INFO: Autologin not specified.
        INFO: Authenticating to destination using Azure AD
        INFO: Authenticating to source using Azure AD
        INFO: Any empty folders will not be processed, because source and/or destination doesn't have full folder support
        
        Job 15fe8cca-78c3-3d40-4a55-e90d11495258 has started
        Log file is located at: /root/.azcopy/15fe8cca-78c3-3d40-4a55-e90d11495258.log
        
        INFO: Transfers could fail because AzCopy could not verify if the destination supports tiers.
        100.0 %, 1 Done, 0 Failed, 0 Pending, 0 Skipped, 1 Total, 
        
        Job 15fe8cca-78c3-3d40-4a55-e90d11495258 summary
        Elapsed Time (Minutes): 1.4338
        Number of File Transfers: 1
        Number of Folder Property Transfers: 0
        Number of Symlink Transfers: 0
        Total Number of Transfers: 1
        Number of File Transfers Completed: 1
        Number of Folder Transfers Completed: 0
        Number of File Transfers Failed: 0
        Number of Folder Transfers Failed: 0
        Number of File Transfers Skipped: 0
        Number of Folder Transfers Skipped: 0
        TotalBytesTransferred: 10519930170
        Final Job Status: Completed
        
        #5
        root@ubuntu0:/home/zyi# azcopy copy https://sastorageac0.blob.core.windows.net/sacontainer/1.zip https://eustorageac0.blob.core.windows.net/eucontainer/1.zip
        INFO: Scanning...
        INFO: Autologin not specified.
        INFO: Authenticating to destination using Azure AD
        INFO: Authenticating to source using Azure AD
        INFO: Any empty folders will not be processed, because source and/or destination doesn't have full folder support
        
        Job 2ac14c6f-f943-9c4b-7477-6947fd59ab31 has started
        Log file is located at: /root/.azcopy/2ac14c6f-f943-9c4b-7477-6947fd59ab31.log
        
        INFO: Transfers could fail because AzCopy could not verify if the destination supports tiers.
        100.0 %, 1 Done, 0 Failed, 0 Pending, 0 Skipped, 1 Total, 
        
        Job 2ac14c6f-f943-9c4b-7477-6947fd59ab31 summary
        Elapsed Time (Minutes): 1.8673
        Number of File Transfers: 1
        Number of Folder Property Transfers: 0
        Number of Symlink Transfers: 0
        Total Number of Transfers: 1
        Number of File Transfers Completed: 1
        Number of Folder Transfers Completed: 0
        Number of File Transfers Failed: 0
        Number of Folder Transfers Failed: 0
        Number of File Transfers Skipped: 0
        Number of Folder Transfers Skipped: 0
        TotalBytesTransferred: 10519930170
        Final Job Status: Completed
        
      5. EU Contaner → SA Container

        root@ubuntu0:/home/zyi# azcopy copy https://eustorageac0.blob.core.windows.net/eucontainer/10.zip https://sastorageac0.blob.core.windows.net/sacontainer
        INFO: Scanning...
        INFO: Autologin not specified.
        INFO: Authenticating to destination using Azure AD
        INFO: Authenticating to source using Azure AD
        INFO: Any empty folders will not be processed, because source and/or destination doesn't have full folder support
        
        Job 8b6f339f-e23b-2f4e-755c-8bd336942b40 has started
        Log file is located at: /root/.azcopy/8b6f339f-e23b-2f4e-755c-8bd336942b40.log
        
        INFO: Transfers could fail because AzCopy could not verify if the destination supports tiers.
        100.0 %, 1 Done, 0 Failed, 0 Pending, 0 Skipped, 1 Total, 
        
        Job 8b6f339f-e23b-2f4e-755c-8bd336942b40 summary
        Elapsed Time (Minutes): 1.0003
        Number of File Transfers: 1
        Number of Folder Property Transfers: 0
        Number of Symlink Transfers: 0
        Total Number of Transfers: 1
        Number of File Transfers Completed: 1
        Number of Folder Transfers Completed: 0
        Number of File Transfers Failed: 0
        Number of Folder Transfers Failed: 0
        Number of File Transfers Skipped: 0
        Number of Folder Transfers Skipped: 0
        TotalBytesTransferred: 10519930170
        Final Job Status: Completed
        
        #2
        root@ubuntu0:/home/zyi# azcopy copy https://eustorageac0.blob.core.windows.net/eucontainer/10.zip https://sastorageac0.blob.core.windows.net/sacontainer/1.zip
        INFO: Scanning...
        INFO: Autologin not specified.
        INFO: Authenticating to destination using Azure AD
        INFO: Authenticating to source using Azure AD
        INFO: Any empty folders will not be processed, because source and/or destination doesn't have full folder support
        
        Job 0c1039f0-7a9f-0e44-6a42-079c03708fb8 has started
        Log file is located at: /root/.azcopy/0c1039f0-7a9f-0e44-6a42-079c03708fb8.log
        
        INFO: Transfers could fail because AzCopy could not verify if the destination supports tiers.
        100.0 %, 1 Done, 0 Failed, 0 Pending, 0 Skipped, 1 Total, 
        
        Job 0c1039f0-7a9f-0e44-6a42-079c03708fb8 summary
        Elapsed Time (Minutes): 0.9336
        Number of File Transfers: 1
        Number of Folder Property Transfers: 0
        Number of Symlink Transfers: 0
        Total Number of Transfers: 1
        Number of File Transfers Completed: 1
        Number of Folder Transfers Completed: 0
        Number of File Transfers Failed: 0
        Number of Folder Transfers Failed: 0
        Number of File Transfers Skipped: 0
        Number of Folder Transfers Skipped: 0
        TotalBytesTransferred: 10519930170
        Final Job Status: Completed
        
      6. EU client → EU Container

        root@eu-ubuntu0:/home/zyi# azcopy copy 1.zip https://eustorageac0.blob.core.windows.net/eucontainer/1.zip 
        INFO: Scanning...
        INFO: Autologin not specified.
        INFO: Authenticating to destination using Azure AD
        INFO: Any empty folders will not be processed, because source and/or destination doesn't have full folder support
        
        Job d3bdc10a-4142-8b41-7f9a-752c840c5f36 has started
        Log file is located at: /root/.azcopy/d3bdc10a-4142-8b41-7f9a-752c840c5f36.log
        
        100.0 %, 1 Done, 0 Failed, 0 Pending, 0 Skipped, 1 Total, 2-sec Throughput (Mb/s): 623.3303
        
        Job d3bdc10a-4142-8b41-7f9a-752c840c5f36 summary
        Elapsed Time (Minutes): 0.767
        Number of File Transfers: 1
        Number of Folder Property Transfers: 0
        Number of Symlink Transfers: 0
        Total Number of Transfers: 1
        Number of File Transfers Completed: 1
        Number of Folder Transfers Completed: 0
        Number of File Transfers Failed: 0
        Number of Folder Transfers Failed: 0
        Number of File Transfers Skipped: 0
        Number of Folder Transfers Skipped: 0
        TotalBytesTransferred: 10519930170
        Final Job Status: Completed
        
        #2
        root@eu-ubuntu0:/home/zyi# azcopy copy 1.zip https://eustorageac0.blob.core.windows.net/eucontainer/1.zip 
        INFO: Scanning...
        INFO: Autologin not specified.
        INFO: Authenticating to destination using Azure AD
        INFO: Any empty folders will not be processed, because source and/or destination doesn't have full folder support
        
        Job 3018151c-c777-ca42-4054-7f980de47650 has started
        Log file is located at: /root/.azcopy/3018151c-c777-ca42-4054-7f980de47650.log
        
        100.0 %, 1 Done, 0 Failed, 0 Pending, 0 Skipped, 1 Total, 2-sec Throughput (Mb/s): 598.946 
        
        Job 3018151c-c777-ca42-4054-7f980de47650 summary
        Elapsed Time (Minutes): 0.7669
        Number of File Transfers: 1
        Number of Folder Property Transfers: 0
        Number of Symlink Transfers: 0
        Total Number of Transfers: 1
        Number of File Transfers Completed: 1
        Number of Folder Transfers Completed: 0
        Number of File Transfers Failed: 0
        Number of Folder Transfers Failed: 0
        Number of File Transfers Skipped: 0
        Number of Folder Transfers Skipped: 0
        TotalBytesTransferred: 10519930170
        Final Job Status: Completed
        
        #3
        root@eu-ubuntu0:/home/zyi# azcopy copy 1.zip https://eustorageac0.blob.core.windows.net/eucontainer/1.zip 
        INFO: Scanning...
        INFO: Autologin not specified.
        INFO: Authenticating to destination using Azure AD
        INFO: Any empty folders will not be processed, because source and/or destination doesn't have full folder support
        
        Job 33cf320d-94a5-aa48-5a35-b94d34cf5cc1 has started
        Log file is located at: /root/.azcopy/33cf320d-94a5-aa48-5a35-b94d34cf5cc1.log
        
        100.0 %, 1 Done, 0 Failed, 0 Pending, 0 Skipped, 1 Total, 2-sec Throughput (Mb/s): 579.6335
        
        Job 33cf320d-94a5-aa48-5a35-b94d34cf5cc1 summary
        Elapsed Time (Minutes): 0.767
        Number of File Transfers: 1
        Number of Folder Property Transfers: 0
        Number of Symlink Transfers: 0
        Total Number of Transfers: 1
        Number of File Transfers Completed: 1
        Number of Folder Transfers Completed: 0
        Number of File Transfers Failed: 0
        Number of Folder Transfers Failed: 0
        Number of File Transfers Skipped: 0
        Number of Folder Transfers Skipped: 0
        TotalBytesTransferred: 10519930170
        Final Job Status: Completed
        
      7. EU Container → EU Client, VM disk iops limited

        root@eu-ubuntu0:/home/zyi# azcopy copy  https://eustorageac0.blob.core.windows.net/eucontainer/1.zip 10.zip
        INFO: Scanning...
        INFO: Autologin not specified.
        INFO: Authenticating to source using Azure AD
        INFO: Any empty folders will not be processed, because source and/or destination doesn't have full folder support
        
        Job 038b5c4a-7376-094d-4e7c-c958e15378f8 has started
        Log file is located at: /root/.azcopy/038b5c4a-7376-094d-4e7c-c958e15378f8.log
        
        100.0 %, 1 Done, 0 Failed, 0 Pending, 0 Skipped, 1 Total,                                                               
        
        Job 038b5c4a-7376-094d-4e7c-c958e15378f8 summary
        Elapsed Time (Minutes): 0.8814
        Number of File Transfers: 1
        Number of Folder Property Transfers: 0
        Number of Symlink Transfers: 0
        Total Number of Transfers: 1
        Number of File Transfers Completed: 1
        Number of Folder Transfers Completed: 0
        Number of File Transfers Failed: 0
        Number of Folder Transfers Failed: 0
        Number of File Transfers Skipped: 0
        Number of Folder Transfers Skipped: 0
        TotalBytesTransferred: 10519930170
        Final Job Status: Completed
        
      8. EA client →EU Container

        root@ubuntu0:/home/zyi# azcopy copy  1.zip https://eustorageac0.blob.core.windows.net/eucontainer
        INFO: Scanning...
        INFO: Autologin not specified.
        INFO: Authenticating to destination using Azure AD
        INFO: Any empty folders will not be processed, because source and/or destination doesn't have full folder support
        
        Job e197a453-cd7d-9042-53bc-de6c0e26246c has started
        Log file is located at: /root/.azcopy/e197a453-cd7d-9042-53bc-de6c0e26246c.log
        
        100.0 %, 1 Done, 0 Failed, 0 Pending, 0 Skipped, 1 Total,                                  
        
        Job e197a453-cd7d-9042-53bc-de6c0e26246c summary
        Elapsed Time (Minutes): 0.5335
        Number of File Transfers: 1
        Number of Folder Property Transfers: 0
        Number of Symlink Transfers: 0
        Total Number of Transfers: 1
        Number of File Transfers Completed: 1
        Number of Folder Transfers Completed: 0
        Number of File Transfers Failed: 0
        Number of Folder Transfers Failed: 0
        Number of File Transfers Skipped: 0
        Number of Folder Transfers Skipped: 0
        TotalBytesTransferred: 10519930170
        Final Job Status: Completed
        
        #2
        root@ubuntu0:/home/zyi# azcopy copy  1.zip https://eustorageac0.blob.core.windows.net/eucontainer/10.zip
        INFO: Scanning...
        INFO: Autologin not specified.
        INFO: Authenticating to destination using Azure AD
        INFO: Any empty folders will not be processed, because source and/or destination doesn't have full folder support
        
        Job 6b1b50a2-3c6c-9c45-5165-085514255e76 has started
        Log file is located at: /root/.azcopy/6b1b50a2-3c6c-9c45-5165-085514255e76.log
        
        100.0 %, 1 Done, 0 Failed, 0 Pending, 0 Skipped, 1 Total,                                  
        
        Job 6b1b50a2-3c6c-9c45-5165-085514255e76 summary
        Elapsed Time (Minutes): 0.7002
        Number of File Transfers: 1
        Number of Folder Property Transfers: 0
        Number of Symlink Transfers: 0
        Total Number of Transfers: 1
        Number of File Transfers Completed: 1
        Number of Folder Transfers Completed: 0
        Number of File Transfers Failed: 0
        Number of Folder Transfers Failed: 0
        Number of File Transfers Skipped: 0
        Number of Folder Transfers Skipped: 0
        TotalBytesTransferred: 10519930170
        Final Job Status: Completed
        
      9. EU container → EA container

        root@ubuntu0:/home/zyi# azcopy copy https://eustorageac0.blob.core.windows.net/eucontainer/10.zip https://eastorageaccountpg.blob.core.windows.net/blog-pg
        INFO: Scanning...
        INFO: Autologin not specified.
        INFO: Authenticating to destination using Azure AD
        INFO: Authenticating to source using Azure AD
        INFO: Any empty folders will not be processed, because source and/or destination doesn't have full folder support
        
        Job 04a69131-382f-3741-4263-c81b6e28c27e has started
        Log file is located at: /root/.azcopy/04a69131-382f-3741-4263-c81b6e28c27e.log
        
        INFO: Transfers could fail because AzCopy could not verify if the destination supports tiers.
        100.0 %, 1 Done, 0 Failed, 0 Pending, 0 Skipped, 1 Total, 
        
        Job 04a69131-382f-3741-4263-c81b6e28c27e summary
        Elapsed Time (Minutes): 0.4001
        Number of File Transfers: 1
        Number of Folder Property Transfers: 0
        Number of Symlink Transfers: 0
        Total Number of Transfers: 1
        Number of File Transfers Completed: 1
        Number of Folder Transfers Completed: 0
        Number of File Transfers Failed: 0
        Number of Folder Transfers Failed: 0
        Number of File Transfers Skipped: 0
        Number of Folder Transfers Skipped: 0
        TotalBytesTransferred: 10519930170
        Final Job Status: Completed
        
  • AzCopy Sync 使用

    2f9a311157ef2d7218ffe93e63fddaf2.jpeg

      1. azcopy sync,Client local Dir → EU:Blob/container/dir
      • Client未登录 Azure
      • blob 的 container 生成共享访问令牌,注意权限选择

      Untitled

      • Client 执行 azcopy sync 命令with SAS

        root@ubuntu0:~# azcopy sync "./blog/" "https://eustoragesacc0.blob.core.windows.net/eucontainer?sp=racwdlep&st=2023-07-21T12:27:30Z&se=2023-07-21T20:27:30Z&spr=https&sv=2022-11-02&sr=c&sig=edSES09iSGU1xChuOAJnEKNrTJ1xbk0pR97aO%2FA0boE%3D"
        INFO: Any empty folders will not be processed, because source and/or destination doesn't have full folder support
        
        Job e08f5117-f8b7-314d-5aa3-3f22b0fdf82b has started
        Log file is located at: /root/.azcopy/e08f5117-f8b7-314d-5aa3-3f22b0fdf82b.log
        
        100.0 %, 2 Done, 0 Failed, 0 Pending, 2 Total, 2-sec Throughput (Mb/s): 0.6465
        
        Job e08f5117-f8b7-314d-5aa3-3f22b0fdf82b Summary
        Files Scanned at Source: 2
        Files Scanned at Destination: 0
        Elapsed Time (Minutes): 0.0667
        Number of Copy Transfers for Files: 2
        Number of Copy Transfers for Folder Properties: 0 
        Total Number Of Copy Transfers: 2
        Number of Copy Transfers Completed: 2
        Number of Copy Transfers Failed: 0
        Number of Deletions at Destination: 0
        Total Number of Bytes Transferred: 423810
        Total Number of Bytes Enumerated: 423810
        Final Job Status: Completed
        
      • 查看 Blob 情况

        Untitled

      1. EA:blob/container/dir → EU:blob/container/dir
      • ea 源生成 SAS,注意权限

      Untitled

      • Client 执行 azcopy sync 命令with SAS

        root@ubuntu0:~# azcopy sync "https://eastorageacc0.blob.core.windows.net/eacontainer/sync/?sp=rle&st=2023-07-21T12:42:42Z&se=2023-07-21T20:42:42Z&spr=https&sv=2022-11-02&sr=c&sig=%2FZzdp1B5dpZzTGT3PlwhssFKnipWkgp%2BBpOIqo9t1mY%3D" "https://eustoragesacc0.blob.core.windows.net/eucontainer/sync/?sp=racwdlep&st=2023-07-21T12:27:30Z&se=2023-07-21T20:27:30Z&spr=https&sv=2022-11-02&sr=c&sig=edSES09iSGU1xChuOAJnEKNrTJ1xbk0pR97aO%2FA0boE%3D"
        INFO: Any empty folders will not be processed, because source and/or destination doesn't have full folder support
        
        Job 747202e5-1afc-b846-4388-9e2e4eee6c58 has started
        Log file is located at: /root/.azcopy/747202e5-1afc-b846-4388-9e2e4eee6c58.log
        
        100.0 %, 3 Done, 0 Failed, 0 Pending, 3 Total, 2-sec Throughput (Mb/s): 0   
        
        Job 747202e5-1afc-b846-4388-9e2e4eee6c58 Summary
        Files Scanned at Source: 3
        Files Scanned at Destination: 0
        Elapsed Time (Minutes): 0.1
        Number of Copy Transfers for Files: 3
        Number of Copy Transfers for Folder Properties: 0 
        Total Number Of Copy Transfers: 3
        Number of Copy Transfers Completed: 3
        Number of Copy Transfers Failed: 0
        Number of Deletions at Destination: 0
        Total Number of Bytes Transferred: 847620
        Total Number of Bytes Enumerated: 847620
        Final Job Status: Completed
        
      • 查看 Blob 情况

        Untitled

  • AzCopy copy 示例

    azcopy copy "https://eascc20230728.blob.core.windows.net/local/1.txt?sp=racwli&st=2023-07-31T03:54:41Z&se=2023-08-31T11:54:41Z&spr=https&sv=2022-11-02&sr=c&sig=hRxFYgG3chofx1WUwlb0ji5wPuI%2BgA31DxUNZlPjAW4%3D" ./1.txt
    
    • 加上 token 要使用“”
    • https://eascc20230728.blob.core.windows.net/local/1.txt 具体的 blob 还是目录要指定清楚
  • 文章目录
  • 站点概览
Etaon

Etaon

Kepp Going!

80 日志
15 分类
43 标签
GitHub CSDN
友情链接
  • Kubernetes
  • Cisco
  • W3School
  • 廖雪峰
标签云
  • Mysql
  • Aws
  • Dql
  • Hadoop
  • Kubernetes
  • Nsx t
  • Redis
  • Azure
  • Cicd
  • Git
© 2010 - 2023 路无止境!
Powered by - Hugo v0.101.0 / Theme by - NexT
4216 / 8421
Storage by Azure static web apps /
0%