美文网首页
SPEC SFS 2014 EDA Workload简单说明

SPEC SFS 2014 EDA Workload简单说明

作者: 沧海一粒米 | 来源:发表于2018-06-07 17:21 被阅读0次

默认Benchmark

<benchmark name="EDA" business_metric="JOB_SETS">
    <workload name="EDA_FRONTEND">
        <oprate>100</oprate>
        <instances>3</instances>
        <override_parm name="FILE_SIZE">16k</override_parm>
        <override_parm name="FILES_PER_DIR">10</override_parm>
        <override_parm name="DIR_COUNT">10</override_parm>
    </workload>
    <workload name="EDA_BACKEND">
        <oprate>75</oprate>
        <instances>2</instances>
        <override_parm name="FILE_SIZE">10m</override_parm>
        <override_parm name="FILES_PER_DIR">10</override_parm>
        <override_parm name="DIR_COUNT">5</override_parm>
    </workload>
    <override_parm name="RUNTIME">300</override_parm>
    <threshold type="proc oprate">75</threshold>
    <threshold type="global oprate">95</threshold>
    <threshold type="workload variance">5</threshold>
</benchmark>

负载启动后会启动5个进程,2个后端,3个前端

Test run time = 300 seconds, Warmup = 300 seconds.
Running 5 copies of the test on 1 clients
Results directory: /opt/specsfs2014/results
Op latency reporting activated
Clients have a total of 1024 MiBytes of memory
Clients have 204 MiBytes of memory size per process
Clients each have 5 processes
Adjustable aggregate data set value set to 1024 MiBytes
Starting tests: Thu Jun  7 10:40:21 2018

   Launching 5 processes.
   Starting test client:   0 Host:  localhost    Workload:    EDA_BACKEND  Location: 
   Starting test client:   1 Host:  localhost    Workload:    EDA_BACKEND  Location: 
   Starting test client:   2 Host:  localhost    Workload:   EDA_FRONTEND  Location: 
   Starting test client:   3 Host:  localhost    Workload:   EDA_FRONTEND  Location: 
   Starting test client:   4 Host:  localhost    Workload:   EDA_FRONTEND  Location: 

生成目录如下

drwxr-xr-x.  7 root root  7 Jun  7 10:23 CL0_EDA_BACKEND
drwxr-xr-x.  7 root root  7 Jun  7 10:23 CL1_EDA_BACKEND
drwxr-xr-x. 12 root root 12 Jun  7 10:23 CL2_EDA_FRONTEND
drwxr-xr-x. 12 root root 12 Jun  7 10:23 CL3_EDA_FRONTEND
drwxr-xr-x. 12 root root 12 Jun  7 10:23 CL4_EDA_FRONTEND

根据Benchmark文件配,每个前端进程创建10个子目录,<override_parm name="DIR_COUNT">10</override_parm>

每个后端进程创建5个子目录,<override_parm name="DIR_COUNT">5</override_parm>

[root@localhost CL2_EDA_FRONTEND]# ll
total 40
drwxr-xr-x. 28 root root 28 Jun  7 10:51 Dir0
drwxr-xr-x. 28 root root 28 Jun  7 10:51 Dir1
drwxr-xr-x. 28 root root 28 Jun  7 10:51 Dir2
drwxr-xr-x. 28 root root 28 Jun  7 10:51 Dir3
drwxr-xr-x. 28 root root 28 Jun  7 10:51 Dir4
drwxr-xr-x. 28 root root 28 Jun  7 10:50 Dir5
drwxr-xr-x. 28 root root 28 Jun  7 10:50 Dir6
drwxr-xr-x. 28 root root 28 Jun  7 10:50 Dir7
drwxr-xr-x. 28 root root 28 Jun  7 10:51 Dir8
drwxr-xr-x. 28 root root 28 Jun  7 10:50 Dir9

特别说明一下

所有前端目录和后端目录Dir*都会创建名字为buket*的子目录
前端的bucket子目录是26个,后端的bucket子目录是24个

[root@localhost Dir0]# ll
total 104
drwxr-xr-x. 2 root root 12 Jun  7 10:23 bucket0
drwxr-xr-x. 2 root root 12 Jun  7 10:23 bucket1
drwxr-xr-x. 2 root root 12 Jun  7 10:23 bucket10
drwxr-xr-x. 2 root root  2 Jun  7 10:51 bucket11
drwxr-xr-x. 2 root root 12 Jun  7 10:23 bucket12
drwxr-xr-x. 2 root root 12 Jun  7 10:23 bucket13
drwxr-xr-x. 2 root root 12 Jun  7 10:23 bucket14
drwxr-xr-x. 2 root root 12 Jun  7 10:24 bucket15
drwxr-xr-x. 2 root root 12 Jun  7 10:24 bucket16
drwxr-xr-x. 2 root root 12 Jun  7 10:24 bucket17
drwxr-xr-x. 2 root root 12 Jun  7 10:24 bucket18
drwxr-xr-x. 2 root root 12 Jun  7 10:40 bucket19
drwxr-xr-x. 2 root root 12 Jun  7 10:23 bucket2
drwxr-xr-x. 2 root root 12 Jun  7 10:40 bucket20
drwxr-xr-x. 2 root root 12 Jun  7 10:40 bucket21
drwxr-xr-x. 2 root root 12 Jun  7 10:50 bucket22
drwxr-xr-x. 2 root root  2 Jun  7 10:40 bucket23
drwxr-xr-x. 2 root root 12 Jun  7 10:40 bucket24
drwxr-xr-x. 2 root root 12 Jun  7 10:40 bucket25
drwxr-xr-x. 2 root root 12 Jun  7 10:23 bucket3
drwxr-xr-x. 2 root root 12 Jun  7 10:23 bucket4
drwxr-xr-x. 2 root root 12 Jun  7 10:23 bucket5
drwxr-xr-x. 2 root root 12 Jun  7 10:23 bucket6
drwxr-xr-x. 2 root root  2 Jun  7 10:51 bucket7
drwxr-xr-x. 2 root root 12 Jun  7 10:50 bucket8
drwxr-xr-x. 2 root root 12 Jun  7 10:23 bucket9

[root@localhost Dir0]# pwd
CL0_EDA_BACKEND/Dir0
[root@localhost Dir0]# ls | wc -l
24
[root@localhost Dir0]#pwd
CL2_EDA_FRONTEND/Dir0
[root@localhost Dir0]# ls | wc -l
26

Benchmark配置文件中的每个目录文件数<override_parm name="FILES_PER_DIR">10</override_parm>是指的bucket*子目录的文件数

创建的目录总数

[root@localhost spec]# ls -lR | grep "^d" | wc -l
1065

1065=5+2*(5*24+5)+3*(10*26+10)

创建的文件总数

[root@localhost spec]# ls -lR | grep "^-" | wc -l
9200

9200=2*5*23*10+3*10*23*10

这里的23是每个目录下的子目录数,不是24或26,而是23

创建的总文件大小

[root@localhost spec]# du -ah
4.0K    ./CL2_EDA_FRONTEND/Dir7/bucket7
4.0K    ./CL2_EDA_FRONTEND/Dir7/bucket24/sdacihi2.ec
4.0K    ./CL2_EDA_FRONTEND/Dir7/bucket24/mmdfbh4.drn
4.0K    ./CL2_EDA_FRONTEND/Dir7/bucket24/atees6.nrfao
4.0K    ./CL2_EDA_FRONTEND/Dir7/bucket24/sehi8.l
4.0K    ./CL2_EDA_FRONTEND/Dir7/bucket24/toc5.ruvh
...
36K     ./CL4_EDA_FRONTEND/Dir4/bucket5/smiu6.sr
28K     ./CL4_EDA_FRONTEND/Dir4/bucket5/lee5.lu
28K     ./CL4_EDA_FRONTEND/Dir4/bucket5/sittole0.uez
36K     ./CL4_EDA_FRONTEND/Dir4/bucket5/rwinhhc9.tliil
20K     ./CL4_EDA_FRONTEND/Dir4/bucket5/enhiochg7.aoo
300K    ./CL4_EDA_FRONTEND/Dir4/bucket5
3.1M    ./CL4_EDA_FRONTEND/Dir4
31M     ./CL4_EDA_FRONTEND
11G     .
[root@localhost spec]#

测试产生的文件操作有

    Write              
    Write_file         
    Mmap_write         
    Mmap_read          
    Read               
    Read_file          
    Mkdir              
    Rmdir              
    Unlink             
    Unlink2            
    Create             
    Stat               
    Append             
    Lock               
    Access             
    Chmod              
    Readdir            
    Random_write       
    Random_read        
    Read_modify_write  
    Open file          
    Close file         
    Copyfile           
    Rename             
    Statfs             
    Pathconf           
    Custom1            
    Custom2            

相关文章

网友评论

      本文标题:SPEC SFS 2014 EDA Workload简单说明

      本文链接:https://www.haomeiwen.com/subject/wpagsftx.html