SPECweb2005 Result ================================================================================ || IBM: System x3650 || SPECweb2005 = 9182 Accoria Networks: Rock Web Server v1.3.3 (x86-6 || 4) || Apache Software Foundation: Apache Tomcat 5.5.9 || SPECweb2005_Banking = 15000 || SPECweb2005_Ecommerce = 13000 || SPECweb2005_Support = 8800 || ================================================================================ Submitter: IBM, SPEC License #: 11, Test date: Jun-2006 ================================================================================ PERFORMANCE Banking | Simultaneous | Test | Aggregate QOS Compliance | Validation | | User Sessions | Iteration | Good Tolerable Fail | Errors | |---------------|-----------|---------------------------|------------| | | 1 | 99.5% 99.7% 0.3% | 255 | | |-----------|---------------------------|------------| | 15000 | 2 | 99.6% 99.7% 0.3% | 472 | | |-----------|---------------------------|------------| | | 3 | 99.5% 99.7% 0.3% | 249 | -------------------------------------------------------------------- Ecommerce | Simultaneous | Test | Aggregate QOS Compliance | Validation | | User Sessions | Iteration | Good Tolerable Fail | Errors | |---------------|-----------|---------------------------|------------| | | 1 | 96.8% 99.9% 0.1% | 0 | | |-----------|---------------------------|------------| | 13000 | 2 | 97.4% 100.0% 0.0% | 27 | | |-----------|---------------------------|------------| | | 3 | 98.0% 100.0% 0.0% | 1 | -------------------------------------------------------------------- Support | Simultaneous | Test | Aggregate QOS Compliance | Validation | | User Sessions | Iteration | Good Tolerable Fail | Errors | |---------------|-----------|---------------------------|------------| | | 1 | 99.3% 100.0% 0.0% | 0 | | |-----------|---------------------------|------------| | 8800 | 2 | 98.8% 100.0% 0.0% | 0 | | |-----------|---------------------------|------------| | | 3 | 98.1% 100.0% 0.0% | 0 | -------------------------------------------------------------------- ================================================================================ CONFIGURATION Availability Dates -------------------------------------------------------------------------------- Backend Simulator Nov-2003 SUT Hardware May-2006 Web Server Software May-2006 (Accoria Rock Web 1.3.3) Dec-2004 (Apache Tomcat 5.5.9) Operating System Mar-2006 Other Components N/A System Under Test (SUT) -------------------------------------------------------------------------------- # of SUTs 1 Vendor IBM Model System x3650 Processor 3.0 GHz Intel Xeon 5160 Processor Speed (MHz) 3000 # Processors 4 cores, 2 chips, 2 cores/chip Primary Cache 32KB(I) + 32KB(D) on chip Secondary Cache 4096 KB Other Cache N/A Memory 12 x 2 GB (DDR2 FBD 667MHz) Disk Subsystem 146GB 15K Ultra320 SAS, 70 x 18GB Fibre Channel Disk Controllers Onboard SAS controller QLogic Fibre Channel QLA2342 Operating System RHEL 4 U3 (2.6.9-34.ELsmp x86-64) File System ext2 Other Hardware 1 x PCI-X Riser Card P/N 40K1908, 1 x Extreme Networks Summit 400-48t Switch, 1 x IBM DS4400 Fibre Channel controller, 5 x EXP700 Fibre Channel storage enclosure Other Software Sun Java(TM) 2 Runtime Environment, Standard Edition 1.5.06 Web Server Software -------------------------------------------------------------------------------- Vendor Accoria Networks Name/Version Rock Web Server v1.3.3 (x86-64) Dynamic Scripts JSP Server Cache N/A Log Mode Common Log Format Script Engine -------------------------------------------------------------------------------- Vendor Apache Software Foundation Name/Version Apache Tomcat 5.5.9 Dynamic Scripts JSP Server Cache N/A Log Mode Common Log Format SUT Network -------------------------------------------------------------------------------- # of Controllers 2 Network Controllers Intel PRO/1000 PT # of Networks 4 Network Type Gigabit Ethernet Network Speed 1 Gb/s MSL (sec) 30 (Non RFC1122) Time-Wait (sec) 60 (Non RFC1122) MTU Size 1500 Client Systems -------------------------------------------------------------------------------- # of Clients 27 Model eServer xSeries x336 Processor Xeon Processor Speed (MHz) 2800 # Processors 2 Memory 2 GB Network Controller IBM NetXtreme BCM5721 Gigabit Ethernet PCI Express Operating System SUSE Linux 9.2 (kernel 2.6.8-24-smp) JVM Version Java 2 Runtime Environment, Std Edition (build 1.4.2_01-b06) JIT Version Java HotSpot Client VM (build 1.4.2_01-b06, mixed mode) Other Hardware N/A Other Software N/A Backend Simulator (BESIM) -------------------------------------------------------------------------------- # of Simulators 1 Model eServer xSeries x336 Processor Xeon Processor Speed (MHz) 2800 # of Processors 2 Memory 2 GB Network Controller IBM NetXtreme BCM5721 Gigabit Ethernet PCI Express Operating System SUSE Linux 9.2 (kernel 2.6.8-24-smp) File System ext2 Web Server Apache 2.0.53 Server Scripts SPEC-FCGI v1.0 Other Hardware N/A Other Software N/A ================================================================================ Banking Run Details Iter-| | Total | QOS ation| Request Type | Reqs | Good Toler Fail -----|------------------|------------|------------------------------------ |login | 879394 | 872967 4358 2069 |account_summary | 620055 | 616669 822 2544 |check_detail_html | 348011 | 345708 740 1553 |bill_pay | 565925 | 562798 722 2391 |add_payee | 45618 | 45380 59 179 |payee_info | 32587 | 32394 55 137 |quick_pay | 271507 | 269704 599 1198 |billpay_status | 90442 | 89947 142 350 1 |chg_profile | 49675 | 49434 50 191 |post_profile | 35753 | 35559 31 163 |req_checks | 49517 | 49111 180 226 |post_chk_order | 35679 | 35384 50 157 |req_xfer_form | 70764 | 70374 87 302 |post_fund_xfer | 50920 | 50645 70 203 |logout | 250962 | 249677 246 1025 |check_image | 696104 | 695841 11 156 |------------------|------------|------------------------------------ | TOTAL | 4092913 | 4071592 8222 12844 Iter-| | Byte | Weighted | Avg Resp | Average ation| Request Type | Rate | ABR | (sec) | Bytes -----|------------------|------------|------------|----------|---------- |login | 51,960.7 | 17,712.3 | 0.664 | 34539 |account_summary | 82,888.3 | 9,925.8 | 0.331 | 27451 |check_detail_html | 78,191.2 | 4,820.8 | 0.303 | 23754 |bill_pay | 82,307.9 | 8,369.6 | 0.308 | 25361 |add_payee | 83,826.6 | 699.8 | 0.313 | 26305 |payee_info | 87,646.0 | 831.4 | 0.499 | 43748 |quick_pay | 83,198.2 | 5,227.1 | 0.396 | 33014 |billpay_status | 85,687.7 | 1,743.8 | 0.385 | 33063 1 |chg_profile | 89,144.1 | 1,249.2 | 0.483 | 43123 |post_profile | 86,617.9 | 764.6 | 0.423 | 36673 |req_checks | 85,853.6 | 2,539.4 | 1.024 | 87943 |post_chk_order | 84,806.9 | 687.6 | 0.389 | 33046 |req_xfer_form | 80,267.0 | 908.3 | 0.274 | 22010 |post_fund_xfer | 81,659.9 | 726.5 | 0.299 | 24465 |logout | 74,457.0 | 11,009.8 | 1.010 | 75230 |check_image | 93,439.5 | 4,336.9 | 0.114 | 10684 |------------------|------------|------------|----------|---------- | TOTAL | - | 71,552.8 | - | - Iter-| | Total | QOS ation| Request Type | Reqs | Good Toler Fail -----|------------------|------------|------------------------------------ |login | 882312 | 875614 3614 2999 |account_summary | 622611 | 619953 303 2313 |check_detail_html | 349130 | 347386 358 1361 |bill_pay | 567135 | 564642 261 2202 |add_payee | 45737 | 45539 24 172 |payee_info | 32715 | 32581 10 124 |quick_pay | 272215 | 270845 277 1082 |billpay_status | 90461 | 90059 41 357 2 |chg_profile | 50002 | 49799 27 174 |post_profile | 36100 | 35954 9 136 |req_checks | 49683 | 49344 114 223 |post_chk_order | 35718 | 35434 27 160 |req_xfer_form | 70942 | 70640 30 268 |post_fund_xfer | 51055 | 50819 19 216 |logout | 251725 | 250678 101 938 |check_image | 698331 | 697988 90 95 |------------------|------------|------------------------------------ | TOTAL | 4105872 | 4087275 5305 12820 Iter-| | Byte | Weighted | Avg Resp | Average ation| Request Type | Rate | ABR | (sec) | Bytes -----|------------------|------------|------------|----------|---------- |login | 52,077.4 | 17,987.0 | 0.662 | 34490 |account_summary | 85,402.7 | 10,093.2 | 0.321 | 27426 |check_detail_html | 81,697.7 | 4,902.1 | 0.290 | 23755 |bill_pay | 84,908.9 | 8,501.2 | 0.298 | 25360 |add_payee | 85,852.5 | 711.1 | 0.306 | 26305 |payee_info | 89,671.3 | 846.0 | 0.487 | 43750 |quick_pay | 85,930.4 | 5,311.7 | 0.384 | 33013 |billpay_status | 87,712.8 | 1,767.8 | 0.376 | 33062 2 |chg_profile | 90,709.6 | 1,274.6 | 0.475 | 43126 |post_profile | 89,369.0 | 782.5 | 0.410 | 36670 |req_checks | 86,776.8 | 2,581.6 | 1.013 | 87912 |post_chk_order | 86,619.0 | 697.7 | 0.381 | 33048 |req_xfer_form | 83,225.7 | 921.8 | 0.264 | 21983 |post_fund_xfer | 83,387.5 | 738.1 | 0.293 | 24459 |logout | 74,863.3 | 11,191.6 | 1.004 | 75220 |check_image | 94,681.3 | 4,410.7 | 0.112 | 10685 |------------------|------------|------------|----------|---------- | TOTAL | - | 72,718.6 | - | - Iter-| | Total | QOS ation| Request Type | Reqs | Good Toler Fail -----|------------------|------------|------------------------------------ |login | 881714 | 875430 3594 2678 |account_summary | 622011 | 619318 351 2321 |check_detail_html | 349013 | 347044 605 1357 |bill_pay | 567305 | 564682 325 2291 |add_payee | 45814 | 45621 31 160 |payee_info | 32878 | 32708 40 129 |quick_pay | 272375 | 270833 503 1032 |billpay_status | 90568 | 90135 54 377 3 |chg_profile | 49864 | 49645 33 185 |post_profile | 35983 | 35823 25 134 |req_checks | 49675 | 49299 168 208 |post_chk_order | 35812 | 35584 16 142 |req_xfer_form | 70913 | 70617 29 267 |post_fund_xfer | 50984 | 50733 30 220 |logout | 251792 | 250734 99 951 |check_image | 698107 | 697840 77 81 |------------------|------------|------------------------------------ | TOTAL | 4104808 | 4086046 5980 12533 Iter-| | Byte | Weighted | Avg Resp | Average ation| Request Type | Rate | ABR | (sec) | Bytes -----|------------------|------------|------------|----------|---------- |login | 52,073.7 | 17,909.2 | 0.662 | 34484 |account_summary | 84,771.9 | 10,048.2 | 0.323 | 27426 |check_detail_html | 80,874.9 | 4,883.6 | 0.293 | 23756 |bill_pay | 84,060.8 | 8,474.3 | 0.301 | 25361 |add_payee | 85,619.9 | 709.9 | 0.307 | 26307 |payee_info | 88,925.3 | 847.1 | 0.491 | 43745 |quick_pay | 85,561.6 | 5,296.3 | 0.385 | 33012 |billpay_status | 86,830.5 | 1,763.8 | 0.380 | 33063 3 |chg_profile | 90,088.2 | 1,266.7 | 0.478 | 43127 |post_profile | 88,377.5 | 777.2 | 0.414 | 36669 |req_checks | 86,521.7 | 2,572.4 | 1.016 | 87917 |post_chk_order | 86,759.0 | 697.5 | 0.381 | 33068 |req_xfer_form | 82,649.3 | 918.3 | 0.266 | 21984 |post_fund_xfer | 82,571.3 | 734.5 | 0.296 | 24459 |logout | 74,741.8 | 11,155.2 | 1.006 | 75217 |check_image | 94,610.5 | 4,393.7 | 0.112 | 10685 |------------------|------------|------------|----------|---------- | TOTAL | - | 72,447.8 | - | - BANKING NOTES SUT Notes --------- * 146GB Drive used for OS/SWAP/Logs * Each Fibre Channel enclosure represents a single volume and mount point * Files are evenly distributed across the 5 RAID 0 volumes * Boot drive contains soft links to the directories Operating System Notes ---------------------- * net.ipv4.icmp_echo_ignore_broadcasts = 1, enable ignoring broadcast requests, default 0 * net.ipv4.conf.all.rp_filter = 1, enable source route verification, default 0 * net.ipv4.ip_forward=1, enable IP forwarding, default 0 * net.ipv4.tcp_timestamps = 0, turns TCP timestamp support off, default 1 * net.ipv4.tcp_max_tw_buckets = 2000000, sets TCP time-wait buckets pool size, default 180000 * net.core.optmem_max = 10000000, maximum amount of option memory buffers, default 20480 * net.core.rmem_default = 10000000, default receive socket buffer size, default 65535 * net.core.rmem_max = 10000000, maximum receive socket buffer size, default 131071 * net.core.wmem_default = 10000000, default send socket buffer size * net.core.wmem_max = 10000000, maximum send socket buffer size, default 131071 * net.ipv4.tcp_rmem = 30000000 30000000 30000000, maximum TCP read-buffer space allocatable, default 4096 87380 174760 * net.ipv4.tcp_wmem = 30000000 30000000 30000000, maximum TCP write-buffer space allocatable, default 4096 87380 174760 * net.ipv4.tcp_mem = 30000000 30000000 30000000, maximum TCP buffer space, default 392192 392704 393216 * net.ipv4.tcp_max_syn_backlog = 12000, default 1024 * fs.file-max = 5000000, sets number of open file handles kernel allocates, default 904396 * net.core.somaxconn = 10000, size of the listen queue for accepting new TCP connections, default 128 * net.core.netdev_max_backlog=400000, number of unprocessed input packets before kernel starts dropping them, default 300 * net.ipv4.tcp_dsack=0, turns DSACK support off, default on * net.ipv4.tcp_sack=0, turns SACK support off, default on * net.ipv4.tcp_window_scaling=0, turns TCP window scaling suport off, default on * Each NICs txqueuelen set to 60000, default 1000 * irqbalancer service was enabled during run * ulimit -n 1000000, sets number of open files, default 1024 * ulimit -u 1000000, sets max user processes, default 70656 * No modifications to default kernel configuration * /etc/inittab, id:3:initdefault:, Run Level 3 Web Server Software Notes ------------------------- * server_log httpd.log * validate_static -1, disables static file modification validation, default 0 * validate_httpmod -1, disables HTTP module modificatoin validation, default 0 * header_etag_on 0, disables etag header in HTTP replies, default 1 * header_server_on 0, disables server header in HTTP replies, default 1 * tcp_send_buf_size 1048576, sets socket send buffer size, default OS default * log_buf_size 1048576, sets access log buffer size, default 65536 * direct_io 1, uses direct IO when possible * connection_timeout 200, connection inactivity timeout, default 60 * worker 192.0.1.100/80 192.0.1.100/443 192.0.1.100/9090 * worker 192.0.2.100/80 192.0.2.100/443 * worker 192.0.3.100/80 192.0.3.100/443 * worker 192.0.4.100/80 192.0.4.100/443 * keepalive_max 100000, max. keepalive requests on a connection, default 100 * cache_memory_size 8192, (support), cache manager memory, default 0 * cache_file_max_size 4194304 (support), * servlet_session_count 57917, (bank/ecom) estimate number of servlet sessions, default 23191 * servlet_session_timeout 800, (bank/ecom) servlet session timeout, default 600 * cache_replacement lru, (sup/ecom) least recently used policy for file replacement, default random * direct_io_size 1048576 (support) read buffer size for direct IO, default 65536 * write_chunk_size 1048576 (support) max. number of bytes to send to a client at one time, default 65536 * disk_worker_count 68, (support) number of threads to read data from disk for large files, default 21 * fast_read 1, (support) enable better read when IO wait time is long, default 0 * ;host; testserver:80 * document_root /root/sw2005/jakarta-tomcat-5.5.9/webapps * access_log access_port80.log * error_log error_port80.log * access_log_format commonlog * ;file; / * cgi_type gateway * cgi_regex .*jsp * cgi_listener localhost/8080 * ;/file; * ;/host; * ;host; testserver:443 * document_root /root/sw2005/jakarta-tomcat-5.5.9/webapps * ssl_key_file /root/sw2005/httpd/etc/key-cert/sample.key * ssl_cert_file /root/sw2005/httpd/etc/key-cert/sample.certificate * ssl_session_max 74931 * ssl_session_timeout 0 * access_log access_port443.log * error_log error_port443.log * access_log_format commonlog * ;file; / * cgi_type gateway * cgi_regex .*jsp * cgi_listener localhost/8080 * ;/file; * ;/host; * ;host; testserver:9090 * admin_server yes * ;file; / * home_page home.cgi * auth_type basic * auth_name Administrative Web Server * auth_user_file /root/sw2005/httpd/conf/password * cgi_type module * cgi_where internal * cgi_regex .*cgi * ;/file; * ;/host; * 1024-bit SSL key and cert generated by Rock Webserver admin console and used for this workload. HTTP Script Notes ----------------- * SPEC-provided JSP scripts used without modification * Apache Tomcat 5.5.9 is used as JSP engine * JAVA_OPTS = -Xms4000m -Xmx4000m -Xss512k -Xcompactexplicitgc -server -d64, optimize garbage collection for applications and set JVM heap size to 4GB, set stack size to 512KB * server.xml tuning: * maxThreads=15000, max number of sessions, default 150 * minSpareThreads=2048, number of threads created when connector starts, default 25 * maxSpareThreads=2048, max number of unused threads allowed, default 75 * acceptCount=10000, max queue length for connection requests, default 100 * maxHttpHeaderSize=8192, max size of HTTP header, default 4096 * connectionTimeout=0, msec connector will wait for request URI line to be presented, default 20000 * maxKeepAliveRequest=-1, allow an unlimited amount of pipelined or keep-alive HTTP requests, default 100 * disableUploadTimeout=true, allow servlet container to use a longer connection timeout, default false * Apache Tomcat 5.5.9 is supported by Covalent Technologies Client Notes ------------ * ulimit -n 1000000, sets number of open files, default 1024 * ulimit -u 1000000, sets max user processes, default 7168 * java -Xms512m -Xmx512m -Xss256k -Xcompactexplicitgc specwebclient BESIM Notes ----------- * BESIM is a physically separate machine * ulimit -n 1000000, sets number of open files, default 1024 * ulimit -u 1000000, sets max user processes, default 7168 * Apache using mod_fastcgi * Apache httpd.conf: * StartServer 100, specifies the number of child server processes that will be created by Apache on start-up, default 5 * MinSpareServers 250, specifies the minimum number of idle child server processes for Apache, which is not handling a request, default 5 * MaxSpareServers 1500, specifies the maximum number of idle child server processes for Apache, which is not handling a request, default 10 * MaxClients 1500, sets the limit on the number of simultaneous requests that can be supported, no more than this number of child server processes will be created, default 256 * MaxRequestsPerChild 0, specifies the number of requests that an individual child server process will handle (0 unlimited), default 0 * KeepAlive on, if set to On, specifies enabling persistent connections on this web server, default off * KeepAliveTimeout 600, specifies how much time, in seconds, Apache will wait for a subsequent request before closing the connection, default 15 * ServerLimit 1500, sets max configured value for MaxClients, default 16 * No additional fcgi tuning is implemented Other Notes ----------- * N/A ================================================================================ Errors for Banking Workload Quality of Service Errors ------------------------- * No QOS Errors Found Validation Errors ----------------- * 2 Validation Errors for Iteration 1: client5 - account_summary * 1 Validation Errors for Iteration 1: client7 - account_summary * 1 Validation Errors for Iteration 1: client12:1098 - account_summary * 1 Validation Errors for Iteration 1: client13:1098 - account_summary * 2 Validation Errors for Iteration 1: client18:1098 - account_summary * 2 Validation Errors for Iteration 1: client19:1098 - account_summary * 1 Validation Errors for Iteration 1: client23:1098 - account_summary * 7 Validation Errors for Iteration 1: client24:1098 - account_summary * 3 Validation Errors for Iteration 1: client26:1098 - account_summary * 1 Validation Errors for Iteration 1: client14:1098 - check_detail_html * 1 Validation Errors for Iteration 1: client18:1098 - check_detail_html * 3 Validation Errors for Iteration 1: client19:1098 - check_detail_html * 3 Validation Errors for Iteration 1: client26:1098 - check_detail_html * 1 Validation Errors for Iteration 1: client30:1098 - check_detail_html * 1 Validation Errors for Iteration 1: client31:1098 - check_detail_html * 1 Validation Errors for Iteration 1: client7 - bill_pay * 1 Validation Errors for Iteration 1: client8 - bill_pay * 1 Validation Errors for Iteration 1: client9 - bill_pay * 2 Validation Errors for Iteration 1: client18:1098 - bill_pay * 1 Validation Errors for Iteration 1: client19:1098 - bill_pay * 3 Validation Errors for Iteration 1: client23:1098 - bill_pay * 2 Validation Errors for Iteration 1: client24:1098 - bill_pay * 2 Validation Errors for Iteration 1: client26:1098 - bill_pay * 1 Validation Errors for Iteration 1: client30:1098 - bill_pay * 1 Validation Errors for Iteration 1: client23:1098 - payee_info * 2 Validation Errors for Iteration 1: client19:1098 - quick_pay * 2 Validation Errors for Iteration 1: client23:1098 - quick_pay * 1 Validation Errors for Iteration 1: client24:1098 - quick_pay * 1 Validation Errors for Iteration 1: client26:1098 - quick_pay * 1 Validation Errors for Iteration 1: client9 - billpay_status * 1 Validation Errors for Iteration 1: client18:1098 - billpay_status * 1 Validation Errors for Iteration 1: client23:1098 - billpay_status * 4 Validation Errors for Iteration 1: client1 - post_chk_order * 1 Validation Errors for Iteration 1: client4 - post_chk_order * 3 Validation Errors for Iteration 1: client5 - post_chk_order * 2 Validation Errors for Iteration 1: client6 - post_chk_order * 2 Validation Errors for Iteration 1: client7 - post_chk_order * 7 Validation Errors for Iteration 1: client8 - post_chk_order * 2 Validation Errors for Iteration 1: client9 - post_chk_order * 3 Validation Errors for Iteration 1: client10:1098 - post_chk_order * 6 Validation Errors for Iteration 1: client11:1098 - post_chk_order * 2 Validation Errors for Iteration 1: client12:1098 - post_chk_order * 3 Validation Errors for Iteration 1: client13:1098 - post_chk_order * 3 Validation Errors for Iteration 1: client16:1098 - post_chk_order * 5 Validation Errors for Iteration 1: client18:1098 - post_chk_order * 1 Validation Errors for Iteration 1: client19:1098 - post_chk_order * 4 Validation Errors for Iteration 1: client23:1098 - post_chk_order * 4 Validation Errors for Iteration 1: client24:1098 - post_chk_order * 4 Validation Errors for Iteration 1: client25:1098 - post_chk_order * 6 Validation Errors for Iteration 1: client26:1098 - post_chk_order * 2 Validation Errors for Iteration 1: client29:1098 - post_chk_order * 2 Validation Errors for Iteration 1: client30:1098 - post_chk_order * 4 Validation Errors for Iteration 1: client31:1098 - post_chk_order * 3 Validation Errors for Iteration 1: client32:1098 - post_chk_order * 6 Validation Errors for Iteration 1: client33:1098 - post_chk_order * 9 Validation Errors for Iteration 1: client34:1098 - post_chk_order * 1 Validation Errors for Iteration 1: client18:1098 - req_xfer_form * 2 Validation Errors for Iteration 1: client24:1098 - post_fund_xfer * 1 Validation Errors for Iteration 1: client5 - logout * 1 Validation Errors for Iteration 1: client7 - logout * 1 Validation Errors for Iteration 1: client14:1098 - logout * 3 Validation Errors for Iteration 1: client18:1098 - logout * 2 Validation Errors for Iteration 1: client19:1098 - logout * 1 Validation Errors for Iteration 1: client23:1098 - logout * 2 Validation Errors for Iteration 1: client24:1098 - logout * 1 Validation Errors for Iteration 1: client26:1098 - logout * 1 Validation Errors for Iteration 1: client31:1098 - logout * 1 Validation Errors for Iteration 1: client34:1098 - logout * 3 Validation Errors for Iteration 1: client1 - check_image * 3 Validation Errors for Iteration 1: client4 - check_image * 1 Validation Errors for Iteration 1: client6 - check_image * 1 Validation Errors for Iteration 1: client7 - check_image * 4 Validation Errors for Iteration 1: client8 - check_image * 2 Validation Errors for Iteration 1: client9 - check_image * 1 Validation Errors for Iteration 1: client10:1098 - check_image * 2 Validation Errors for Iteration 1: client11:1098 - check_image * 2 Validation Errors for Iteration 1: client12:1098 - check_image * 2 Validation Errors for Iteration 1: client13:1098 - check_image * 3 Validation Errors for Iteration 1: client14:1098 - check_image * 3 Validation Errors for Iteration 1: client15:1098 - check_image * 2 Validation Errors for Iteration 1: client16:1098 - check_image * 7 Validation Errors for Iteration 1: client18:1098 - check_image * 12 Validation Errors for Iteration 1: client19:1098 - check_image * 2 Validation Errors for Iteration 1: client23:1098 - check_image * 7 Validation Errors for Iteration 1: client24:1098 - check_image * 3 Validation Errors for Iteration 1: client25:1098 - check_image * 7 Validation Errors for Iteration 1: client26:1098 - check_image * 2 Validation Errors for Iteration 1: client28:1098 - check_image * 6 Validation Errors for Iteration 1: client29:1098 - check_image * 5 Validation Errors for Iteration 1: client30:1098 - check_image * 3 Validation Errors for Iteration 1: client31:1098 - check_image * 4 Validation Errors for Iteration 1: client32:1098 - check_image * 4 Validation Errors for Iteration 1: client33:1098 - check_image * 5 Validation Errors for Iteration 1: client34:1098 - check_image * 3 Validation Errors for Iteration 2: client1 - login * 7 Validation Errors for Iteration 2: client4 - login * 4 Validation Errors for Iteration 2: client5 - login * 12 Validation Errors for Iteration 2: client6 - login * 6 Validation Errors for Iteration 2: client7 - login * 5 Validation Errors for Iteration 2: client8 - login * 3 Validation Errors for Iteration 2: client9 - login * 1 Validation Errors for Iteration 2: client10:1098 - login * 1 Validation Errors for Iteration 2: client12:1098 - login * 3 Validation Errors for Iteration 2: client14:1098 - login * 3 Validation Errors for Iteration 2: client15:1098 - login * 5 Validation Errors for Iteration 2: client16:1098 - login * 4 Validation Errors for Iteration 2: client18:1098 - login * 3 Validation Errors for Iteration 2: client19:1098 - login * 1 Validation Errors for Iteration 2: client24:1098 - login * 7 Validation Errors for Iteration 2: client25:1098 - login * 1 Validation Errors for Iteration 2: client26:1098 - login * 3 Validation Errors for Iteration 2: client28:1098 - login * 2 Validation Errors for Iteration 2: client30:1098 - login * 8 Validation Errors for Iteration 2: client31:1098 - login * 3 Validation Errors for Iteration 2: client33:1098 - login * 2 Validation Errors for Iteration 2: client1 - account_summary * 2 Validation Errors for Iteration 2: client4 - account_summary * 3 Validation Errors for Iteration 2: client5 - account_summary * 4 Validation Errors for Iteration 2: client6 - account_summary * 1 Validation Errors for Iteration 2: client7 - account_summary * 1 Validation Errors for Iteration 2: client8 - account_summary * 4 Validation Errors for Iteration 2: client9 - account_summary * 2 Validation Errors for Iteration 2: client10:1098 - account_summary * 2 Validation Errors for Iteration 2: client11:1098 - account_summary * 2 Validation Errors for Iteration 2: client12:1098 - account_summary * 5 Validation Errors for Iteration 2: client13:1098 - account_summary * 2 Validation Errors for Iteration 2: client14:1098 - account_summary * 1 Validation Errors for Iteration 2: client15:1098 - account_summary * 1 Validation Errors for Iteration 2: client16:1098 - account_summary * 1 Validation Errors for Iteration 2: client23:1098 - account_summary * 1 Validation Errors for Iteration 2: client28:1098 - account_summary * 2 Validation Errors for Iteration 2: client29:1098 - account_summary * 2 Validation Errors for Iteration 2: client31:1098 - account_summary * 2 Validation Errors for Iteration 2: client32:1098 - account_summary * 1 Validation Errors for Iteration 2: client33:1098 - account_summary * 1 Validation Errors for Iteration 2: client34:1098 - account_summary * 1 Validation Errors for Iteration 2: client6 - check_detail_html * 1 Validation Errors for Iteration 2: client8 - check_detail_html * 3 Validation Errors for Iteration 2: client9 - check_detail_html * 3 Validation Errors for Iteration 2: client10:1098 - check_detail_html * 2 Validation Errors for Iteration 2: client11:1098 - check_detail_html * 3 Validation Errors for Iteration 2: client12:1098 - check_detail_html * 1 Validation Errors for Iteration 2: client13:1098 - check_detail_html * 1 Validation Errors for Iteration 2: client14:1098 - check_detail_html * 4 Validation Errors for Iteration 2: client15:1098 - check_detail_html * 2 Validation Errors for Iteration 2: client16:1098 - check_detail_html * 1 Validation Errors for Iteration 2: client19:1098 - check_detail_html * 1 Validation Errors for Iteration 2: client28:1098 - check_detail_html * 1 Validation Errors for Iteration 2: client29:1098 - check_detail_html * 1 Validation Errors for Iteration 2: client31:1098 - check_detail_html * 1 Validation Errors for Iteration 2: client1 - bill_pay * 1 Validation Errors for Iteration 2: client4 - bill_pay * 1 Validation Errors for Iteration 2: client7 - bill_pay * 1 Validation Errors for Iteration 2: client8 - bill_pay * 1 Validation Errors for Iteration 2: client10:1098 - bill_pay * 2 Validation Errors for Iteration 2: client11:1098 - bill_pay * 5 Validation Errors for Iteration 2: client12:1098 - bill_pay * 3 Validation Errors for Iteration 2: client13:1098 - bill_pay * 2 Validation Errors for Iteration 2: client14:1098 - bill_pay * 1 Validation Errors for Iteration 2: client15:1098 - bill_pay * 3 Validation Errors for Iteration 2: client16:1098 - bill_pay * 1 Validation Errors for Iteration 2: client18:1098 - bill_pay * 1 Validation Errors for Iteration 2: client19:1098 - bill_pay * 1 Validation Errors for Iteration 2: client24:1098 - bill_pay * 3 Validation Errors for Iteration 2: client28:1098 - bill_pay * 1 Validation Errors for Iteration 2: client31:1098 - bill_pay * 1 Validation Errors for Iteration 2: client33:1098 - bill_pay * 1 Validation Errors for Iteration 2: client34:1098 - bill_pay * 1 Validation Errors for Iteration 2: client7 - add_payee * 1 Validation Errors for Iteration 2: client33:1098 - add_payee * 1 Validation Errors for Iteration 2: client4 - quick_pay * 1 Validation Errors for Iteration 2: client6 - quick_pay * 1 Validation Errors for Iteration 2: client7 - quick_pay * 1 Validation Errors for Iteration 2: client11:1098 - quick_pay * 1 Validation Errors for Iteration 2: client12:1098 - quick_pay * 1 Validation Errors for Iteration 2: client13:1098 - quick_pay * 1 Validation Errors for Iteration 2: client14:1098 - quick_pay * 2 Validation Errors for Iteration 2: client19:1098 - quick_pay * 1 Validation Errors for Iteration 2: client25:1098 - quick_pay * 1 Validation Errors for Iteration 2: client33:1098 - quick_pay * 1 Validation Errors for Iteration 2: client4 - billpay_status * 1 Validation Errors for Iteration 2: client9 - billpay_status * 2 Validation Errors for Iteration 2: client14:1098 - billpay_status * 1 Validation Errors for Iteration 2: client25:1098 - chg_profile * 1 Validation Errors for Iteration 2: client32:1098 - chg_profile * 1 Validation Errors for Iteration 2: client23:1098 - post_profile * 1 Validation Errors for Iteration 2: client12:1098 - req_checks * 1 Validation Errors for Iteration 2: client14:1098 - req_checks * 2 Validation Errors for Iteration 2: client1 - post_chk_order * 3 Validation Errors for Iteration 2: client4 - post_chk_order * 2 Validation Errors for Iteration 2: client5 - post_chk_order * 3 Validation Errors for Iteration 2: client6 - post_chk_order * 3 Validation Errors for Iteration 2: client7 - post_chk_order * 6 Validation Errors for Iteration 2: client8 - post_chk_order * 2 Validation Errors for Iteration 2: client9 - post_chk_order * 2 Validation Errors for Iteration 2: client10:1098 - post_chk_order * 2 Validation Errors for Iteration 2: client11:1098 - post_chk_order * 4 Validation Errors for Iteration 2: client12:1098 - post_chk_order * 4 Validation Errors for Iteration 2: client13:1098 - post_chk_order * 5 Validation Errors for Iteration 2: client14:1098 - post_chk_order * 5 Validation Errors for Iteration 2: client15:1098 - post_chk_order * 2 Validation Errors for Iteration 2: client16:1098 - post_chk_order * 8 Validation Errors for Iteration 2: client18:1098 - post_chk_order * 2 Validation Errors for Iteration 2: client19:1098 - post_chk_order * 1 Validation Errors for Iteration 2: client23:1098 - post_chk_order * 5 Validation Errors for Iteration 2: client24:1098 - post_chk_order * 5 Validation Errors for Iteration 2: client25:1098 - post_chk_order * 6 Validation Errors for Iteration 2: client26:1098 - post_chk_order * 6 Validation Errors for Iteration 2: client28:1098 - post_chk_order * 3 Validation Errors for Iteration 2: client29:1098 - post_chk_order * 1 Validation Errors for Iteration 2: client30:1098 - post_chk_order * 3 Validation Errors for Iteration 2: client31:1098 - post_chk_order * 7 Validation Errors for Iteration 2: client32:1098 - post_chk_order * 3 Validation Errors for Iteration 2: client33:1098 - post_chk_order * 2 Validation Errors for Iteration 2: client34:1098 - post_chk_order * 1 Validation Errors for Iteration 2: client7 - req_xfer_form * 1 Validation Errors for Iteration 2: client16:1098 - req_xfer_form * 2 Validation Errors for Iteration 2: client19:1098 - req_xfer_form * 1 Validation Errors for Iteration 2: client8 - post_fund_xfer * 1 Validation Errors for Iteration 2: client1 - logout * 1 Validation Errors for Iteration 2: client10:1098 - logout * 1 Validation Errors for Iteration 2: client12:1098 - logout * 2 Validation Errors for Iteration 2: client14:1098 - logout * 1 Validation Errors for Iteration 2: client18:1098 - logout * 1 Validation Errors for Iteration 2: client28:1098 - logout * 1 Validation Errors for Iteration 2: client30:1098 - logout * 8 Validation Errors for Iteration 2: client1 - check_image * 3 Validation Errors for Iteration 2: client4 - check_image * 9 Validation Errors for Iteration 2: client5 - check_image * 6 Validation Errors for Iteration 2: client6 - check_image * 4 Validation Errors for Iteration 2: client7 - check_image * 6 Validation Errors for Iteration 2: client8 - check_image * 8 Validation Errors for Iteration 2: client9 - check_image * 6 Validation Errors for Iteration 2: client10:1098 - check_image * 7 Validation Errors for Iteration 2: client11:1098 - check_image * 11 Validation Errors for Iteration 2: client12:1098 - check_image * 9 Validation Errors for Iteration 2: client13:1098 - check_image * 9 Validation Errors for Iteration 2: client14:1098 - check_image * 13 Validation Errors for Iteration 2: client15:1098 - check_image * 8 Validation Errors for Iteration 2: client16:1098 - check_image * 5 Validation Errors for Iteration 2: client18:1098 - check_image * 2 Validation Errors for Iteration 2: client19:1098 - check_image * 4 Validation Errors for Iteration 2: client23:1098 - check_image * 4 Validation Errors for Iteration 2: client24:1098 - check_image * 3 Validation Errors for Iteration 2: client26:1098 - check_image * 8 Validation Errors for Iteration 2: client28:1098 - check_image * 5 Validation Errors for Iteration 2: client29:1098 - check_image * 5 Validation Errors for Iteration 2: client30:1098 - check_image * 5 Validation Errors for Iteration 2: client31:1098 - check_image * 4 Validation Errors for Iteration 2: client32:1098 - check_image * 4 Validation Errors for Iteration 2: client33:1098 - check_image * 2 Validation Errors for Iteration 2: client34:1098 - check_image * 1 Validation Errors for Iteration 3: client1 - login * 2 Validation Errors for Iteration 3: client4 - login * 1 Validation Errors for Iteration 3: client5 - login * 1 Validation Errors for Iteration 3: client7 - login * 1 Validation Errors for Iteration 3: client8 - login * 1 Validation Errors for Iteration 3: client11:1098 - login * 1 Validation Errors for Iteration 3: client19:1098 - login * 1 Validation Errors for Iteration 3: client26:1098 - login * 1 Validation Errors for Iteration 3: client31:1098 - login * 1 Validation Errors for Iteration 3: client32:1098 - login * 1 Validation Errors for Iteration 3: client33:1098 - login * 1 Validation Errors for Iteration 3: client5 - account_summary * 1 Validation Errors for Iteration 3: client7 - account_summary * 1 Validation Errors for Iteration 3: client8 - account_summary * 1 Validation Errors for Iteration 3: client9 - account_summary * 1 Validation Errors for Iteration 3: client10:1098 - account_summary * 2 Validation Errors for Iteration 3: client11:1098 - account_summary * 1 Validation Errors for Iteration 3: client13:1098 - account_summary * 2 Validation Errors for Iteration 3: client14:1098 - account_summary * 1 Validation Errors for Iteration 3: client15:1098 - account_summary * 1 Validation Errors for Iteration 3: client19:1098 - account_summary * 1 Validation Errors for Iteration 3: client23:1098 - account_summary * 2 Validation Errors for Iteration 3: client28:1098 - account_summary * 1 Validation Errors for Iteration 3: client30:1098 - account_summary * 2 Validation Errors for Iteration 3: client31:1098 - account_summary * 3 Validation Errors for Iteration 3: client34:1098 - account_summary * 2 Validation Errors for Iteration 3: client8 - check_detail_html * 1 Validation Errors for Iteration 3: client12:1098 - check_detail_html * 1 Validation Errors for Iteration 3: client13:1098 - check_detail_html * 1 Validation Errors for Iteration 3: client19:1098 - check_detail_html * 1 Validation Errors for Iteration 3: client25:1098 - check_detail_html * 1 Validation Errors for Iteration 3: client32:1098 - check_detail_html * 1 Validation Errors for Iteration 3: client4 - bill_pay * 1 Validation Errors for Iteration 3: client6 - bill_pay * 1 Validation Errors for Iteration 3: client8 - bill_pay * 2 Validation Errors for Iteration 3: client14:1098 - bill_pay * 1 Validation Errors for Iteration 3: client18:1098 - bill_pay * 1 Validation Errors for Iteration 3: client30:1098 - bill_pay * 1 Validation Errors for Iteration 3: client1 - add_payee * 1 Validation Errors for Iteration 3: client7 - add_payee * 1 Validation Errors for Iteration 3: client16:1098 - payee_info * 1 Validation Errors for Iteration 3: client5 - quick_pay * 2 Validation Errors for Iteration 3: client13:1098 - quick_pay * 1 Validation Errors for Iteration 3: client16:1098 - quick_pay * 1 Validation Errors for Iteration 3: client23:1098 - quick_pay * 1 Validation Errors for Iteration 3: client24:1098 - quick_pay * 1 Validation Errors for Iteration 3: client32:1098 - quick_pay * 1 Validation Errors for Iteration 3: client5 - billpay_status * 1 Validation Errors for Iteration 3: client24:1098 - billpay_status * 1 Validation Errors for Iteration 3: client30:1098 - chg_profile * 1 Validation Errors for Iteration 3: client25:1098 - post_profile * 3 Validation Errors for Iteration 3: client1 - post_chk_order * 3 Validation Errors for Iteration 3: client4 - post_chk_order * 2 Validation Errors for Iteration 3: client5 - post_chk_order * 3 Validation Errors for Iteration 3: client6 - post_chk_order * 1 Validation Errors for Iteration 3: client8 - post_chk_order * 1 Validation Errors for Iteration 3: client10:1098 - post_chk_order * 3 Validation Errors for Iteration 3: client11:1098 - post_chk_order * 3 Validation Errors for Iteration 3: client12:1098 - post_chk_order * 2 Validation Errors for Iteration 3: client13:1098 - post_chk_order * 3 Validation Errors for Iteration 3: client14:1098 - post_chk_order * 1 Validation Errors for Iteration 3: client15:1098 - post_chk_order * 3 Validation Errors for Iteration 3: client16:1098 - post_chk_order * 3 Validation Errors for Iteration 3: client18:1098 - post_chk_order * 3 Validation Errors for Iteration 3: client19:1098 - post_chk_order * 3 Validation Errors for Iteration 3: client23:1098 - post_chk_order * 4 Validation Errors for Iteration 3: client24:1098 - post_chk_order * 3 Validation Errors for Iteration 3: client25:1098 - post_chk_order * 3 Validation Errors for Iteration 3: client26:1098 - post_chk_order * 3 Validation Errors for Iteration 3: client28:1098 - post_chk_order * 2 Validation Errors for Iteration 3: client29:1098 - post_chk_order * 3 Validation Errors for Iteration 3: client30:1098 - post_chk_order * 7 Validation Errors for Iteration 3: client31:1098 - post_chk_order * 3 Validation Errors for Iteration 3: client32:1098 - post_chk_order * 3 Validation Errors for Iteration 3: client33:1098 - post_chk_order * 2 Validation Errors for Iteration 3: client34:1098 - post_chk_order * 1 Validation Errors for Iteration 3: client4 - post_fund_xfer * 1 Validation Errors for Iteration 3: client1 - logout * 1 Validation Errors for Iteration 3: client5 - logout * 1 Validation Errors for Iteration 3: client7 - logout * 1 Validation Errors for Iteration 3: client8 - logout * 1 Validation Errors for Iteration 3: client13:1098 - logout * 1 Validation Errors for Iteration 3: client14:1098 - logout * 1 Validation Errors for Iteration 3: client28:1098 - logout * 1 Validation Errors for Iteration 3: client33:1098 - logout * 3 Validation Errors for Iteration 3: client1 - check_image * 4 Validation Errors for Iteration 3: client4 - check_image * 2 Validation Errors for Iteration 3: client5 - check_image * 3 Validation Errors for Iteration 3: client7 - check_image * 8 Validation Errors for Iteration 3: client8 - check_image * 4 Validation Errors for Iteration 3: client9 - check_image * 1 Validation Errors for Iteration 3: client10:1098 - check_image * 5 Validation Errors for Iteration 3: client11:1098 - check_image * 4 Validation Errors for Iteration 3: client12:1098 - check_image * 5 Validation Errors for Iteration 3: client13:1098 - check_image * 2 Validation Errors for Iteration 3: client14:1098 - check_image * 3 Validation Errors for Iteration 3: client16:1098 - check_image * 7 Validation Errors for Iteration 3: client18:1098 - check_image * 8 Validation Errors for Iteration 3: client19:1098 - check_image * 4 Validation Errors for Iteration 3: client23:1098 - check_image * 3 Validation Errors for Iteration 3: client24:1098 - check_image * 6 Validation Errors for Iteration 3: client25:1098 - check_image * 8 Validation Errors for Iteration 3: client26:1098 - check_image * 1 Validation Errors for Iteration 3: client28:1098 - check_image * 9 Validation Errors for Iteration 3: client29:1098 - check_image * 5 Validation Errors for Iteration 3: client30:1098 - check_image * 5 Validation Errors for Iteration 3: client31:1098 - check_image * 6 Validation Errors for Iteration 3: client32:1098 - check_image * 2 Validation Errors for Iteration 3: client33:1098 - check_image * 1 Validation Errors for Iteration 3: client34:1098 - check_image Ecommerce Run Details Iter-| | Total | QOS ation| Request Type | Reqs | Good Toler Fail -----|------------------|------------|------------------------------------ |index | 279173 | 265459 13714 0 |search | 139594 | 139487 107 0 |browse | 250545 | 236338 14207 0 |browse_productline| 213753 | 213589 164 0 |productdetail | 170908 | 170802 106 0 |customize1 | 360370 | 360196 174 0 1 |customize2 | 190697 | 190628 69 0 |customize3 | 131009 | 103209 26313 1487 |cart | 112727 | 105388 7242 97 |login | 80481 | 75997 4002 482 |shipping | 75672 | 75672 0 0 |billing | 71998 | 71979 19 0 |confirm | 53924 | 53924 0 0 |------------------|------------|------------------------------------ | TOTAL | 2130851 | 2062668 66117 2066 Iter-| | Byte | Weighted | Avg Resp | Average ation| Request Type | Rate | ABR | (sec) | Bytes -----|------------------|------------|------------|----------|---------- |index | 71,557.8 | 10,295.7 | 1.930 | 138148 |search | 90,537.8 | 7,098.9 | 2.104 | 190495 |browse | 75,979.2 | 10,514.4 | 2.069 | 157203 |browse_productline| 90,493.7 | 11,028.0 | 2.135 | 193262 |productdetail | 43,168.6 | 2,433.6 | 1.235 | 53338 |customize1 | 87,705.0 | 15,874.0 | 1.881 | 165005 1 |customize2 | 87,666.6 | 8,362.8 | 1.873 | 164273 |customize3 | 73,101.3 | 6,153.1 | 2.406 | 175935 |cart | 50,672.5 | 2,185.4 | 1.433 | 72619 |login | 54,141.5 | 1,027.8 | 0.883 | 47838 |shipping | 61,389.2 | 865.3 | 0.697 | 42834 |billing | 41,773.3 | 626.5 | 0.780 | 32597 |confirm | 48,394.6 | 451.3 | 0.647 | 31349 |------------------|------------|------------|----------|---------- | TOTAL | - | 76,916.8 | - | - Iter-| | Total | QOS ation| Request Type | Reqs | Good Toler Fail -----|------------------|------------|------------------------------------ |index | 279070 | 270499 8571 0 |search | 140274 | 140249 25 0 |browse | 250465 | 241293 9172 0 |browse_productline| 214104 | 214059 45 0 |productdetail | 171104 | 171090 14 0 |customize1 | 360068 | 360023 43 0 2 |customize2 | 190785 | 190765 20 0 |customize3 | 131327 | 104501 26241 577 |cart | 112989 | 107312 5631 29 |login | 80457 | 76130 4063 264 |shipping | 75740 | 75740 0 0 |billing | 71960 | 71958 2 0 |confirm | 53911 | 53911 0 0 |------------------|------------|------------------------------------ | TOTAL | 2132254 | 2077530 53827 870 Iter-| | Byte | Weighted | Avg Resp | Average ation| Request Type | Rate | ABR | (sec) | Bytes -----|------------------|------------|------------|----------|---------- |index | 72,129.2 | 10,355.1 | 1.915 | 138137 |search | 90,806.9 | 7,177.8 | 2.097 | 190495 |browse | 76,536.4 | 10,580.1 | 2.054 | 157259 |browse_productline| 90,744.5 | 11,115.9 | 2.129 | 193281 |productdetail | 43,794.5 | 2,450.3 | 1.217 | 53311 |customize1 | 88,151.9 | 15,958.8 | 1.871 | 165001 2 |customize2 | 88,068.1 | 8,418.6 | 1.865 | 164273 |customize3 | 73,554.9 | 6,205.2 | 2.391 | 175904 |cart | 51,410.7 | 2,207.9 | 1.415 | 72746 |login | 55,035.0 | 1,032.5 | 0.868 | 47776 |shipping | 61,938.3 | 871.5 | 0.691 | 42834 |billing | 42,719.9 | 630.1 | 0.763 | 32597 |confirm | 49,382.8 | 454.0 | 0.634 | 31349 |------------------|------------|------------|----------|---------- | TOTAL | - | 77,457.7 | - | - Iter-| | Total | QOS ation| Request Type | Reqs | Good Toler Fail -----|------------------|------------|------------------------------------ |index | 280039 | 274436 5603 0 |search | 140554 | 140539 15 0 |browse | 251661 | 245453 6208 0 |browse_productline| 214994 | 214972 22 0 |productdetail | 171808 | 171801 7 0 |customize1 | 361476 | 361454 22 0 3 |customize2 | 191662 | 191655 7 0 |customize3 | 131910 | 109207 22439 263 |cart | 113113 | 108852 4243 18 |login | 80750 | 76883 3738 129 |shipping | 75895 | 75895 0 0 |billing | 72162 | 72160 2 0 |confirm | 54125 | 54124 1 0 |------------------|------------|------------------------------------ | TOTAL | 2140149 | 2097431 42307 410 Iter-| | Byte | Weighted | Avg Resp | Average ation| Request Type | Rate | ABR | (sec) | Bytes -----|------------------|------------|------------|----------|---------- |index | 74,188.2 | 10,587.8 | 1.862 | 138147 |search | 91,711.0 | 7,327.8 | 2.077 | 190496 |browse | 78,432.9 | 10,827.8 | 2.004 | 157210 |browse_productline| 91,478.8 | 11,371.6 | 2.112 | 193265 |productdetail | 45,153.8 | 2,511.9 | 1.183 | 53421 |customize1 | 89,313.6 | 16,323.5 | 1.847 | 165003 3 |customize2 | 89,222.5 | 8,616.6 | 1.841 | 164270 |customize3 | 75,929.6 | 6,350.6 | 2.316 | 175912 |cart | 54,259.1 | 2,245.1 | 1.336 | 72525 |login | 57,903.6 | 1,061.2 | 0.829 | 48018 |shipping | 64,613.3 | 889.7 | 0.662 | 42834 |billing | 45,623.9 | 643.8 | 0.714 | 32597 |confirm | 52,589.3 | 464.4 | 0.596 | 31349 |------------------|------------|------------|----------|---------- | TOTAL | - | 79,221.7 | - | - ECOMMERCE NOTES SUT Notes --------- * 146GB Drive used for OS/SWAP/Logs * Each Fibre Channel enclosure represents a single volume and mount point * Files are evenly distributed across the 5 RAID 0 volumes * Boot drive contains soft links to the directories Operating System Notes ---------------------- * net.ipv4.icmp_echo_ignore_broadcasts = 1, enable ignoring broadcast requests, default 0 * net.ipv4.conf.all.rp_filter = 1, enable source route verification, default 0 * net.ipv4.ip_forward=1, enable IP forwarding, default 0 * net.ipv4.tcp_timestamps = 0, turns TCP timestamp support off, default 1 * net.ipv4.tcp_max_tw_buckets = 2000000, sets TCP time-wait buckets pool size, default 180000 * net.core.optmem_max = 10000000, maximum amount of option memory buffers, default 20480 * net.core.rmem_default = 10000000, default receive socket buffer size, default 65535 * net.core.rmem_max = 10000000, maximum receive socket buffer size, default 131071 * net.core.wmem_default = 10000000, default send socket buffer size * net.core.wmem_max = 10000000, maximum send socket buffer size, default 131071 * net.ipv4.tcp_rmem = 30000000 30000000 30000000, maximum TCP read-buffer space allocatable, default 4096 87380 174760 * net.ipv4.tcp_wmem = 30000000 30000000 30000000, maximum TCP write-buffer space allocatable, default 4096 87380 174760 * net.ipv4.tcp_mem = 30000000 30000000 30000000, maximum TCP buffer space, default 392192 392704 393216 * net.ipv4.tcp_max_syn_backlog = 12000, default 1024 * fs.file-max = 5000000, sets number of open file handles kernel allocates, default 904396 * net.core.somaxconn = 10000, size of the listen queue for accepting new TCP connections, default 128 * net.core.netdev_max_backlog=400000, number of unprocessed input packets before kernel starts dropping them, default 300 * net.ipv4.tcp_dsack=0, turns DSACK support off, default on * net.ipv4.tcp_sack=0, turns SACK support off, default on * net.ipv4.tcp_window_scaling=0, turns TCP window scaling suport off, default on * Each NICs txqueuelen set to 60000, default 1000 * irqbalancer service was enabled during run * ulimit -n 1000000, sets number of open files, default 1024 * ulimit -u 1000000, sets max user processes, default 70656 * No modifications to default kernel configuration * /etc/inittab, id:3:initdefault:, Run Level 3 Web Server Software Notes ------------------------- * server_log httpd.log * validate_static -1, disables static file modification validation, default 0 * validate_httpmod -1, disables HTTP module modificatoin validation, default 0 * header_etag_on 0, disables etag header in HTTP replies, default 1 * header_server_on 0, disables server header in HTTP replies, default 1 * tcp_send_buf_size 1048576, sets socket send buffer size, default OS default * log_buf_size 1048576, sets access log buffer size, default 65536 * direct_io 1, uses direct IO when possible * connection_timeout 200, connection inactivity timeout, default 60 * worker 192.0.1.100/80 192.0.1.100/443 192.0.1.100/9090 * worker 192.0.2.100/80 192.0.2.100/443 * worker 192.0.3.100/80 192.0.3.100/443 * worker 192.0.4.100/80 192.0.4.100/443 * keepalive_max 100000, max. keepalive requests on a connection, default 100 * cache_memory_size 8192, (support), cache manager memory, default 0 * cache_file_max_size 4194304 (support), * servlet_session_count 57917, (bank/ecom) estimate number of servlet sessions, default 23191 * servlet_session_timeout 800, (bank/ecom) servlet session timeout, default 600 * cache_replacement lru, (sup/ecom) least recently used policy for file replacement, default random * direct_io_size 1048576 (support) read buffer size for direct IO, default 65536 * write_chunk_size 1048576 (support) max. number of bytes to send to a client at one time, default 65536 * disk_worker_count 68, (support) number of threads to read data from disk for large files, default 21 * fast_read 1, (support) enable better read when IO wait time is long, default 0 * ;host; testserver:80 * document_root /root/sw2005/jakarta-tomcat-5.5.9/webapps * access_log access_port80.log * error_log error_port80.log * access_log_format commonlog * ;file; / * cgi_type gateway * cgi_regex .*jsp * cgi_listener localhost/8080 * ;/file; * ;/host; * ;host; testserver:443 * document_root /root/sw2005/jakarta-tomcat-5.5.9/webapps * ssl_key_file /root/sw2005/httpd/etc/key-cert/sample.key * ssl_cert_file /root/sw2005/httpd/etc/key-cert/sample.certificate * ssl_session_max 74931 * ssl_session_timeout 0 * access_log access_port443.log * error_log error_port443.log * access_log_format commonlog * ;file; / * cgi_type gateway * cgi_regex .*jsp * cgi_listener localhost/8080 * ;/file; * ;/host; * ;host; testserver:9090 * admin_server yes * ;file; / * home_page home.cgi * auth_type basic * auth_name Administrative Web Server * auth_user_file /root/sw2005/httpd/conf/password * cgi_type module * cgi_where internal * cgi_regex .*cgi * ;/file; * ;/host; * 1024-bit SSL key and cert generated by Rock Webserver admin console and used for this workload. HTTP Script Notes ----------------- * SPEC-provided JSP scripts used without modification * Apache Tomcat 5.5.9 is used as JSP engine * JAVA_OPTS = -Xms4000m -Xmx4000m -Xss512k -Xcompactexplicitgc -server -d64, optimize garbage collection for applications and set JVM heap size to 4GB, set stack size to 512KB * server.xml tuning: * maxThreads=15000, max number of sessions, default 150 * minSpareThreads=2048, number of threads created when connector starts, default 25 * maxSpareThreads=2048, max number of unused threads allowed, default 75 * acceptCount=10000, max queue length for connection requests, default 100 * maxHttpHeaderSize=8192, max size of HTTP header, default 4096 * connectionTimeout=0, msec connector will wait for request URI line to be presented, default 20000 * maxKeepAliveRequest=-1, allow an unlimited amount of pipelined or keep-alive HTTP requests, default 100 * disableUploadTimeout=true, allow servlet container to use a longer connection timeout, default false * Apache Tomcat 5.5.9 is supported by Covalent Technologies Client Notes ------------ * ulimit -n 1000000, sets number of open files, default 1024 * ulimit -u 1000000, sets max user processes, default 7168 * java -Xms512m -Xmx512m -Xss256k -Xcompactexplicitgc specwebclient BESIM Notes ----------- * BESIM is a physically separate machine * ulimit -n 1000000, sets number of open files, default 1024 * ulimit -u 1000000, sets max user processes, default 7168 * Apache using mod_fastcgi * Apache httpd.conf: * StartServer 100, specifies the number of child server processes that will be created by Apache on start-up, default 5 * MinSpareServers 250, specifies the minimum number of idle child server processes for Apache, which is not handling a request, default 5 * MaxSpareServers 1500, specifies the maximum number of idle child server processes for Apache, which is not handling a request, default 10 * MaxClients 1500, sets the limit on the number of simultaneous requests that can be supported, no more than this number of child server processes will be created, default 256 * MaxRequestsPerChild 0, specifies the number of requests that an individual child server process will handle (0 unlimited), default 0 * KeepAlive on, if set to On, specifies enabling persistent connections on this web server, default off * KeepAliveTimeout 600, specifies how much time, in seconds, Apache will wait for a subsequent request before closing the connection, default 15 * ServerLimit 1500, sets max configured value for MaxClients, default 16 * No additional fcgi tuning is implemented Other Notes ----------- * N/A ================================================================================ Errors for Ecommerce Workload Quality of Service Errors ------------------------- * No QOS Errors Found Validation Errors ----------------- * 1 Validation Errors for Iteration 2: client1 - customize1 * 1 Validation Errors for Iteration 2: client12:1098 - customize1 * 1 Validation Errors for Iteration 2: client5 - customize3 * 2 Validation Errors for Iteration 2: client7 - customize3 * 1 Validation Errors for Iteration 2: client8 - customize3 * 1 Validation Errors for Iteration 2: client13:1098 - customize3 * 1 Validation Errors for Iteration 2: client16:1098 - customize3 * 1 Validation Errors for Iteration 2: client30:1098 - customize3 * 1 Validation Errors for Iteration 2: client34:1098 - customize3 * 1 Validation Errors for Iteration 2: client4 - cart * 2 Validation Errors for Iteration 2: client5 - cart * 1 Validation Errors for Iteration 2: client6 - cart * 1 Validation Errors for Iteration 2: client7 - cart * 1 Validation Errors for Iteration 2: client8 - cart * 1 Validation Errors for Iteration 2: client9 - cart * 1 Validation Errors for Iteration 2: client12:1098 - cart * 1 Validation Errors for Iteration 2: client14:1098 - cart * 1 Validation Errors for Iteration 2: client16:1098 - cart * 1 Validation Errors for Iteration 2: client18:1098 - cart * 1 Validation Errors for Iteration 2: client19:1098 - cart * 1 Validation Errors for Iteration 2: client26:1098 - cart * 1 Validation Errors for Iteration 2: client28:1098 - cart * 1 Validation Errors for Iteration 2: client31:1098 - cart * 2 Validation Errors for Iteration 2: client34:1098 - cart * 1 Validation Errors for Iteration 3: client34:1098 - customize3 Support Run Details Iter-| | Total | QOS ation| Request Type | Reqs | Good Toler Fail -----|------------------|------------|------------------------------------ |home | 124024 | 123976 48 0 |search | 193911 | 193911 0 0 |catalog | 178920 | 178920 0 0 1 |product | 379537 | 376620 2914 3 |fileCatalog | 345651 | 341326 4321 4 |file | 207331 | 203237 4070 24 |download | 103326 | 103266 53 7 |------------------|------------|------------------------------------ | TOTAL | 1532700 | 1521256 11406 38 Iter-| | Byte | Weighted | Avg Resp | Average ation| Request Type | Rate | ABR | (sec) | Bytes -----|------------------|------------|------------|----------|---------- |home | 72,732.4 | 860.6 | 0.829 | 60318 |search | 57,006.6 | 607.5 | 0.477 | 27235 |catalog | 65,402.2 | 704.5 | 0.523 | 34228 1 |product | 59,148.2 | 2,925.5 | 1.132 | 67008 |fileCatalog | 70,816.4 | 4,204.9 | 1.493 | 105752 |file | 74,150.4 | 2,963.7 | 1.675 | 124265 |download | 99,999.8 | 81,793.1 | 68.815 | 6881526 |------------------|------------|------------|----------|---------- | TOTAL | - | 94,059.8 | - | - Iter-| | Total | QOS ation| Request Type | Reqs | Good Toler Fail -----|------------------|------------|------------------------------------ |home | 123374 | 123374 0 0 |search | 192566 | 192566 0 0 |catalog | 178025 | 178025 0 0 2 |product | 376777 | 372193 4584 0 |fileCatalog | 343143 | 336172 6971 0 |file | 206031 | 199275 6756 0 |download | 102760 | 102705 46 9 |------------------|------------|------------------------------------ | TOTAL | 1522676 | 1504310 18357 9 Iter-| | Byte | Weighted | Avg Resp | Average ation| Request Type | Rate | ABR | (sec) | Bytes -----|------------------|------------|------------|----------|---------- |home | 70,764.8 | 849.7 | 0.852 | 60309 |search | 54,293.9 | 598.8 | 0.501 | 27233 |catalog | 63,635.4 | 695.9 | 0.537 | 34231 2 |product | 54,974.2 | 2,883.2 | 1.218 | 67012 |fileCatalog | 67,312.3 | 4,143.4 | 1.570 | 105742 |file | 70,888.8 | 2,923.6 | 1.752 | 124264 |download | 99,999.9 | 81,078.4 | 69.095 | 6909537 |------------------|------------|------------|----------|---------- | TOTAL | - | 93,173.0 | - | - Iter-| | Total | QOS ation| Request Type | Reqs | Good Toler Fail -----|------------------|------------|------------------------------------ |home | 122891 | 122877 14 0 |search | 191691 | 191691 0 0 |catalog | 177168 | 177168 0 0 3 |product | 374592 | 366670 7920 2 |fileCatalog | 340984 | 330381 10603 0 |file | 204940 | 195214 9711 15 |download | 102373 | 102311 53 9 |------------------|------------|------------------------------------ | TOTAL | 1514639 | 1486312 28301 26 Iter-| | Byte | Weighted | Avg Resp | Average ation| Request Type | Rate | ABR | (sec) | Bytes -----|------------------|------------|------------|----------|---------- |home | 68,570.7 | 844.4 | 0.879 | 60310 |search | 51,321.1 | 594.6 | 0.530 | 27225 |catalog | 61,192.8 | 691.0 | 0.559 | 34233 3 |product | 52,188.1 | 2,859.6 | 1.283 | 67007 |fileCatalog | 64,903.6 | 4,108.2 | 1.629 | 105754 |file | 68,611.3 | 2,901.4 | 1.811 | 124267 |download | 100,000.1 | 80,443.3 | 68.973 | 6897392 |------------------|------------|------------|----------|---------- | TOTAL | - | 92,442.3 | - | - SUPPORT NOTES SUT Notes --------- * 146GB Drive used for OS/SWAP/Logs * Each Fibre Channel enclosure represents a single volume and mount point * Files are evenly distributed across the 5 RAID 0 volumes * Boot drive contains soft links to the directories Operating System Notes ---------------------- * net.ipv4.icmp_echo_ignore_broadcasts = 1, enable ignoring broadcast requests, default 0 * net.ipv4.conf.all.rp_filter = 1, enable source route verification, default 0 * net.ipv4.ip_forward=1, enable IP forwarding, default 0 * net.ipv4.tcp_timestamps = 0, turns TCP timestamp support off, default 1 * net.ipv4.tcp_max_tw_buckets = 2000000, sets TCP time-wait buckets pool size, default 180000 * net.core.optmem_max = 10000000, maximum amount of option memory buffers, default 20480 * net.core.rmem_default = 10000000, default receive socket buffer size, default 65535 * net.core.rmem_max = 10000000, maximum receive socket buffer size, default 131071 * net.core.wmem_default = 10000000, default send socket buffer size * net.core.wmem_max = 10000000, maximum send socket buffer size, default 131071 * net.ipv4.tcp_rmem = 30000000 30000000 30000000, maximum TCP read-buffer space allocatable, default 4096 87380 174760 * net.ipv4.tcp_wmem = 30000000 30000000 30000000, maximum TCP write-buffer space allocatable, default 4096 87380 174760 * net.ipv4.tcp_mem = 30000000 30000000 30000000, maximum TCP buffer space, default 392192 392704 393216 * net.ipv4.tcp_max_syn_backlog = 12000, default 1024 * fs.file-max = 5000000, sets number of open file handles kernel allocates, default 904396 * net.core.somaxconn = 10000, size of the listen queue for accepting new TCP connections, default 128 * net.core.netdev_max_backlog=400000, number of unprocessed input packets before kernel starts dropping them, default 300 * net.ipv4.tcp_dsack=0, turns DSACK support off, default on * net.ipv4.tcp_sack=0, turns SACK support off, default on * net.ipv4.tcp_window_scaling=0, turns TCP window scaling suport off, default on * Each NICs txqueuelen set to 60000, default 1000 * irqbalancer service was enabled during run * ulimit -n 1000000, sets number of open files, default 1024 * ulimit -u 1000000, sets max user processes, default 70656 * No modifications to default kernel configuration * /etc/inittab, id:3:initdefault:, Run Level 3 Web Server Software Notes ------------------------- * server_log httpd.log * validate_static -1, disables static file modification validation, default 0 * validate_httpmod -1, disables HTTP module modificatoin validation, default 0 * header_etag_on 0, disables etag header in HTTP replies, default 1 * header_server_on 0, disables server header in HTTP replies, default 1 * tcp_send_buf_size 1048576, sets socket send buffer size, default OS default * log_buf_size 1048576, sets access log buffer size, default 65536 * direct_io 1, uses direct IO when possible * connection_timeout 200, connection inactivity timeout, default 60 * worker 192.0.1.100/80 192.0.1.100/443 192.0.1.100/9090 * worker 192.0.2.100/80 192.0.2.100/443 * worker 192.0.3.100/80 192.0.3.100/443 * worker 192.0.4.100/80 192.0.4.100/443 * keepalive_max 100000, max. keepalive requests on a connection, default 100 * cache_memory_size 8192, (support), cache manager memory, default 0 * cache_file_max_size 4194304 (support), * servlet_session_count 57917, (bank/ecom) estimate number of servlet sessions, default 23191 * servlet_session_timeout 800, (bank/ecom) servlet session timeout, default 600 * cache_replacement lru, (sup/ecom) least recently used policy for file replacement, default random * direct_io_size 1048576 (support) read buffer size for direct IO, default 65536 * write_chunk_size 1048576 (support) max. number of bytes to send to a client at one time, default 65536 * disk_worker_count 68, (support) number of threads to read data from disk for large files, default 21 * fast_read 1, (support) enable better read when IO wait time is long, default 0 * ;host; testserver:80 * document_root /root/sw2005/jakarta-tomcat-5.5.9/webapps * access_log access_port80.log * error_log error_port80.log * access_log_format commonlog * ;file; / * cgi_type gateway * cgi_regex .*jsp * cgi_listener localhost/8080 * ;/file; * ;/host; * ;host; testserver:443 * document_root /root/sw2005/jakarta-tomcat-5.5.9/webapps * ssl_key_file /root/sw2005/httpd/etc/key-cert/sample.key * ssl_cert_file /root/sw2005/httpd/etc/key-cert/sample.certificate * ssl_session_max 74931 * ssl_session_timeout 0 * access_log access_port443.log * error_log error_port443.log * access_log_format commonlog * ;file; / * cgi_type gateway * cgi_regex .*jsp * cgi_listener localhost/8080 * ;/file; * ;/host; * ;host; testserver:9090 * admin_server yes * ;file; / * home_page home.cgi * auth_type basic * auth_name Administrative Web Server * auth_user_file /root/sw2005/httpd/conf/password * cgi_type module * cgi_where internal * cgi_regex .*cgi * ;/file; * ;/host; HTTP Script Notes ----------------- * SPEC-provided JSP scripts used without modification * Apache Tomcat 5.5.9 is used as JSP engine * JAVA_OPTS = -Xms4000m -Xmx4000m -Xss512k -Xcompactexplicitgc -server -d64, optimize garbage collection for applications and set JVM heap size to 4GB, set stack size to 512KB * server.xml tuning: * maxThreads=15000, max number of sessions, default 150 * minSpareThreads=2048, number of threads created when connector starts, default 25 * maxSpareThreads=2048, max number of unused threads allowed, default 75 * acceptCount=10000, max queue length for connection requests, default 100 * maxHttpHeaderSize=8192, max size of HTTP header, default 4096 * connectionTimeout=0, msec connector will wait for request URI line to be presented, default 20000 * maxKeepAliveRequest=-1, allow an unlimited amount of pipelined or keep-alive HTTP requests, default 100 * disableUploadTimeout=true, allow servlet container to use a longer connection timeout, default false * Apache Tomcat 5.5.9 is supported by Covalent Technologies Client Notes ------------ * ulimit -n 1000000, sets number of open files, default 1024 * ulimit -u 1000000, sets max user processes, default 7168 * java -Xms512m -Xmx512m -Xss256k -Xcompactexplicitgc specwebclient BESIM Notes ----------- * BESIM is a physically separate machine * ulimit -n 1000000, sets number of open files, default 1024 * ulimit -u 1000000, sets max user processes, default 7168 * Apache using mod_fastcgi * Apache httpd.conf: * StartServer 100, specifies the number of child server processes that will be created by Apache on start-up, default 5 * MinSpareServers 250, specifies the minimum number of idle child server processes for Apache, which is not handling a request, default 5 * MaxSpareServers 1500, specifies the maximum number of idle child server processes for Apache, which is not handling a request, default 10 * MaxClients 1500, sets the limit on the number of simultaneous requests that can be supported, no more than this number of child server processes will be created, default 256 * MaxRequestsPerChild 0, specifies the number of requests that an individual child server process will handle (0 unlimited), default 0 * KeepAlive on, if set to On, specifies enabling persistent connections on this web server, default off * KeepAliveTimeout 600, specifies how much time, in seconds, Apache will wait for a subsequent request before closing the connection, default 15 * ServerLimit 1500, sets max configured value for MaxClients, default 16 * No additional fcgi tuning is implemented Other Notes ----------- * N/A ================================================================================ Errors for Support Workload Quality of Service Errors ------------------------- * No QOS Errors Found Validation Errors ----------------- * No Validation Errors Found For questions about this result, please contact the submitter: IBM Copyright (c) 2005 Standard Performance Evaluation Corporation