Laboratory/GridComparisonPartII/DAC-0.9.1

DAC 0.9.1 (comparison of the grid/cloud computing frameworks - part II)

Test environment

During fail-over tests we used the same test environment as in the part I of our comparison. However, we simulated node failures during our tests in the following order:

intel4 went down after 60 seconds from the beginning of computations
intel3 went down after 180 seconds from the beginning of computations
intel2 went down after 300 seconds from the beginning of computations

Please notice, that broker node is the most vulnerable part of the DAC framework. When it goes down, all other nodes also go down.

Code

During fail-over tests we used the same code as in the part I of our comparison. The only thing that has changed was new fail-over hook just before task generation phase. It allowed us to precisely synchronize the test environment.

You can find all the code in our repository: http://dacframe.org/lab

Results

You can see all the results with std deviation and average values on the following table:

DAC 0.9.1 <-->

	Computation time	Repeated tasks
Average	881 464.00
Std Deviation	20 079.70
	872 904.00	24
	829 388.00	23
	889 100.00	24
	880 514.00	24
	892 788.00	24
	890 873.00	23
	893 421.00	24
	875 061.00	24
	894 587.00	24
	896 004,00	24

As you can see on the above table, both average time and std deviation are much bigger in the fail-over test than in our first comparison. Average time increased from 299 815.70 by 194%, std deviation increased from 160.37 by 12420%. However, only 23-24 tasks were computed several times (but default transaction timeouts are quite big). This means, that DAC is quite sensitive to unexpected node failures.