.Buildings.ThermalZones.ISO13790.Validation.BESTEST.UsersGuide .Buildings.ThermalZones.ISO13790.Validation.BESTEST.UsersGuideThe package Buildings.ThermalZones.ISO13790.Validation.BESTEST contains the models that were used for the BESTEST validation (ANSI/ASHRAE 2020).
All examples have a script that runs an annual simulation and plots the results with the minimum, mean and maximum value listed in the ANSI/ASHRAE Standard 140-2020.
The script compares the following quantities:
Heating and cooling is controlled using the PI controller Buildings.Controls.Continuous.LimPID.
Hourly averaged values and annual mean values are computed using an instance of Buildings.Controls.OBC.CDL.Reals.MovingAverage.
The data used for validation are from "RESULTS5-2A.xlsx" in folder "/Sec5-2AFiles/Informative Materials" of Supplemental Files for ANSI/ASHRAE Standard 140-2020, Method of Test for Evaluating Building Performance Simulation Software.
The simulations of cases with heating and cooling are validated by comparing the annual heating and cooling energy, the peak heating and cooling demand with the validation data. In addition, one day load profiles are also validated. The detailed comparison, which also shows the peak load hours, are shown in the table after the plots below. The simulation results obtained from the Modelica ISO13790 model are illustrated in black.
| Annual heating load (MWh) | |||||||||
| Case | Lower limit | Upper limit | BSIMAC | CSE | DeST | EnergyPlus | ESP-r | TRNSYS | ISO13790 |
|---|---|---|---|---|---|---|---|---|---|
| Case600 | 3.75 | 4.98 | 4.05 | 3.993 | 4.047 | 4.324 | 4.362 | 4.504 | 4.658 |
| Case610 | 3.61 | 5.27 | 4.163 | 4.066 | 4.144 | 4.375 | 4.527 | 4.592 | 4.784 |
| Case620 | 3.67 | 5.38 | 4.37 | 4.094 | 4.297 | 4.485 | 4.514 | 4.719 | 4.824 |
| Case630 | 3.69 | 6.12 | 4.923 | 4.356 | 4.677 | 4.784 | 5.051 | 5.139 | 5.097 |
| Case640 | 1.58 | 3.76 | 2.682 | 2.403 | 2.619 | 2.662 | 2.654 | 2.653 | 2.898 |
| Case650 | 0.00 | 0.00 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 |
| Case660 | 2.68 | 4.82 | 3.574 | 3.602 | 3.821 | 3.707 | 3.787 | 3.79 | 3.898 |
| Case670 | 4.00 | 7.96 | 5.484 | 5.3 | 5.573 | 5.616 | 5.975 | 6.14 | 7.381 |
| Case680 | 1.21 | 3.08 | 2.219 | 1.786 | 1.732 | 2.18 | 2.132 | 2.286 | 2.646 |
| Case685 | 4.08 | 5.75 | 4.532 | 4.574 | 4.646 | 4.877 | 4.904 | 5.042 | 5.063 |
| Case695 | 1.70 | 3.81 | 2.709 | 2.415 | 2.385 | 2.802 | 2.732 | 2.892 | 3.147 |
| Case900 | 1.04 | 2.28 | 1.726 | 1.379 | 1.591 | 1.664 | 1.585 | 1.814 | 1.833 |
| Case910 | 1.56 | 2.30 | 2.163 | 1.648 | 1.86 | 1.956 | 2.067 | 2.132 | 2.284 |
| Case920 | 2.55 | 4.20 | 3.5 | 2.956 | 3.259 | 3.337 | 3.3 | 3.607 | 3.65 |
| Case930 | 2.75 | 5.35 | 4.27 | 3.524 | 3.933 | 3.994 | 4.278 | 4.384 | 4.183 |
| Case940 | 0.22 | 1.91 | 1.389 | 0.863 | 1.149 | 1.067 | 1.015 | 1.169 | 1.242 |
| Case950 | 0.00 | 0.00 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 |
| Case980 | -0.61 | 1.28 | 0.72 | 0.246 | 0.266 | 0.411 | 0.351 | 0.45 | 0.494 |
| Case985 | 1.68 | 3.09 | 2.801 | 2.12 | 2.279 | 2.369 | 2.283 | 2.536 | 2.333 |
| Case995 | -0.15 | 2.02 | 1.33 | 0.755 | 0.77 | 1.006 | 0.905 | 1.077 | 0.927 |
| Annual cooling load (MWh) | |||||||||
| Case | Lower limit | Upper limit | BSIMAC | CSE | DeST | EnergyPlus | ESP-r | TRNSYS | ISO13790 |
| Case600 | 5.00 | 6.83 | 5.822 | 5.913 | 5.432 | 6.027 | 6.162 | 5.78 | 5.803 |
| Case610 | 2.74 | 6.03 | 4.299 | 4.382 | 4.173 | 4.333 | 4.233 | 4.117 | 4.602 |
| Case620 | 2.76 | 5.19 | 4.404 | 4.079 | 3.909 | 4.06 | 4.246 | 3.841 | 4.009 |
| Case630 | 1.08 | 4.42 | 3.074 | 3.02 | 2.787 | 2.836 | 2.595 | 2.573 | 2.954 |
| Case640 | 4.44 | 6.86 | 5.804 | 5.644 | 5.237 | 5.763 | 5.893 | 5.477 | 5.617 |
| Case650 | 3.46 | 5.88 | 4.629 | 4.654 | 4.186 | 4.817 | 4.945 | 4.632 | 4.821 |
| Case660 | 1.91 | 4.33 | 3.014 | 3.34 | 3.26 | 3.232 | 3.219 | 2.966 | 3.185 |
| Case670 | 5.05 | 7.67 | 6.539 | 6.578 | 5.954 | 6.623 | 6.52 | 6.198 | 4.975 |
| Case680 | 5.13 | 7.70 | 5.938 | 6.43 | 5.932 | 6.444 | 6.529 | 6.31 | 6.764 |
| Case685 | 7.70 | 10.14 | 9.13 | 8.859 | 8.238 | 9.119 | 9.121 | 8.851 | 8.651 |
| Case695 | 7.49 | 10.58 | 8.755 | 8.974 | 8.386 | 9.172 | 9.149 | 9.039 | 9.323 |
| Case900 | 2.35 | 2.60 | 2.714 | 2.464 | 2.383 | 2.489 | 2.488 | 2.267 | 2.284 |
| Case910 | 2.00 | 0.86 | 1.484 | 1.415 | 1.49 | 1.383 | 1.283 | 1.191 | 1.674 |
| Case920 | 2.43 | 3.08 | 3.128 | 2.789 | 2.706 | 2.731 | 2.814 | 2.549 | 2.684 |
| Case930 | 1.24 | 2.64 | 2.161 | 2.075 | 1.908 | 1.919 | 1.654 | 1.672 | 1.92 |
| Case940 | 2.24 | 3.14 | 2.613 | 2.397 | 2.343 | 2.424 | 2.428 | 2.203 | 2.251 |
| Case950 | 0.43 | 1.52 | 0.586 | 0.598 | 0.618 | 0.707 | 0.656 | 0.642 | 0.638 |
| Case980 | 3.52 | 4.49 | 3.501 | 3.995 | 3.758 | 3.712 | 3.775 | 3.519 | 3.658 |
| Case985 | 5.95 | 7.26 | 7.273 | 6.234 | 5.88 | 6.359 | 6.249 | 6.113 | 5.905 |
| Case995 | 6.58 | 8.41 | 7.482 | 7.202 | 6.771 | 7.203 | 7.149 | 7.064 | 7.077 |
| Peak heating load (kW) | ||||||||||||||
| Case | BSIMAC | CSE | DeST | EnergyPlus | ESP-r | TRNSYS | ISO13790 | |||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| kW | hour | kW | hour | kW | hour | kW | hour | kW | hour | kW | hour | kW | hour | |
| Case600 | 3.255 | 26-Nov:8 | 3.020 | 01-Jan:1 | 3.035 | 01-Jan:0 | 3.204 | 31-Dec:24 | 3.228 | 01-Jan:1 | 3.359 | 01-Jan:1 | 3.232 | 31-Dec:24 |
| Case610 | 3.166 | 26-Nov:8 | 3.021 | 01-Jan:1 | 3.039 | 01-Jan:0 | 3.192 | 31-Dec:24 | 3.233 | 01-Jan:1 | 3.360 | 01-Jan:1 | 3.236 | 31-Dec:24 |
| Case620 | 3.145 | 31-Dec:24 | 3.038 | 01-Jan:1 | 3.068 | 01-Jan:0 | 3.229 | 31-Dec:24 | 3.253 | 01-Jan:1 | 3.385 | 01-Jan:1 | 3.249 | 31-Dec:24 |
| Case630 | 3.252 | 31-Dec:24 | 3.039 | 01-Jan:1 | 3.072 | 01-Jan:0 | 3.207 | 31-Dec:24 | 3.259 | 01-Jan:1 | 3.388 | 01-Jan:1 | 3.251 | 31-Dec:24 |
| Case640 | 4.633 | 08-Feb:9 | 4.222 | 26-Nov:8 | 4.658 | 26-Nov:7 | 4.559 | 26-Nov:8 | 4.101 | 26-Nov:8 | 4.039 | 26-Nov:8 | 3.880 | 26-Nov:8 |
| Case650 | 0.000 | N/A | 0.000 | 01-Jan:1 | 0.000 | N/A | 0.000 | 01-Jan:1 | 0.000 | 01-Jan:1 | 0.000 | 31-Dec:0 | 0.000 | 31-Dec:24 |
| Case660 | 2.620 | 26-Nov:8 | 2.758 | 01-Jan:1 | 2.798 | 01-Jan:0 | 2.831 | 31-Dec:24 | 2.846 | 01-Jan:1 | 2.955 | 01-Jan:1 | 2.717 | 31-Dec:24 |
| Case670 | 4.122 | 26-Nov:8 | 3.655 | 01-Jan:1 | 3.812 | 01-Jan:0 | 3.854 | 26-Nov:7 | 3.992 | 26-Nov:7 | 4.221 | 26-Nov:8 | 4.516 | 31-Dec:24 |
| Case680 | 2.126 | 26-Nov:8 | 1.778 | 09-Feb:6 | 1.811 | 01-Jan:1 | 2.052 | 26-Nov:7 | 2.022 | 09-Feb:7 | 2.115 | 26-Nov:8 | 2.241 | 31-Dec:24 |
| Case685 | 3.169 | 26-Nov:8 | 3.032 | 01-Jan:1 | 3.054 | 01-Jan:0 | 3.223 | 31-Dec:24 | 3.247 | 01-Jan:1 | 3.374 | 01-Jan:1 | 3.233 | 31-Dec:24 |
| Case695 | 2.138 | 26-Nov:8 | 1.795 | 01-Jan:1 | 1.855 | 01-Jan:1 | 2.072 | 31-Dec:24 | 2.025 | 26-Nov:7 | 2.118 | 26-Nov:8 | 2.271 | 31-Dec:24 |
| Case900 | 2.551 | 08-Feb:24 | 2.443 | 09-Feb:6 | 2.453 | 09-Feb:5 | 2.687 | 09-Feb:6 | 2.633 | 09-Feb:7 | 2.778 | 09-Feb:7 | 2.640 | 9-Feb:6 |
| Case910 | 2.761 | 08-Feb:24 | 2.469 | 09-Feb:6 | 2.474 | 09-Feb:5 | 2.699 | 09-Feb:6 | 2.684 | 09-Feb:7 | 2.799 | 09-Feb:6 | 2.679 | 9-Feb:6 |
| Case920 | 2.895 | 26-Nov:8 | 2.512 | 09-Feb:6 | 2.513 | 09-Feb:5 | 2.770 | 09-Feb:6 | 2.706 | 09-Feb:7 | 2.864 | 09-Feb:6 | 2.728 | 9-Feb:6 |
| Case930 | 2.968 | 31-Dec:24 | 2.537 | 09-Feb:6 | 2.549 | 09-Feb:5 | 2.785 | 09-Feb:6 | 2.765 | 09-Feb:6 | 2.900 | 09-Feb:6 | 2.760 | 9-Feb:6 |
| Case940 | 3.882 | 08-Feb:9 | 3.052 | 01-Jan:9 | 3.659 | 09-Feb:7 | 3.143 | 31-Dec:9 | 3.122 | 09-Feb:9 | 3.405 | 01-Jan:9 | 3.111 | 9-Feb:9 |
| Case950 | 0.000 | N/A | 0.000 | 01-Jan:1 | 0.000 | N/A | 0.000 | 01-Jan:1 | 0.000 | 01-Jan:1 | 0.000 | 31-Dec:0 | 0.000 | 31-Dec:24 |
| Case980 | 1.693 | 08-Feb:24 | 1.254 | 09-Feb:6 | 1.382 | 09-Feb:5 | 1.538 | 09-Feb:6 | 1.473 | 09-Feb:7 | 1.592 | 09-Feb:7 | 1.706 | 9-Feb:6 |
| Case985 | 2.754 | 08-Feb:24 | 2.452 | 09-Feb:6 | 2.458 | 09-Feb:5 | 2.695 | 09-Feb:6 | 2.642 | 09-Feb:7 | 2.785 | 09-Feb:6 | 2.636 | 9-Feb:6 |
| Case995 | 1.711 | 26-Nov:8 | 1.370 | 09-Feb:6 | 1.462 | 09-Feb:5 | 1.622 | 09-Feb:6 | 1.560 | 09-Feb:7 | 1.662 | 09-Feb:6 | 1.740 | 9-Feb:6 |
| Peak cooling load (kW) | ||||||||||||||
| Case | BSIMAC | CSE | DeST | EnergyPlus | ESP-r | TRNSYS | ISO13790 | |||||||
| kW | hour | kW | hour | kW | hour | kW | hour | kW | hour | kW | hour | kW | hour | |
| Case600 | 5.650 | 22-Jan:15 | 6.481 | 22-Jan:14 | 5.422 | 22-Jan:14 | 6.352 | 22-Jan:14 | 6.193 | 22-Jan:14 | 6.046 | 22-Jan:14 | 5.570 | 22-Jan:14 |
| Case610 | 5.466 | 22-Jan:15 | 6.432 | 01-Dec:14 | 5.331 | 22-Jan:14 | 6.135 | 01-Dec:14 | 5.934 | 22-Jan:14 | 5.868 | 01-Dec:14 | 4.611 | 18-Oct:14 |
| Case620 | 4.704 | 26-Jun:18 | 4.493 | 26-Jun:17 | 3.955 | 26-Jun:17 | 4.797 | 26-Jun:17 | 4.622 | 26-Jun:17 | 4.588 | 26-Jun:17 | 4.384 | 26-Jun:18 |
| Case630 | 4.121 | 26-Jun:18 | 3.998 | 26-Jun:18 | 3.526 | 26-Jun:17 | 4.212 | 26-Jun:17 | 3.971 | 26-Jun:17 | 3.949 | 26-Jun:17 | 3.734 | 26-Jun:18 |
| Case640 | 5.650 | 22-Jan:15 | 6.429 | 22-Jan:14 | 5.365 | 22-Jan:14 | 6.297 | 22-Jan:14 | 6.127 | 22-Jan:14 | 5.967 | 22-Jan:14 | 5.516 | 22-Jan:14 |
| Case650 | 5.648 | 22-Jan:15 | 6.290 | 01-Dec:14 | 5.045 | 18-Oct:14 | 6.138 | 18-Oct:14 | 5.961 | 18-Oct:14 | 5.797 | 18-Oct:14 | 5.382 | 18-Oct:14 |
| Case660 | 3.343 | 18-Oct:15 | 3.933 | 01-Oct:13 | 3.355 | 11-Oct:14 | 3.770 | 18-Oct:14 | 3.530 | 01-Oct:14 | 3.457 | 18-Oct:14 | 3.344 | 18-Oct:14 |
| Case670 | 6.217 | 18-Oct:14 | 6.925 | 01-Oct:13 | 5.839 | 10-Oct:13 | 6.806 | 22-Jan:14 | 6.482 | 18-Oct:14 | 6.401 | 18-Oct:14 | 5.187 | 18-Oct:14 |
| Case680 | 5.761 | 22-Jan:15 | 7.051 | 22-Jan:14 | 5.861 | 22-Jan:14 | 6.770 | 22-Jan:14 | 6.676 | 22-Jan:14 | 6.557 | 22-Jan:14 | 6.281 | 22-Jan:14 |
| Case685 | 6.318 | 22-Jan:15 | 7.159 | 22-Jan:14 | 6.071 | 22-Jan:14 | 7.107 | 22-Jan:14 | 6.934 | 22-Jan:14 | 6.867 | 22-Jan:14 | 6.265 | 22-Jan:14 |
| Case695 | 6.232 | 22-Jan:15 | 7.541 | 22-Jan:14 | 6.355 | 22-Jan:14 | 7.334 | 22-Jan:14 | 7.239 | 22-Jan:14 | 7.175 | 22-Jan:14 | 6.829 | 22-Jan:14 |
| Case900 | 3.039 | 01-Oct:15 | 3.376 | 01-Oct:14 | 2.556 | 11-Sep:14 | 3.040 | 01-Oct:14 | 2.896 | 12-Oct:15 | 2.940 | 01-Oct:14 | 2.365 | 1-Oct:15 |
| Case910 | 2.493 | 18-Oct:14 | 2.722 | 02-Oct:15 | 2.103 | 12-Oct:14 | 2.222 | 18-Oct:15 | 2.212 | 02-Oct:15 | 2.081 | 12-Oct:15 | 2.012 | 11-Sep:15 |
| Case920 | 3.481 | 26-Jun:18 | 3.057 | 26-Jun:18 | 2.710 | 26-Jun:17 | 3.260 | 26-Jun:18 | 3.099 | 26-Jun:18 | 3.154 | 26-Jun:18 | 2.798 | 26-Jun:18 |
| Case930 | 3.052 | 26-Jun:18 | 2.662 | 26-Jun:18 | 2.335 | 26-Jun:17 | 2.782 | 26-Jun:18 | 2.494 | 26-Jun:18 | 2.613 | 26-Jun:18 | 2.365 | 26-Jun:18 |
| Case940 | 3.158 | 01-Oct:15 | 3.376 | 01-Oct:14 | 2.556 | 11-Sep:14 | 3.040 | 01-Oct:14 | 2.891 | 12-Oct:15 | 2.938 | 01-Oct:14 | 2.365 | 1-Oct:15 |
| Case950 | 2.366 | 10-Sep:15 | 2.364 | 04-Sep:15 | 2.054 | 11-Sep:14 | 2.388 | 11-Sep:15 | 2.202 | 10-Sep:15 | 2.236 | 11-Sep:15 | 1.940 | 11-Sep:16 |
| Case980 | 3.384 | 18-Oct:14 | 3.668 | 02-Oct:14 | 2.930 | 18-Oct:14 | 3.450 | 18-Oct:15 | 3.341 | 12-Oct:15 | 3.313 | 12-Oct:14 | 2.658 | 18-Oct:15 |
| Case985 | 3.977 | 18-Oct:14 | 4.225 | 01-Oct:14 | 3.208 | 11-Oct:14 | 3.915 | 18-Oct:15 | 3.736 | 12-Oct:15 | 3.885 | 01-Oct:14 | 3.053 | 1-Oct:15 |
| Case995 | 4.129 | 22-Jan:14 | 4.224 | 22-Jan:15 | 3.315 | 22-Jan:14 | 4.177 | 22-Jan:15 | 3.954 | 22-Jan:15 | 4.115 | 22-Jan:15 | 3.113 | 18-Oct:15 |
The following plots compare the maximum, minimum and average zone temperature simulated with the Modelica Buildings Library with the values simulated by other tools. The simulation is also validated by comparing one-day simulation results in different days, and by comparing the distribution of the annual temperature. The detailed comparisons, which also show the peak temperature hour, are shown in the table after the plots.
| Maximum temperature (°C) | ||||||||||||||
| Case | BSIMAC | CSE | DeST | EnergyPlus | ESP-r | TRNSYS | ISO13790 | |||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| °C | hour | °C | hour | °C | hour | °C | hour | °C | hour | °C | hour | °C | hour | |
| Case600FF | 63.4 | 18-Oct:17 | 68.4 | 01-Oct:16 | 65.0 | 11-Oct:15 | 63.8 | 18-Oct:16 | 64.6 | 01-Oct:16 | 62.4 | 01-Oct:15 | 67.0 | 18-Oct:16 |
| Case650FF | 62.1 | 18-Oct:17 | 66.8 | 01-Oct:16 | 62.6 | 11-Oct:15 | 62.5 | 18-Oct:16 | 63.3 | 01-Oct:16 | 61.1 | 01-Oct:15 | 66.2 | 18-Oct:16 |
| Case680FF | 72.5 | 22-Jan:17 | 78.5 | 22-Jan:16 | 75.0 | 12-Oct:15 | 70.1 | 22-Jan:16 | 72.2 | 12-Oct:16 | 69.8 | 22-Jan:16 | 77.1 | 22-Jan:16 |
| Case900FF | 46.0 | 01-Oct:17 | 45.1 | 04-Sep:15 | 44.5 | 11-Sep:15 | 44.3 | 12-Sep:15 | 44.3 | 12-Sep:16 | 43.3 | 12-Sep:15 | 43.4 | 11-Sep:16 |
| Case950FF | 37.1 | 01-Oct:17 | 36.8 | 11-Sep:15 | 36.4 | 11-Sep:15 | 36.7 | 11-Sep:16 | 36.4 | 05-Aug:16 | 36.1 | 11-Sep:16 | 36.6 | 11-Sep:16 |
| Case980FF | 49.7 | 01-Oct:17 | 52.2 | 12-Sep:15 | 52.8 | 21-Oct:14 | 49.6 | 12-Sep:16 | 50.2 | 12-Sep:15 | 48.5 | 12-Sep:15 | 49.9 | 12-Sep:16 |
| Minimum temperature (°C) | ||||||||||||||
| Case | BSIMAC | CSE | DeST | EnergyPlus | ESP-r | TRNSYS | ISO13790 | |||||||
| °C | hour | °C | hour | °C | hour | °C | hour | °C | hour | °C | hour | °C | hour | |
| Case600FF | -9.9 | 26-Nov:8 | -12.9 | 09-Feb:7 | -13.5 | 09-Feb:6 | -12.6 | 09-Feb:7 | -13.5 | 09-Feb:7 | -13.8 | 09-Feb:7 | -12.9 | 9-Feb:7 |
| Case650FF | -16.7 | 31-Dec:24 | -17.8 | 01-Jan:1 | -17.4 | 30-Dec:23 | -17.1 | 31-Dec:24 | -17.5 | 01-Jan:1 | -17.5 | 31-Dec:24 | -17.5 | 31-Dec:24 |
| Case680FF | -5.7 | 08-Feb:11 | -6.2 | 09-Feb:7 | -6.9 | 09-Feb:7 | -7.1 | 09-Feb:7 | -7.2 | 09-Feb:7 | -8.1 | 09-Feb:7 | -9.2 | 9-Feb:7 |
| Case900FF | 0.6 | 08-Feb:11 | 2.2 | 09-Feb:7 | 1.3 | 09-Feb:7 | 1.2 | 09-Feb:7 | 1.6 | 09-Feb:7 | 0.6 | 09-Feb:7 | 0.3 | 9-Feb:7 |
| Case950FF | -13.2 | 31-Dec:24 | -13.2 | 01-Jan:1 | -13.4 | 30-Dec:23 | -12.8 | 09-Feb:7 | -12.5 | 09-Feb:6 | -12.8 | 09-Feb:6 | -13.4 | 31-Dec:24 |
| Case980FF | 7.3 | 08-Feb:11 | 12.5 | 04-Nov:7 | 12.4 | 05-Nov:6 | 9.9 | 04-Nov:7 | 10.5 | 04-Nov:8 | 9.5 | 04-Nov:7 | 8.6 | 4-Nov:7 |
To generate the data shown in this user guide, run
cd Buildings/Resources/src/ThermalZones/ISO13790/Validation/BESTEST python3 simulateAndPlot.py
ANSI/ASHRAE. 2020. ANSI/ASHRAE Standard 140-2020, Standard Method of Test for the Evaluation of Building Energy Analysis Computer Programs.