# Model Validation

To validate the dynamic landcover model, we iteratively withheld 1/10th of the training data in a k-fold crossvalidation exercise on 50,000 training locations distributed across the Cascadia region. Each fold was spatially independent, so the withheld fold did not overlap in space with the training folds. The table below shows the producers, users, and overall accuracy averaged across the 10 folds in the crossvalidation.

<table data-full-width="true"><thead><tr><th width="179">Landcover Class</th><th>water</th><th width="114">snow_ice</th><th>barren</th><th width="121">emergent wetland</th><th width="129">woody wetland</th><th width="128">mesic grass forb</th><th width="124">xeric grass forb</th><th width="113">mesic shrub</th><th width="123">xeric shrub</th><th width="136">deciduous forest</th><th width="126">coniferous forest</th><th width="104">pasture</th><th width="112">mesic rowcrops</th><th>orchard</th><th width="119">xeric rowcrops</th><th>fallow</th><th width="134">developed high intensity</th><th width="133">developed medium intensity</th><th>user's accuracy</th></tr></thead><tbody><tr><td>water</td><td>2987</td><td>0</td><td>1</td><td>11</td><td>0</td><td>0</td><td>0</td><td>0</td><td>0</td><td>0</td><td>0</td><td>0</td><td>0</td><td>0</td><td>0</td><td>0</td><td>1</td><td>0</td><td>99.57%</td></tr><tr><td>snow_ice</td><td>0</td><td>974</td><td>24</td><td>0</td><td>0</td><td>0</td><td>0</td><td>1</td><td>0</td><td>1</td><td>0</td><td>0</td><td>0</td><td>0</td><td>0</td><td>0</td><td>0</td><td>0</td><td>97.40%</td></tr><tr><td>barren</td><td>3</td><td>18</td><td>2750</td><td>2</td><td>1</td><td>0</td><td>9</td><td>0</td><td>51</td><td>1</td><td>2</td><td>0</td><td>4</td><td>1</td><td>1</td><td>12</td><td>115</td><td>30</td><td>91.67%</td></tr><tr><td>emergent wetland</td><td>27</td><td>0</td><td>10</td><td>1960</td><td>168</td><td>46</td><td>25</td><td>42</td><td>15</td><td>12</td><td>5</td><td>92</td><td>17</td><td>36</td><td>4</td><td>5</td><td>15</td><td>21</td><td>78.40%</td></tr><tr><td>woody wetland</td><td>0</td><td>0</td><td>7</td><td>148</td><td>1783</td><td>27</td><td>0</td><td>74</td><td>2</td><td>161</td><td>268</td><td>6</td><td>3</td><td>10</td><td>0</td><td>0</td><td>2</td><td>9</td><td>71.32%</td></tr><tr><td>mesic grass forb</td><td>0</td><td>0</td><td>0</td><td>43</td><td>28</td><td>2799</td><td>0</td><td>953</td><td>1</td><td>31</td><td>82</td><td>24</td><td>9</td><td>3</td><td>7</td><td>2</td><td>0</td><td>18</td><td>69.98%</td></tr><tr><td>xeric grass forb</td><td>0</td><td>0</td><td>2</td><td>0</td><td>0</td><td>11</td><td>2096</td><td>0</td><td>354</td><td>0</td><td>0</td><td>0</td><td>1</td><td>0</td><td>6</td><td>28</td><td>0</td><td>2</td><td>83.84%</td></tr><tr><td>mesic shrub</td><td>0</td><td>0</td><td>0</td><td>36</td><td>28</td><td>1036</td><td>0</td><td>2478</td><td>1</td><td>113</td><td>267</td><td>14</td><td>3</td><td>10</td><td>1</td><td>0</td><td>0</td><td>13</td><td>61.95%</td></tr><tr><td>xeric shrub</td><td>0</td><td>0</td><td>62</td><td>1</td><td>0</td><td>4</td><td>275</td><td>2</td><td>2142</td><td>0</td><td>0</td><td>0</td><td>0</td><td>1</td><td>0</td><td>6</td><td>0</td><td>7</td><td>85.68%</td></tr><tr><td>deciduous forest</td><td>0</td><td>0</td><td>0</td><td>8</td><td>71</td><td>17</td><td>0</td><td>21</td><td>0</td><td>3867</td><td>16</td><td>0</td><td>0</td><td>0</td><td>0</td><td>0</td><td>0</td><td>0</td><td>96.68%</td></tr><tr><td>coniferous forest</td><td>0</td><td>0</td><td>9</td><td>9</td><td>207</td><td>76</td><td>1</td><td>345</td><td>6</td><td>120</td><td>4210</td><td>1</td><td>0</td><td>1</td><td>0</td><td>0</td><td>0</td><td>15</td><td>84.20%</td></tr><tr><td>pasture</td><td>0</td><td>0</td><td>0</td><td>119</td><td>5</td><td>77</td><td>9</td><td>14</td><td>2</td><td>0</td><td>2</td><td>1180</td><td>32</td><td>23</td><td>1</td><td>4</td><td>2</td><td>30</td><td>78.67%</td></tr><tr><td>mesic row crops</td><td>0</td><td>0</td><td>2</td><td>16</td><td>3</td><td>29</td><td>13</td><td>3</td><td>2</td><td>0</td><td>1</td><td>35</td><td>1594</td><td>121</td><td>121</td><td>50</td><td>0</td><td>10</td><td>79.70%</td></tr><tr><td>orchard</td><td>0</td><td>0</td><td>6</td><td>22</td><td>1</td><td>8</td><td>12</td><td>12</td><td>1</td><td>0</td><td>1</td><td>22</td><td>158</td><td>1199</td><td>0</td><td>30</td><td>0</td><td>28</td><td>79.93%</td></tr><tr><td>xeric row crops</td><td>0</td><td>0</td><td>11</td><td>13</td><td>1</td><td>29</td><td>24</td><td>8</td><td>7</td><td>1</td><td>1</td><td>4</td><td>165</td><td>8</td><td>827</td><td>394</td><td>0</td><td>7</td><td>55.13%</td></tr><tr><td>fallow</td><td>0</td><td>0</td><td>14</td><td>13</td><td>0</td><td>60</td><td>99</td><td>5</td><td>45</td><td>1</td><td>0</td><td>31</td><td>112</td><td>56</td><td>303</td><td>741</td><td>1</td><td>19</td><td>49.40%</td></tr><tr><td>developed high intensity</td><td>0</td><td>0</td><td>45</td><td>5</td><td>1</td><td>1</td><td>1</td><td>0</td><td>0</td><td>0</td><td>0</td><td>5</td><td>6</td><td>4</td><td>0</td><td>1</td><td>3458</td><td>473</td><td>86.45%</td></tr><tr><td>developed medium intensity</td><td>0</td><td>0</td><td>55</td><td>13</td><td>8</td><td>9</td><td>2</td><td>8</td><td>6</td><td>0</td><td>5</td><td>33</td><td>2</td><td>28</td><td>1</td><td>6</td><td>441</td><td>3383</td><td>84.58%</td></tr><tr><td>producer's accuracy</td><td>99.01%</td><td>98.19%</td><td>91.73%</td><td>81.03%</td><td>77.35%</td><td>66.19%</td><td>81.68%</td><td>62.48%</td><td>81.29%</td><td>89.76%</td><td>86.63%</td><td>81.55%</td><td>75.69%</td><td>79.88%</td><td>65.02%</td><td>57.94%</td><td>85.70%</td><td>83.22%</td><td></td></tr><tr><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td></tr><tr><td>overall accuracy</td><td>80.86%</td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td></tr></tbody></table>

&#x20;