Valid entries and size of groups

There is a total of 394 entries in the dataset. 59 participants failed the attention check or the comprehension check. The valid number of entries is n = 335.

Cell counts (3 x 2 design):

ai_training stakes n percentage
yes_ai low 58 17.31%
yes_ai high 58 17.31%
control low 51 15.22%
control high 55 16.42%
no_ai low 58 17.31%
no_ai high 55 16.42%

How to read this file

This is the item-level counterpart to the composite analysis. For each scale you get a Reliability diagnostics tab followed by a full 3x2 report for every individual item. When a composite’s α is below threshold in S2-analysis.Rmd, use the Reliability diagnostics here to find the offending item (look for a low or negative r.drop, or an alpha.drop row whose raw_alpha sits above the overall α), and use the per-item ANOVAs to check whether the items are telling a consistent story before you decide to drop or keep any of them.

Item-level analyses

Trust

Reliability diagnostics

Overall reliability
raw_alpha std_alpha avg_inter_item_r n_items
0.931 0.934 0.876 2
Reliability if an item is dropped (raw_alpha rising above the overall value flags a problem item)
raw_alpha std.alpha G6(smc) average_r S/N alpha se var.r med.r
comfort 0.976 0.876 0.767 0.876 7.041 NA 0 0.876
confidence 0.786 0.876 0.767 0.876 7.041 NA 0 0.876
Item statistics – r.drop is the corrected item-total correlation (low / negative = weak item)
n raw.r std.r r.cor r.drop mean sd
comfort 335 0.972 0.968 0.906 0.876 4.782 1.342
confidence 334 0.965 0.968 0.906 0.876 4.728 1.203

Comfort

Summary

Both factors
stakes ai_training variable n mean sd se ci
low yes_ai comfort 58 4.241 1.615 0.212 0.425
high yes_ai comfort 58 3.759 1.647 0.216 0.433
low control comfort 51 5.157 0.731 0.102 0.206
high control comfort 55 4.709 1.165 0.157 0.315
low no_ai comfort 58 5.552 0.654 0.086 0.172
high no_ai comfort 55 5.345 0.821 0.111 0.222
By ai_training
ai_training variable n mean sd se ci
yes_ai comfort 116 4.000 1.642 0.152 0.302
control comfort 106 4.925 1.002 0.097 0.193
no_ai comfort 113 5.451 0.744 0.070 0.139
By stakes
stakes variable n mean sd se ci
low comfort 167 4.976 1.232 0.095 0.188
high comfort 168 4.589 1.420 0.110 0.216

Two-Way ANOVA

## $output1
## Anova Table (Type II tests)
## 
## Response: comfort
##                    Sum Sq  Df F value    Pr(>F)    
## ai_training        123.17   2 43.6571 < 2.2e-16 ***
## stakes              11.99   1  8.4965  0.003802 ** 
## ai_training:stakes   1.28   2  0.4535  0.635770    
## Residuals          464.11 329                      
## ---
## Signif. codes:  0 '***' 0.001 '**' 0.01 '*' 0.05 '.' 0.1 ' ' 1
## 
## $output2
## # Effect Size for ANOVA (Type II)
## 
## Parameter          | Eta2 (partial) |       95% CI
## --------------------------------------------------
## ai_training        |           0.21 | [0.15, 1.00]
## stakes             |           0.03 | [0.00, 1.00]
## ai_training:stakes |       2.75e-03 | [0.00, 1.00]
## 
## - One-sided CIs: upper bound fixed at [1.00].
## $output3
## # Effect Size for ANOVA (Type II)
## 
## Parameter          | Cohen's f (partial) |      95% CI
## ------------------------------------------------------
## ai_training        |                0.52 | [0.41, Inf]
## stakes             |                0.16 | [0.07, Inf]
## ai_training:stakes |                0.05 | [0.00, Inf]
## 
## - One-sided CIs: upper bound fixed at [Inf].

Plots Two-Way

stakes group1 group2 n1 n2 p p.signif p.adj p.adj.signif effsize conf.low conf.high Cohens’ d
low yes_ai control 58 51 0.0000 **** 0.0001 *** -0.7151 -1.03 -0.41 moderate
low yes_ai no_ai 58 58 0.0000 **** 0.0000 **** -1.0638 -1.42 -0.77 large
low control no_ai 51 58 0.0641 ns 0.0641 ns -0.5714 -1.01 -0.17 moderate
high yes_ai control 58 55 0.0001 **** 0.0003 *** -0.6632 -1.06 -0.31 moderate
high yes_ai no_ai 58 55 0.0000 **** 0.0000 **** -1.2095 -1.61 -0.86 large
high control no_ai 55 55 0.0092 ** 0.0184 * -0.6312 -1.02 -0.24 moderate
ai_training group1 group2 n1 n2 p p.signif p.adj p.adj.signif effsize conf.low conf.high Cohens’ d
yes_ai low high 58 58 0.1140 ns 0.2280 ns 0.2960 -0.07 0.68 small
control low high 51 55 0.0208
0.0624 ns 0.4564 0.09 0.79 small
no_ai low high 58 55 0.1410 ns 0.2280 ns 0.2787 -0.06 0.66 small

One-Way ANOVAs

## $output1
## Anova Table (Type II tests)
## 
## Response: comfort
##             Sum Sq  Df F value    Pr(>F)    
## ai_training 123.71   2  43.019 < 2.2e-16 ***
## Residuals   477.38 332                      
## ---
## Signif. codes:  0 '***' 0.001 '**' 0.01 '*' 0.05 '.' 0.1 ' ' 1
## 
## $output2
## # Effect Size for ANOVA
## 
## Parameter   | Eta2 |       95% CI
## ---------------------------------
## ai_training | 0.21 | [0.14, 1.00]
## 
## - One-sided CIs: upper bound fixed at [1.00].
## $output3
## # Effect Size for ANOVA
## 
## Parameter   | Cohen's f |      95% CI
## -------------------------------------
## ai_training |      0.51 | [0.41, Inf]
## 
## - One-sided CIs: upper bound fixed at [Inf].
## $output1
## Anova Table (Type II tests)
## 
## Response: comfort
##           Sum Sq  Df F value   Pr(>F)   
## stakes     12.53   1  7.0879 0.008137 **
## Residuals 588.56 333                    
## ---
## Signif. codes:  0 '***' 0.001 '**' 0.01 '*' 0.05 '.' 0.1 ' ' 1
## 
## $output2
## # Effect Size for ANOVA
## 
## Parameter | Eta2 |       95% CI
## -------------------------------
## stakes    | 0.02 | [0.00, 1.00]
## 
## - One-sided CIs: upper bound fixed at [1.00].
## $output3
## # Effect Size for ANOVA
## 
## Parameter | Cohen's f |      95% CI
## -----------------------------------
## stakes    |      0.15 | [0.06, Inf]
## 
## - One-sided CIs: upper bound fixed at [Inf].

Plots One-Way

group1 group2 n1.x n2.x p p.signif p.adj p.adj.signif effsize n1.y n2.y conf.low conf.high Cohens’ d
yes_ai control 116 106 0.0000 **** 0.0000 **** -0.6728 116 106 -0.91 -0.43 moderate
yes_ai no_ai 116 113 0.0000 **** 0.0000 **** -1.1337 116 113 -1.39 -0.91 large
control no_ai 106 113 0.0013 ** 0.0013 ** -0.5998 106 113 -0.86 -0.34 moderate
group1 group2 n1.x n2.x p p.signif p.adj p.adj.signif effsize n1.y n2.y conf.low conf.high Cohens’ d
low high 167 168 0.0081 ** 0.0081 ** 0.2909 167 168 0.08 0.51 small

Regression (exploratory)

Confidence

Summary

Both factors
stakes ai_training variable n mean sd se ci
low yes_ai confidence 58 4.241 1.479 0.194 0.389
high yes_ai confidence 58 3.931 1.413 0.185 0.371
low control confidence 51 5.000 0.849 0.119 0.239
high control confidence 54 4.685 0.928 0.126 0.253
low no_ai confidence 58 5.276 0.790 0.104 0.208
high no_ai confidence 55 5.291 0.832 0.112 0.225
By ai_training
ai_training variable n mean sd se ci
yes_ai confidence 116 4.086 1.448 0.134 0.266
control confidence 105 4.838 0.900 0.088 0.174
no_ai confidence 113 5.283 0.807 0.076 0.150
By stakes
stakes variable n mean sd se ci
low confidence 167 4.832 1.175 0.091 0.180
high confidence 167 4.623 1.225 0.095 0.187

Two-Way ANOVA

## $output1
## Anova Table (Type II tests)
## 
## Response: confidence
##                    Sum Sq  Df F value    Pr(>F)    
## ai_training         83.61   2 34.8974 1.816e-14 ***
## stakes               3.39   1  2.8339   0.09325 .  
## ai_training:stakes   2.00   2  0.8365   0.43415    
## Residuals          392.92 328                      
## ---
## Signif. codes:  0 '***' 0.001 '**' 0.01 '*' 0.05 '.' 0.1 ' ' 1
## 
## $output2
## # Effect Size for ANOVA (Type II)
## 
## Parameter          | Eta2 (partial) |       95% CI
## --------------------------------------------------
## ai_training        |           0.18 | [0.12, 1.00]
## stakes             |       8.57e-03 | [0.00, 1.00]
## ai_training:stakes |       5.07e-03 | [0.00, 1.00]
## 
## - One-sided CIs: upper bound fixed at [1.00].
## $output3
## # Effect Size for ANOVA (Type II)
## 
## Parameter          | Cohen's f (partial) |      95% CI
## ------------------------------------------------------
## ai_training        |                0.46 | [0.36, Inf]
## stakes             |                0.09 | [0.00, Inf]
## ai_training:stakes |                0.07 | [0.00, Inf]
## 
## - One-sided CIs: upper bound fixed at [Inf].

Plots Two-Way

stakes group1 group2 n1 n2 p p.signif p.adj p.adj.signif effsize conf.low conf.high Cohens’ d
low yes_ai control 58 51 0.0004 *** 0.0015 ** -0.6192 -0.97 -0.30 moderate
low yes_ai no_ai 58 58 0.0000 **** 0.0000 **** -0.8726 -1.23 -0.58 large
low control no_ai 51 58 0.1910 ns 0.1910 ns -0.3373 -0.75 0.07 small
high yes_ai control 58 55 0.0004 *** 0.0015 ** NA NA NA NA
high yes_ai no_ai 58 55 0.0000 **** 0.0000 **** -1.1657 -1.60 -0.82 large
high control no_ai 55 55 0.0044 ** 0.0088 ** NA NA NA NA
ai_training group1 group2 n1 n2 p p.signif p.adj p.adj.signif effsize conf.low conf.high Cohens’ d
yes_ai low high 58 58 0.2500 ns 0.5000 ns 0.2146 -0.13 0.62 small
control low high 51 55 0.0731 ns 0.2193 ns NA NA NA NA
no_ai low high 58 55 0.9220 ns 0.9220 ns -0.0186 -0.39 0.36 negligible

One-Way ANOVAs

## $output1
## Anova Table (Type II tests)
## 
## Response: confidence
##             Sum Sq  Df F value    Pr(>F)    
## ai_training  83.88   2  34.853 1.836e-14 ***
## Residuals   398.32 331                      
## ---
## Signif. codes:  0 '***' 0.001 '**' 0.01 '*' 0.05 '.' 0.1 ' ' 1
## 
## $output2
## # Effect Size for ANOVA
## 
## Parameter   | Eta2 |       95% CI
## ---------------------------------
## ai_training | 0.17 | [0.11, 1.00]
## 
## - One-sided CIs: upper bound fixed at [1.00].
## $output3
## # Effect Size for ANOVA
## 
## Parameter   | Cohen's f |      95% CI
## -------------------------------------
## ai_training |      0.46 | [0.36, Inf]
## 
## - One-sided CIs: upper bound fixed at [Inf].
## $output1
## Anova Table (Type II tests)
## 
## Response: confidence
##           Sum Sq  Df F value Pr(>F)
## stakes      3.67   1  2.5445 0.1116
## Residuals 478.54 332               
## 
## $output2
## # Effect Size for ANOVA
## 
## Parameter |     Eta2 |       95% CI
## -----------------------------------
## stakes    | 7.61e-03 | [0.00, 1.00]
## 
## - One-sided CIs: upper bound fixed at [1.00].
## $output3
## # Effect Size for ANOVA
## 
## Parameter | Cohen's f |      95% CI
## -----------------------------------
## stakes    |      0.09 | [0.00, Inf]
## 
## - One-sided CIs: upper bound fixed at [Inf].

Plots One-Way

group1 group2 n1.x n2.x p p.signif p.adj p.adj.signif effsize n1.y n2.y conf.low conf.high Cohens’ d
yes_ai control 116 106 0.000 **** 0.000 **** -0.6168 116 105 -0.87 -0.39 moderate
yes_ai no_ai 116 113 0.000 **** 0.000 **** -1.0176 116 113 -1.29 -0.79 large
control no_ai 106 113 0.003 ** 0.003 ** -0.5218 105 113 -0.82 -0.24 moderate
group1 group2 n1.x n2.x p p.signif p.adj p.adj.signif effsize n1.y n2.y conf.low conf.high Cohens’ d
low high 167 168 0.112 ns 0.112 ns 0.1746 167 167 -0.05 0.43 negligible

Regression (exploratory)

Ability

Reliability diagnostics

Overall reliability
raw_alpha std_alpha avg_inter_item_r n_items
0.963 0.964 0.9 3
Reliability if an item is dropped (raw_alpha rising above the overall value flags a problem item)
raw_alpha std.alpha G6(smc) average_r S/N alpha se var.r med.r
ability1 0.948 0.949 0.902 0.902 18.431 0.006 NA 0.902
ability2 0.955 0.955 0.914 0.914 21.331 0.005 NA 0.914
ability3 0.935 0.938 0.883 0.883 15.138 0.007 NA 0.883
Item statistics – r.drop is the corrected item-total correlation (low / negative = weak item)
n raw.r std.r r.cor r.drop mean sd
ability1 335 0.963 0.965 0.940 0.921 4.973 1.144
ability2 333 0.964 0.961 0.928 0.914 4.775 1.287
ability3 334 0.971 0.972 0.954 0.937 4.964 1.162

Ability1

Summary

Both factors
stakes ai_training variable n mean sd se ci
low yes_ai ability1 58 4.466 1.404 0.184 0.369
high yes_ai ability1 58 4.138 1.492 0.196 0.392
low control ability1 51 5.216 0.757 0.106 0.213
high control ability1 55 5.018 0.680 0.092 0.184
low no_ai ability1 58 5.517 0.682 0.090 0.179
high no_ai ability1 55 5.545 0.662 0.089 0.179
By ai_training
ai_training variable n mean sd se ci
yes_ai ability1 116 4.302 1.452 0.135 0.267
control ability1 106 5.113 0.721 0.070 0.139
no_ai ability1 113 5.531 0.669 0.063 0.125
By stakes
stakes variable n mean sd se ci
low ability1 167 5.060 1.101 0.085 0.168
high ability1 168 4.887 1.181 0.091 0.180

Two-Way ANOVA

## $output1
## Anova Table (Type II tests)
## 
## Response: ability1
##                    Sum Sq  Df F value Pr(>F)    
## ai_training         89.35   2 42.8437 <2e-16 ***
## stakes               2.32   1  2.2235 0.1369    
## ai_training:stakes   1.85   2  0.8863 0.4132    
## Residuals          343.06 329                   
## ---
## Signif. codes:  0 '***' 0.001 '**' 0.01 '*' 0.05 '.' 0.1 ' ' 1
## 
## $output2
## # Effect Size for ANOVA (Type II)
## 
## Parameter          | Eta2 (partial) |       95% CI
## --------------------------------------------------
## ai_training        |           0.21 | [0.14, 1.00]
## stakes             |       6.71e-03 | [0.00, 1.00]
## ai_training:stakes |       5.36e-03 | [0.00, 1.00]
## 
## - One-sided CIs: upper bound fixed at [1.00].
## $output3
## # Effect Size for ANOVA (Type II)
## 
## Parameter          | Cohen's f (partial) |      95% CI
## ------------------------------------------------------
## ai_training        |                0.51 | [0.41, Inf]
## stakes             |                0.08 | [0.00, Inf]
## ai_training:stakes |                0.07 | [0.00, Inf]
## 
## - One-sided CIs: upper bound fixed at [Inf].

Plots Two-Way

stakes group1 group2 n1 n2 p p.signif p.adj p.adj.signif effsize conf.low conf.high Cohens’ d
low yes_ai control 58 51 0.0002 *** 0.0005 *** -0.6534 -0.99 -0.35 moderate
low yes_ai no_ai 58 58 0.0000 **** 0.0000 **** -0.9528 -1.29 -0.66 large
low control no_ai 51 58 0.1220 ns 0.1220 ns -0.4202 -0.83 -0.06 small
high yes_ai control 58 55 0.0000 **** 0.0000 **** -0.7525 -1.14 -0.42 moderate
high yes_ai no_ai 58 55 0.0000 **** 0.0000 **** -1.2087 -1.63 -0.90 large
high control no_ai 55 55 0.0081 ** 0.0162 * -0.7859 -1.28 -0.37 moderate
ai_training group1 group2 n1 n2 p p.signif p.adj p.adj.signif effsize conf.low conf.high Cohens’ d
yes_ai low high 58 58 0.226 ns 0.480 ns 0.2261 -0.14 0.62 small
control low high 51 55 0.160 ns 0.480 ns 0.2751 -0.09 0.68 small
no_ai low high 58 55 0.824 ns 0.824 ns -0.0420 -0.41 0.33 negligible

One-Way ANOVAs

## $output1
## Anova Table (Type II tests)
## 
## Response: ability1
##             Sum Sq  Df F value    Pr(>F)    
## ai_training  89.54   2  42.805 < 2.2e-16 ***
## Residuals   347.22 332                      
## ---
## Signif. codes:  0 '***' 0.001 '**' 0.01 '*' 0.05 '.' 0.1 ' ' 1
## 
## $output2
## # Effect Size for ANOVA
## 
## Parameter   | Eta2 |       95% CI
## ---------------------------------
## ai_training | 0.21 | [0.14, 1.00]
## 
## - One-sided CIs: upper bound fixed at [1.00].
## $output3
## # Effect Size for ANOVA
## 
## Parameter   | Cohen's f |      95% CI
## -------------------------------------
## ai_training |      0.51 | [0.41, Inf]
## 
## - One-sided CIs: upper bound fixed at [Inf].
## $output1
## Anova Table (Type II tests)
## 
## Response: ability1
##           Sum Sq  Df F value Pr(>F)
## stakes      2.51   1  1.9216 0.1666
## Residuals 434.25 333               
## 
## $output2
## # Effect Size for ANOVA
## 
## Parameter |     Eta2 |       95% CI
## -----------------------------------
## stakes    | 5.74e-03 | [0.00, 1.00]
## 
## - One-sided CIs: upper bound fixed at [1.00].
## $output3
## # Effect Size for ANOVA
## 
## Parameter | Cohen's f |      95% CI
## -----------------------------------
## stakes    |      0.08 | [0.00, Inf]
## 
## - One-sided CIs: upper bound fixed at [Inf].

Plots One-Way

group1 group2 n1.x n2.x p p.signif p.adj p.adj.signif effsize n1.y n2.y conf.low conf.high Cohens’ d
yes_ai control 116 106 0.0000 **** 0.0000 **** -0.6983 116 106 -0.94 -0.46 moderate
yes_ai no_ai 116 113 0.0000 **** 0.0000 **** -1.0828 116 113 -1.34 -0.86 large
control no_ai 106 113 0.0027 ** 0.0027 ** -0.6012 106 113 -0.89 -0.32 moderate
group1 group2 n1.x n2.x p p.signif p.adj p.adj.signif effsize n1.y n2.y conf.low conf.high Cohens’ d
low high 167 168 0.167 ns 0.167 ns 0.1515 167 168 -0.07 0.37 negligible

Regression (exploratory)

Ability2

Summary

Both factors
stakes ai_training variable n mean sd se ci
low yes_ai ability2 58 4.241 1.537 0.202 0.404
high yes_ai ability2 57 3.842 1.677 0.222 0.445
low control ability2 51 5.059 0.835 0.117 0.235
high control ability2 55 4.709 0.896 0.121 0.242
low no_ai ability2 58 5.448 0.730 0.096 0.192
high no_ai ability2 54 5.407 0.765 0.104 0.209
By ai_training
ai_training variable n mean sd se ci
yes_ai ability2 115 4.043 1.613 0.150 0.298
control ability2 106 4.877 0.881 0.086 0.170
no_ai ability2 112 5.429 0.744 0.070 0.139
By stakes
stakes variable n mean sd se ci
low ability2 167 4.910 1.212 0.094 0.185
high ability2 166 4.639 1.349 0.105 0.207

Two-Way ANOVA

## $output1
## Anova Table (Type II tests)
## 
## Response: ability2
##                    Sum Sq  Df F value  Pr(>F)    
## ai_training        110.10   2 41.6949 < 2e-16 ***
## stakes               5.75   1  4.3577 0.03762 *  
## ai_training:stakes   2.11   2  0.8001 0.45017    
## Residuals          431.75 327                    
## ---
## Signif. codes:  0 '***' 0.001 '**' 0.01 '*' 0.05 '.' 0.1 ' ' 1
## 
## $output2
## # Effect Size for ANOVA (Type II)
## 
## Parameter          | Eta2 (partial) |       95% CI
## --------------------------------------------------
## ai_training        |           0.20 | [0.14, 1.00]
## stakes             |           0.01 | [0.00, 1.00]
## ai_training:stakes |       4.87e-03 | [0.00, 1.00]
## 
## - One-sided CIs: upper bound fixed at [1.00].
## $output3
## # Effect Size for ANOVA (Type II)
## 
## Parameter          | Cohen's f (partial) |      95% CI
## ------------------------------------------------------
## ai_training        |                0.50 | [0.40, Inf]
## stakes             |                0.12 | [0.02, Inf]
## ai_training:stakes |                0.07 | [0.00, Inf]
## 
## - One-sided CIs: upper bound fixed at [Inf].

Plots Two-Way

stakes group1 group2 n1 n2 p p.signif p.adj p.adj.signif effsize conf.low conf.high Cohens’ d
low yes_ai control 58 51 0.0002 *** 0.0007 *** -0.6496 -0.97 -0.31 moderate
low yes_ai no_ai 58 58 0.0000 **** 0.0000 **** -1.0033 -1.32 -0.70 large
low control no_ai 51 58 0.0679 ns 0.0679 ns -0.4990 -0.94 -0.14 small
high yes_ai control 58 55 0.0002 *** 0.0007 *** NA NA NA NA
high yes_ai no_ai 58 55 0.0000 **** 0.0000 **** NA NA NA NA
high control no_ai 55 55 0.0026 ** 0.0052 ** NA NA NA NA
ai_training group1 group2 n1 n2 p p.signif p.adj p.adj.signif effsize conf.low conf.high Cohens’ d
yes_ai low high 58 58 0.1860 ns 0.3720 ns NA NA NA NA
control low high 51 55 0.0404
0.1212 ns 0.4034 0.02 0.79 small
no_ai low high 58 55 0.7730 ns 0.7730 ns NA NA NA NA

One-Way ANOVAs

## $output1
## Anova Table (Type II tests)
## 
## Response: ability2
##             Sum Sq  Df F value    Pr(>F)    
## ai_training 110.49   2   41.47 < 2.2e-16 ***
## Residuals   439.62 330                      
## ---
## Signif. codes:  0 '***' 0.001 '**' 0.01 '*' 0.05 '.' 0.1 ' ' 1
## 
## $output2
## # Effect Size for ANOVA
## 
## Parameter   | Eta2 |       95% CI
## ---------------------------------
## ai_training | 0.20 | [0.14, 1.00]
## 
## - One-sided CIs: upper bound fixed at [1.00].
## $output3
## # Effect Size for ANOVA
## 
## Parameter   | Cohen's f |      95% CI
## -------------------------------------
## ai_training |      0.50 | [0.40, Inf]
## 
## - One-sided CIs: upper bound fixed at [Inf].
## $output1
## Anova Table (Type II tests)
## 
## Response: ability2
##           Sum Sq  Df F value  Pr(>F)  
## stakes      6.14   1  3.7375 0.05406 .
## Residuals 543.97 331                  
## ---
## Signif. codes:  0 '***' 0.001 '**' 0.01 '*' 0.05 '.' 0.1 ' ' 1
## 
## $output2
## # Effect Size for ANOVA
## 
## Parameter | Eta2 |       95% CI
## -------------------------------
## stakes    | 0.01 | [0.00, 1.00]
## 
## - One-sided CIs: upper bound fixed at [1.00].
## $output3
## # Effect Size for ANOVA
## 
## Parameter | Cohen's f |      95% CI
## -----------------------------------
## stakes    |      0.11 | [0.00, Inf]
## 
## - One-sided CIs: upper bound fixed at [Inf].

Plots One-Way

group1 group2 n1.x n2.x p p.signif p.adj p.adj.signif effsize n1.y n2.y conf.low conf.high Cohens’ d
yes_ai control 116 106 0e+00 **** 0e+00 **** -0.6346 115 106 -0.87 -0.40 moderate
yes_ai no_ai 116 113 0e+00 **** 0e+00 **** -1.0977 115 112 -1.37 -0.88 large
control no_ai 106 113 5e-04 *** 5e-04 *** -0.6778 106 112 -0.98 -0.42 moderate
group1 group2 n1.x n2.x p p.signif p.adj p.adj.signif effsize n1.y n2.y conf.low conf.high Cohens’ d
low high 167 168 0.0541 ns 0.0541 ns 0.2119 167 166 -0.0097 0.42 small

Regression (exploratory)

Ability3

Summary

Both factors
stakes ai_training variable n mean sd se ci
low yes_ai ability3 58 4.448 1.379 0.181 0.363
high yes_ai ability3 58 4.138 1.480 0.194 0.389
low control ability3 51 5.216 0.730 0.102 0.205
high control ability3 55 4.964 0.881 0.119 0.238
low no_ai ability3 58 5.569 0.652 0.086 0.171
high no_ai ability3 54 5.519 0.720 0.098 0.197
By ai_training
ai_training variable n mean sd se ci
yes_ai ability3 116 4.293 1.433 0.133 0.263
control ability3 106 5.085 0.818 0.079 0.158
no_ai ability3 112 5.545 0.683 0.065 0.128
By stakes
stakes variable n mean sd se ci
low ability3 167 5.072 1.090 0.084 0.166
high ability3 167 4.856 1.224 0.095 0.187

Two-Way ANOVA

## $output1
## Anova Table (Type II tests)
## 
## Response: ability3
##                    Sum Sq  Df F value  Pr(>F)    
## ai_training         91.14   2 42.2819 < 2e-16 ***
## stakes               3.50   1  3.2447 0.07257 .  
## ai_training:stakes   1.05   2  0.4864 0.61530    
## Residuals          353.50 328                    
## ---
## Signif. codes:  0 '***' 0.001 '**' 0.01 '*' 0.05 '.' 0.1 ' ' 1
## 
## $output2
## # Effect Size for ANOVA (Type II)
## 
## Parameter          | Eta2 (partial) |       95% CI
## --------------------------------------------------
## ai_training        |           0.20 | [0.14, 1.00]
## stakes             |       9.80e-03 | [0.00, 1.00]
## ai_training:stakes |       2.96e-03 | [0.00, 1.00]
## 
## - One-sided CIs: upper bound fixed at [1.00].
## $output3
## # Effect Size for ANOVA (Type II)
## 
## Parameter          | Cohen's f (partial) |      95% CI
## ------------------------------------------------------
## ai_training        |                0.51 | [0.41, Inf]
## stakes             |                0.10 | [0.00, Inf]
## ai_training:stakes |                0.05 | [0.00, Inf]
## 
## - One-sided CIs: upper bound fixed at [Inf].

Plots Two-Way

stakes group1 group2 n1 n2 p p.signif p.adj p.adj.signif effsize conf.low conf.high Cohens’ d
low yes_ai control 58 51 0.0001 **** 0.0003 *** -0.6833 -1.03 -0.38 moderate
low yes_ai no_ai 58 58 0.0000 **** 0.0000 **** -1.0392 -1.41 -0.74 large
low control no_ai 51 58 0.0636 ns 0.0636 ns -0.5125 -0.93 -0.14 moderate
high yes_ai control 58 55 0.0001 **** 0.0003 *** -0.6735 -1.04 -0.35 moderate
high yes_ai no_ai 58 55 0.0000 **** 0.0000 **** NA NA NA NA
high control no_ai 55 55 0.0086 ** 0.0171 * NA NA NA NA
ai_training group1 group2 n1 n2 p p.signif p.adj p.adj.signif effsize conf.low conf.high Cohens’ d
yes_ai low high 58 58 0.245 ns 0.490 ns 0.2170 -0.15 0.62 small
control low high 51 55 0.113 ns 0.339 ns 0.3104 -0.09 0.69 small
no_ai low high 58 55 0.698 ns 0.698 ns NA NA NA NA

One-Way ANOVAs

## $output1
## Anova Table (Type II tests)
## 
## Response: ability3
##             Sum Sq  Df F value    Pr(>F)    
## ai_training  91.52   2  42.304 < 2.2e-16 ***
## Residuals   358.05 331                      
## ---
## Signif. codes:  0 '***' 0.001 '**' 0.01 '*' 0.05 '.' 0.1 ' ' 1
## 
## $output2
## # Effect Size for ANOVA
## 
## Parameter   | Eta2 |       95% CI
## ---------------------------------
## ai_training | 0.20 | [0.14, 1.00]
## 
## - One-sided CIs: upper bound fixed at [1.00].
## $output3
## # Effect Size for ANOVA
## 
## Parameter   | Cohen's f |      95% CI
## -------------------------------------
## ai_training |      0.51 | [0.41, Inf]
## 
## - One-sided CIs: upper bound fixed at [Inf].
## $output1
## Anova Table (Type II tests)
## 
## Response: ability3
##           Sum Sq  Df F value  Pr(>F)  
## stakes      3.88   1  2.8904 0.09004 .
## Residuals 445.69 332                  
## ---
## Signif. codes:  0 '***' 0.001 '**' 0.01 '*' 0.05 '.' 0.1 ' ' 1
## 
## $output2
## # Effect Size for ANOVA
## 
## Parameter |     Eta2 |       95% CI
## -----------------------------------
## stakes    | 8.63e-03 | [0.00, 1.00]
## 
## - One-sided CIs: upper bound fixed at [1.00].
## $output3
## # Effect Size for ANOVA
## 
## Parameter | Cohen's f |      95% CI
## -----------------------------------
## stakes    |      0.09 | [0.00, Inf]
## 
## - One-sided CIs: upper bound fixed at [Inf].

Plots One-Way

group1 group2 n1.x n2.x p p.signif p.adj p.adj.signif effsize n1.y n2.y conf.low conf.high Cohens’ d
yes_ai control 116 106 0.0000 **** 0.0000 **** -0.6711 116 106 -0.93 -0.44 moderate
yes_ai no_ai 116 113 0.0000 **** 0.0000 **** -1.1090 116 112 -1.35 -0.87 large
control no_ai 106 113 0.0012 ** 0.0012 ** -0.6117 106 112 -0.88 -0.32 moderate
group1 group2 n1.x n2.x p p.signif p.adj p.adj.signif effsize n1.y n2.y conf.low conf.high Cohens’ d
low high 167 168 0.09 ns 0.09 ns 0.1861 167 167 -0.03 0.4 negligible

Regression (exploratory)

Benevolence

Reliability diagnostics

Overall reliability
raw_alpha std_alpha avg_inter_item_r n_items
0.889 0.889 0.728 3
Reliability if an item is dropped (raw_alpha rising above the overall value flags a problem item)
raw_alpha std.alpha G6(smc) average_r S/N alpha se var.r med.r
benevolence1 0.827 0.828 0.707 0.707 4.818 0.019 NA 0.707
benevolence2 0.891 0.892 0.806 0.806 8.300 0.012 NA 0.806
benevolence3 0.801 0.803 0.671 0.671 4.076 0.022 NA 0.671
Item statistics – r.drop is the corrected item-total correlation (low / negative = weak item)
n raw.r std.r r.cor r.drop mean sd
benevolence1 331 0.913 0.913 0.858 0.799 4.637 1.121
benevolence2 333 0.874 0.876 0.762 0.724 4.916 1.103
benevolence3 333 0.928 0.926 0.884 0.828 4.559 1.164

Benevolence1

Summary

Both factors
stakes ai_training variable n mean sd se ci
low yes_ai benevolence1 57 4.579 1.253 0.166 0.332
high yes_ai benevolence1 58 4.190 1.067 0.140 0.281
low control benevolence1 50 4.520 1.054 0.149 0.300
high control benevolence1 55 4.382 1.163 0.157 0.314
low no_ai benevolence1 57 4.947 0.990 0.131 0.263
high no_ai benevolence1 54 5.222 0.861 0.117 0.235
By ai_training
ai_training variable n mean sd se ci
yes_ai benevolence1 115 4.383 1.174 0.109 0.217
control benevolence1 105 4.448 1.109 0.108 0.215
no_ai benevolence1 111 5.081 0.936 0.089 0.176
By stakes
stakes variable n mean sd se ci
low benevolence1 164 4.689 1.116 0.087 0.172
high benevolence1 167 4.587 1.126 0.087 0.172

Two-Way ANOVA

## $output1
## Anova Table (Type II tests)
## 
## Response: benevolence1
##                    Sum Sq  Df F value    Pr(>F)    
## ai_training         32.86   2 14.2600 1.158e-06 ***
## stakes               0.63   1  0.5426    0.4619    
## ai_training:stakes   6.33   2  2.7455    0.0657 .  
## Residuals          374.45 325                      
## ---
## Signif. codes:  0 '***' 0.001 '**' 0.01 '*' 0.05 '.' 0.1 ' ' 1
## 
## $output2
## # Effect Size for ANOVA (Type II)
## 
## Parameter          | Eta2 (partial) |       95% CI
## --------------------------------------------------
## ai_training        |           0.08 | [0.04, 1.00]
## stakes             |       1.67e-03 | [0.00, 1.00]
## ai_training:stakes |           0.02 | [0.00, 1.00]
## 
## - One-sided CIs: upper bound fixed at [1.00].
## $output3
## # Effect Size for ANOVA (Type II)
## 
## Parameter          | Cohen's f (partial) |      95% CI
## ------------------------------------------------------
## ai_training        |                0.30 | [0.20, Inf]
## stakes             |                0.04 | [0.00, Inf]
## ai_training:stakes |                0.13 | [0.00, Inf]
## 
## - One-sided CIs: upper bound fixed at [Inf].

Plots Two-Way

stakes group1 group2 n1 n2 p p.signif p.adj p.adj.signif effsize conf.low conf.high Cohens’ d
low yes_ai control 58 51 0.7840 ns 0.7840 ns NA NA NA NA
low yes_ai no_ai 58 58 0.0774 ns 0.2322 ns NA NA NA NA
low control no_ai 51 58 0.0480
0.1920 ns NA NA NA NA
high yes_ai control 58 55 0.3270 ns 0.6540 ns -0.1724 -0.53 0.22 negligible
high yes_ai no_ai 58 55 0.0000 **** 0.0000 **** NA NA NA NA
high control no_ai 55 55 0.0000 **** 0.0002 *** NA NA NA NA
ai_training group1 group2 n1 n2 p p.signif p.adj p.adj.signif effsize conf.low conf.high Cohens’ d
yes_ai low high 58 58 0.0753 ns 0.2259 ns NA NA NA NA
control low high 51 55 0.5260 ns 0.5260 ns NA NA NA NA
no_ai low high 58 55 0.1220 ns 0.2440 ns NA NA NA NA

One-Way ANOVAs

## $output1
## Anova Table (Type II tests)
## 
## Response: benevolence1
##             Sum Sq  Df F value    Pr(>F)    
## ai_training   33.1   2  14.232 1.182e-06 ***
## Residuals    381.4 328                      
## ---
## Signif. codes:  0 '***' 0.001 '**' 0.01 '*' 0.05 '.' 0.1 ' ' 1
## 
## $output2
## # Effect Size for ANOVA
## 
## Parameter   | Eta2 |       95% CI
## ---------------------------------
## ai_training | 0.08 | [0.04, 1.00]
## 
## - One-sided CIs: upper bound fixed at [1.00].
## $output3
## # Effect Size for ANOVA
## 
## Parameter   | Cohen's f |      95% CI
## -------------------------------------
## ai_training |      0.29 | [0.20, Inf]
## 
## - One-sided CIs: upper bound fixed at [Inf].
## $output1
## Anova Table (Type II tests)
## 
## Response: benevolence1
##           Sum Sq  Df F value Pr(>F)
## stakes      0.86   1  0.6874 0.4077
## Residuals 413.63 329               
## 
## $output2
## # Effect Size for ANOVA
## 
## Parameter |     Eta2 |       95% CI
## -----------------------------------
## stakes    | 2.08e-03 | [0.00, 1.00]
## 
## - One-sided CIs: upper bound fixed at [1.00].
## $output3
## # Effect Size for ANOVA
## 
## Parameter | Cohen's f |      95% CI
## -----------------------------------
## stakes    |      0.05 | [0.00, Inf]
## 
## - One-sided CIs: upper bound fixed at [Inf].

Plots One-Way

group1 group2 n1.x n2.x p p.signif p.adj p.adj.signif effsize n1.y n2.y conf.low conf.high Cohens’ d
yes_ai control 116 106 0.655 ns 0.655 ns -0.0568 115 105 -0.33 0.20 negligible
yes_ai no_ai 116 113 0.000 **** 0.000 **** -0.6567 115 111 -0.94 -0.38 moderate
control no_ai 106 113 0.000 **** 0.000 **** -0.6188 105 111 -0.92 -0.35 moderate
group1 group2 n1.x n2.x p p.signif p.adj p.adj.signif effsize n1.y n2.y conf.low conf.high Cohens’ d
low high 167 168 0.408 ns 0.408 ns 0.0911 164 167 -0.13 0.32 negligible

Regression (exploratory)

Benevolence2

Summary

Both factors
stakes ai_training variable n mean sd se ci
low yes_ai benevolence2 58 4.759 1.302 0.171 0.342
high yes_ai benevolence2 58 4.828 0.976 0.128 0.257
low control benevolence2 51 4.725 1.133 0.159 0.319
high control benevolence2 55 4.745 1.220 0.165 0.330
low no_ai benevolence2 57 5.193 0.972 0.129 0.258
high no_ai benevolence2 54 5.241 0.867 0.118 0.237
By ai_training
ai_training variable n mean sd se ci
yes_ai benevolence2 116 4.793 1.146 0.106 0.211
control benevolence2 106 4.736 1.174 0.114 0.226
no_ai benevolence2 111 5.216 0.919 0.087 0.173
By stakes
stakes variable n mean sd se ci
low benevolence2 166 4.898 1.158 0.090 0.177
high benevolence2 167 4.934 1.048 0.081 0.160

Two-Way ANOVA

## $output1
## Anova Table (Type II tests)
## 
## Response: benevolence2
##                    Sum Sq  Df F value   Pr(>F)   
## ai_training         15.26   2  6.4281 0.001827 **
## stakes               0.18   1  0.1503 0.698526   
## ai_training:stakes   0.03   2  0.0140 0.986070   
## Residuals          388.24 327                    
## ---
## Signif. codes:  0 '***' 0.001 '**' 0.01 '*' 0.05 '.' 0.1 ' ' 1
## 
## $output2
## # Effect Size for ANOVA (Type II)
## 
## Parameter          | Eta2 (partial) |       95% CI
## --------------------------------------------------
## ai_training        |           0.04 | [0.01, 1.00]
## stakes             |       4.59e-04 | [0.00, 1.00]
## ai_training:stakes |       8.58e-05 | [0.00, 1.00]
## 
## - One-sided CIs: upper bound fixed at [1.00].
## $output3
## # Effect Size for ANOVA (Type II)
## 
## Parameter          | Cohen's f (partial) |      95% CI
## ------------------------------------------------------
## ai_training        |                0.20 | [0.10, Inf]
## stakes             |                0.02 | [0.00, Inf]
## ai_training:stakes |            9.26e-03 | [0.00, Inf]
## 
## - One-sided CIs: upper bound fixed at [Inf].

Plots Two-Way

stakes group1 group2 n1 n2 p p.signif p.adj p.adj.signif effsize conf.low conf.high Cohens’ d
low yes_ai control 58 51 0.8800 ns 1.0000 ns 0.0270 -0.34 0.40 negligible
low yes_ai no_ai 58 58 0.0436
0.1785 ns NA NA NA NA
low control no_ai 51 58 0.0357
0.1785 ns NA NA NA NA
high yes_ai control 58 55 0.6730 ns 1.0000 ns 0.0746 -0.30 0.43 negligible
high yes_ai no_ai 58 55 0.0357
0.1785 ns NA NA NA NA
high control no_ai 55 55 0.0132
0.0792 ns NA NA NA NA
ai_training group1 group2 n1 n2 p p.signif p.adj p.adj.signif effsize conf.low conf.high Cohens’ d
yes_ai low high 58 58 0.747 ns 1 ns -0.0599 -0.40 0.35 negligible
control low high 51 55 0.931 ns 1 ns -0.0169 -0.42 0.34 negligible
no_ai low high 58 55 0.786 ns 1 ns NA NA NA NA

One-Way ANOVAs

## $output1
## Anova Table (Type II tests)
## 
## Response: benevolence2
##             Sum Sq  Df F value   Pr(>F)   
## ai_training  15.20   2   6.455 0.001779 **
## Residuals   388.45 330                    
## ---
## Signif. codes:  0 '***' 0.001 '**' 0.01 '*' 0.05 '.' 0.1 ' ' 1
## 
## $output2
## # Effect Size for ANOVA
## 
## Parameter   | Eta2 |       95% CI
## ---------------------------------
## ai_training | 0.04 | [0.01, 1.00]
## 
## - One-sided CIs: upper bound fixed at [1.00].
## $output3
## # Effect Size for ANOVA
## 
## Parameter   | Cohen's f |      95% CI
## -------------------------------------
## ai_training |      0.20 | [0.10, Inf]
## 
## - One-sided CIs: upper bound fixed at [Inf].
## $output1
## Anova Table (Type II tests)
## 
## Response: benevolence2
##           Sum Sq  Df F value Pr(>F)
## stakes      0.11   1  0.0912 0.7629
## Residuals 403.53 331               
## 
## $output2
## # Effect Size for ANOVA
## 
## Parameter |     Eta2 |       95% CI
## -----------------------------------
## stakes    | 2.75e-04 | [0.00, 1.00]
## 
## - One-sided CIs: upper bound fixed at [1.00].
## $output3
## # Effect Size for ANOVA
## 
## Parameter | Cohen's f |      95% CI
## -----------------------------------
## stakes    |      0.02 | [0.00, Inf]
## 
## - One-sided CIs: upper bound fixed at [Inf].

Plots One-Way

group1 group2 n1.x n2.x p p.signif p.adj p.adj.signif effsize n1.y n2.y conf.low conf.high Cohens’ d
yes_ai control 116 106 0.6950 ns 0.6950 ns 0.0494 116 106 -0.22 0.33 negligible
yes_ai no_ai 116 113 0.0036 ** 0.0071 ** -0.4064 116 111 -0.68 -0.12 small
control no_ai 106 113 0.0012 ** 0.0037 ** -0.4571 106 111 -0.74 -0.20 small
group1 group2 n1.x n2.x p p.signif p.adj p.adj.signif effsize n1.y n2.y conf.low conf.high Cohens’ d
low high 167 168 0.763 ns 0.763 ns -0.0331 166 167 -0.25 0.17 negligible

Regression (exploratory)

Benevolence3

Summary

Both factors
stakes ai_training variable n mean sd se ci
low yes_ai benevolence3 57 4.351 1.356 0.180 0.360
high yes_ai benevolence3 58 4.121 1.093 0.144 0.288
low control benevolence3 51 4.510 1.120 0.157 0.315
high control benevolence3 55 4.400 1.099 0.148 0.297
low no_ai benevolence3 57 4.912 1.057 0.140 0.280
high no_ai benevolence3 55 5.073 0.979 0.132 0.265
By ai_training
ai_training variable n mean sd se ci
yes_ai benevolence3 115 4.235 1.231 0.115 0.227
control benevolence3 106 4.453 1.105 0.107 0.213
no_ai benevolence3 112 4.991 1.018 0.096 0.191
By stakes
stakes variable n mean sd se ci
low benevolence3 165 4.594 1.204 0.094 0.185
high benevolence3 168 4.524 1.126 0.087 0.172

Two-Way ANOVA

## $output1
## Anova Table (Type II tests)
## 
## Response: benevolence3
##                    Sum Sq  Df F value    Pr(>F)    
## ai_training         34.09   2 13.4829 2.362e-06 ***
## stakes               0.30   1  0.2408    0.6240    
## ai_training:stakes   2.26   2  0.8934    0.4103    
## Residuals          413.35 327                      
## ---
## Signif. codes:  0 '***' 0.001 '**' 0.01 '*' 0.05 '.' 0.1 ' ' 1
## 
## $output2
## # Effect Size for ANOVA (Type II)
## 
## Parameter          | Eta2 (partial) |       95% CI
## --------------------------------------------------
## ai_training        |           0.08 | [0.03, 1.00]
## stakes             |       7.36e-04 | [0.00, 1.00]
## ai_training:stakes |       5.43e-03 | [0.00, 1.00]
## 
## - One-sided CIs: upper bound fixed at [1.00].
## $output3
## # Effect Size for ANOVA (Type II)
## 
## Parameter          | Cohen's f (partial) |      95% CI
## ------------------------------------------------------
## ai_training        |                0.29 | [0.19, Inf]
## stakes             |                0.03 | [0.00, Inf]
## ai_training:stakes |                0.07 | [0.00, Inf]
## 
## - One-sided CIs: upper bound fixed at [Inf].

Plots Two-Way

stakes group1 group2 n1 n2 p p.signif p.adj p.adj.signif effsize conf.low conf.high Cohens’ d
low yes_ai control 58 51 0.4880 ns 0.4880 ns NA NA NA NA
low yes_ai no_ai 58 58 0.0125
0.0500 * NA NA NA NA
low control no_ai 51 58 0.0805 ns 0.2415 ns NA NA NA NA
high yes_ai control 58 55 0.1630 ns 0.3260 ns -0.2548 -0.63 0.12 small
high yes_ai no_ai 58 55 0.0000 **** 0.0000 **** -0.9162 -1.35 -0.54 large
high control no_ai 55 55 0.0011 ** 0.0053 ** -0.6466 -1.09 -0.27 moderate
ai_training group1 group2 n1 n2 p p.signif p.adj p.adj.signif effsize conf.low conf.high Cohens’ d
yes_ai low high 58 58 0.318 ns 0.954 ns NA NA NA NA
control low high 51 55 0.612 ns 0.954 ns 0.099 -0.29 0.52 negligible
no_ai low high 58 55 0.407 ns 0.954 ns NA NA NA NA

One-Way ANOVAs

## $output1
## Anova Table (Type II tests)
## 
## Response: benevolence3
##             Sum Sq  Df F value    Pr(>F)    
## ai_training  34.19   2  13.565 2.181e-06 ***
## Residuals   415.92 330                      
## ---
## Signif. codes:  0 '***' 0.001 '**' 0.01 '*' 0.05 '.' 0.1 ' ' 1
## 
## $output2
## # Effect Size for ANOVA
## 
## Parameter   | Eta2 |       95% CI
## ---------------------------------
## ai_training | 0.08 | [0.03, 1.00]
## 
## - One-sided CIs: upper bound fixed at [1.00].
## $output3
## # Effect Size for ANOVA
## 
## Parameter   | Cohen's f |      95% CI
## -------------------------------------
## ai_training |      0.29 | [0.19, Inf]
## 
## - One-sided CIs: upper bound fixed at [Inf].
## $output1
## Anova Table (Type II tests)
## 
## Response: benevolence3
##           Sum Sq  Df F value Pr(>F)
## stakes      0.41   1  0.3013 0.5834
## Residuals 449.70 331               
## 
## $output2
## # Effect Size for ANOVA
## 
## Parameter |     Eta2 |       95% CI
## -----------------------------------
## stakes    | 9.10e-04 | [0.00, 1.00]
## 
## - One-sided CIs: upper bound fixed at [1.00].
## $output3
## # Effect Size for ANOVA
## 
## Parameter | Cohen's f |      95% CI
## -----------------------------------
## stakes    |      0.03 | [0.00, Inf]
## 
## - One-sided CIs: upper bound fixed at [Inf].

Plots One-Way

group1 group2 n1.x n2.x p p.signif p.adj p.adj.signif effsize n1.y n2.y conf.low conf.high Cohens’ d
yes_ai control 116 106 0.1500 ns 0.1500 ns -0.1860 115 106 -0.46 0.05 negligible
yes_ai no_ai 116 113 0.0000 **** 0.0000 **** -0.6689 115 112 -0.97 -0.41 moderate
control no_ai 106 113 0.0005 *** 0.0009 *** -0.5072 106 112 -0.83 -0.23 moderate
group1 group2 n1.x n2.x p p.signif p.adj p.adj.signif effsize n1.y n2.y conf.low conf.high Cohens’ d
low high 167 168 0.583 ns 0.583 ns 0.0602 165 168 -0.14 0.25 negligible

Regression (exploratory)

Integrity

Reliability diagnostics

Overall reliability
raw_alpha std_alpha avg_inter_item_r n_items
0.88 0.884 0.717 3
Reliability if an item is dropped (raw_alpha rising above the overall value flags a problem item)
raw_alpha std.alpha G6(smc) average_r S/N alpha se var.r med.r
integrity1 0.865 0.872 0.773 0.773 6.830 0.015 NA 0.773
integrity2 0.809 0.813 0.685 0.685 4.358 0.021 NA 0.685
integrity3 0.817 0.817 0.691 0.691 4.477 0.020 NA 0.691
Item statistics – r.drop is the corrected item-total correlation (low / negative = weak item)
n raw.r std.r r.cor r.drop mean sd
integrity1 334 0.885 0.880 0.772 0.731 4.000 1.240
integrity2 334 0.911 0.912 0.853 0.792 4.566 1.170
integrity3 332 0.908 0.910 0.849 0.784 4.563 1.155

Integrity1

Summary

Both factors
stakes ai_training variable n mean sd se ci
low yes_ai integrity1 58 3.569 1.216 0.160 0.320
high yes_ai integrity1 58 3.276 1.196 0.157 0.315
low control integrity1 51 4.078 1.093 0.153 0.307
high control integrity1 55 3.691 0.998 0.135 0.270
low no_ai integrity1 57 4.667 0.951 0.126 0.252
high no_ai integrity1 55 4.764 1.201 0.162 0.325
By ai_training
ai_training variable n mean sd se ci
yes_ai integrity1 116 3.422 1.210 0.112 0.222
control integrity1 106 3.877 1.057 0.103 0.204
no_ai integrity1 112 4.714 1.077 0.102 0.202
By stakes
stakes variable n mean sd se ci
low integrity1 166 4.102 1.179 0.091 0.181
high integrity1 168 3.899 1.293 0.100 0.197

Two-Way ANOVA

## $output1
## Anova Table (Type II tests)
## 
## Response: integrity1
##                    Sum Sq  Df F value    Pr(>F)    
## ai_training         97.06   2 39.0289 6.236e-16 ***
## stakes               3.08   1  2.4796    0.1163    
## ai_training:stakes   3.65   2  1.4659    0.2324    
## Residuals          407.84 328                      
## ---
## Signif. codes:  0 '***' 0.001 '**' 0.01 '*' 0.05 '.' 0.1 ' ' 1
## 
## $output2
## # Effect Size for ANOVA (Type II)
## 
## Parameter          | Eta2 (partial) |       95% CI
## --------------------------------------------------
## ai_training        |           0.19 | [0.13, 1.00]
## stakes             |       7.50e-03 | [0.00, 1.00]
## ai_training:stakes |       8.86e-03 | [0.00, 1.00]
## 
## - One-sided CIs: upper bound fixed at [1.00].
## $output3
## # Effect Size for ANOVA (Type II)
## 
## Parameter          | Cohen's f (partial) |      95% CI
## ------------------------------------------------------
## ai_training        |                0.49 | [0.39, Inf]
## stakes             |                0.09 | [0.00, Inf]
## ai_training:stakes |                0.09 | [0.00, Inf]
## 
## - One-sided CIs: upper bound fixed at [Inf].

Plots Two-Way

stakes group1 group2 n1 n2 p p.signif p.adj p.adj.signif effsize conf.low conf.high Cohens’ d
low yes_ai control 58 51 0.0162
0.0324 * -0.4393 -0.84 -0.0600 small
low yes_ai no_ai 58 58 0.0000 **** 0.0000 **** NA NA NA NA
low control no_ai 51 58 0.0058 ** 0.0175 * NA NA NA NA
high yes_ai control 58 55 0.0541 ns 0.0541 ns -0.3759 -0.75 -0.0057 small
high yes_ai no_ai 58 55 0.0000 **** 0.0000 **** -1.2411 -1.71 -0.8800 large
high control no_ai 55 55 0.0000 **** 0.0000 **** -0.9715 -1.51 -0.5900 large
ai_training group1 group2 n1 n2 p p.signif p.adj p.adj.signif effsize conf.low conf.high Cohens’ d
yes_ai low high 58 58 0.193 ns 0.386 ns 0.2430 -0.1400 0.61 small
control low high 51 55 0.059 ns 0.177 ns 0.3711 -0.0077 0.75 small
no_ai low high 58 55 0.636 ns 0.636 ns NA NA NA NA

One-Way ANOVAs

## $output1
## Anova Table (Type II tests)
## 
## Response: integrity1
##             Sum Sq  Df F value    Pr(>F)    
## ai_training  97.44   2  38.898 6.719e-16 ***
## Residuals   414.56 331                      
## ---
## Signif. codes:  0 '***' 0.001 '**' 0.01 '*' 0.05 '.' 0.1 ' ' 1
## 
## $output2
## # Effect Size for ANOVA
## 
## Parameter   | Eta2 |       95% CI
## ---------------------------------
## ai_training | 0.19 | [0.13, 1.00]
## 
## - One-sided CIs: upper bound fixed at [1.00].
## $output3
## # Effect Size for ANOVA
## 
## Parameter   | Cohen's f |      95% CI
## -------------------------------------
## ai_training |      0.48 | [0.39, Inf]
## 
## - One-sided CIs: upper bound fixed at [Inf].
## $output1
## Anova Table (Type II tests)
## 
## Response: integrity1
##           Sum Sq  Df F value Pr(>F)
## stakes      3.46   1  2.2596 0.1337
## Residuals 508.54 332               
## 
## $output2
## # Effect Size for ANOVA
## 
## Parameter |     Eta2 |       95% CI
## -----------------------------------
## stakes    | 6.76e-03 | [0.00, 1.00]
## 
## - One-sided CIs: upper bound fixed at [1.00].
## $output3
## # Effect Size for ANOVA
## 
## Parameter | Cohen's f |      95% CI
## -----------------------------------
## stakes    |      0.08 | [0.00, Inf]
## 
## - One-sided CIs: upper bound fixed at [Inf].

Plots One-Way

group1 group2 n1.x n2.x p p.signif p.adj p.adj.signif effsize n1.y n2.y conf.low conf.high Cohens’ d
yes_ai control 116 106 0.0027 ** 0.0027 ** -0.3992 116 106 -0.67 -0.13 small
yes_ai no_ai 116 113 0.0000 **** 0.0000 **** -1.1266 116 112 -1.44 -0.82 large
control no_ai 106 113 0.0000 **** 0.0000 **** -0.7838 106 112 -1.10 -0.50 moderate
group1 group2 n1.x n2.x p p.signif p.adj p.adj.signif effsize n1.y n2.y conf.low conf.high Cohens’ d
low high 167 168 0.134 ns 0.134 ns 0.1645 166 168 -0.07 0.39 negligible

Regression (exploratory)

Integrity2

Summary

Both factors
stakes ai_training variable n mean sd se ci
low yes_ai integrity2 58 4.103 1.423 0.187 0.374
high yes_ai integrity2 58 3.983 1.221 0.160 0.321
low control integrity2 51 4.647 0.976 0.137 0.275
high control integrity2 55 4.473 0.959 0.129 0.259
low no_ai integrity2 57 5.053 0.915 0.121 0.243
high no_ai integrity2 55 5.182 0.905 0.122 0.245
By ai_training
ai_training variable n mean sd se ci
yes_ai integrity2 116 4.043 1.321 0.123 0.243
control integrity2 106 4.557 0.967 0.094 0.186
no_ai integrity2 112 5.116 0.908 0.086 0.170
By stakes
stakes variable n mean sd se ci
low integrity2 166 4.596 1.196 0.093 0.183
high integrity2 168 4.536 1.147 0.089 0.175

Two-Way ANOVA

## $output1
## Anova Table (Type II tests)
## 
## Response: integrity2
##                    Sum Sq  Df F value    Pr(>F)    
## ai_training         65.55   2 27.6538 7.971e-12 ***
## stakes               0.24   1  0.2045    0.6514    
## ai_training:stakes   1.45   2  0.6123    0.5427    
## Residuals          388.74 328                      
## ---
## Signif. codes:  0 '***' 0.001 '**' 0.01 '*' 0.05 '.' 0.1 ' ' 1
## 
## $output2
## # Effect Size for ANOVA (Type II)
## 
## Parameter          | Eta2 (partial) |       95% CI
## --------------------------------------------------
## ai_training        |           0.14 | [0.09, 1.00]
## stakes             |       6.23e-04 | [0.00, 1.00]
## ai_training:stakes |       3.72e-03 | [0.00, 1.00]
## 
## - One-sided CIs: upper bound fixed at [1.00].
## $output3
## # Effect Size for ANOVA (Type II)
## 
## Parameter          | Cohen's f (partial) |      95% CI
## ------------------------------------------------------
## ai_training        |                0.41 | [0.31, Inf]
## stakes             |                0.02 | [0.00, Inf]
## ai_training:stakes |                0.06 | [0.00, Inf]
## 
## - One-sided CIs: upper bound fixed at [Inf].

Plots Two-Way

stakes group1 group2 n1 n2 p p.signif p.adj p.adj.signif effsize conf.low conf.high Cohens’ d
low yes_ai control 58 51 0.0136
0.0402 * -0.4404 -0.82 -0.09 small
low yes_ai no_ai 58 58 0.0000 **** 0.0001 **** NA NA NA NA
low control no_ai 51 58 0.0655 ns 0.0655 ns NA NA NA NA
high yes_ai control 58 55 0.0134
0.0402 * -0.4448 -0.82 -0.10 small
high yes_ai no_ai 58 55 0.0000 **** 0.0000 **** -1.1116 -1.56 -0.75 large
high control no_ai 55 55 0.0005 *** 0.0019 ** -0.7605 -1.21 -0.38 moderate
ai_training group1 group2 n1 n2 p p.signif p.adj p.adj.signif effsize conf.low conf.high Cohens’ d
yes_ai low high 58 58 0.625 ns 1 ns 0.0910 -0.28 0.47 negligible
control low high 51 55 0.356 ns 1 ns 0.1802 -0.18 0.60 negligible
no_ai low high 58 55 0.454 ns 1 ns NA NA NA NA

One-Way ANOVAs

## $output1
## Anova Table (Type II tests)
## 
## Response: integrity2
##             Sum Sq  Df F value    Pr(>F)    
## ai_training  65.61   2  27.813 6.836e-12 ***
## Residuals   390.44 331                      
## ---
## Signif. codes:  0 '***' 0.001 '**' 0.01 '*' 0.05 '.' 0.1 ' ' 1
## 
## $output2
## # Effect Size for ANOVA
## 
## Parameter   | Eta2 |       95% CI
## ---------------------------------
## ai_training | 0.14 | [0.09, 1.00]
## 
## - One-sided CIs: upper bound fixed at [1.00].
## $output3
## # Effect Size for ANOVA
## 
## Parameter   | Cohen's f |      95% CI
## -------------------------------------
## ai_training |      0.41 | [0.31, Inf]
## 
## - One-sided CIs: upper bound fixed at [Inf].
## $output1
## Anova Table (Type II tests)
## 
## Response: integrity2
##           Sum Sq  Df F value Pr(>F)
## stakes      0.31   1  0.2239 0.6364
## Residuals 455.74 332               
## 
## $output2
## # Effect Size for ANOVA
## 
## Parameter |     Eta2 |       95% CI
## -----------------------------------
## stakes    | 6.74e-04 | [0.00, 1.00]
## 
## - One-sided CIs: upper bound fixed at [1.00].
## $output3
## # Effect Size for ANOVA
## 
## Parameter | Cohen's f |      95% CI
## -----------------------------------
## stakes    |      0.03 | [0.00, Inf]
## 
## - One-sided CIs: upper bound fixed at [Inf].

Plots One-Way

group1 group2 n1.x n2.x p p.signif p.adj p.adj.signif effsize n1.y n2.y conf.low conf.high Cohens’ d
yes_ai control 116 106 5e-04 *** 5e-04 *** -0.4405 116 106 -0.72 -0.17 small
yes_ai no_ai 116 113 0e+00 **** 0e+00 **** -0.9435 116 112 -1.22 -0.68 large
control no_ai 106 113 2e-04 *** 3e-04 *** -0.5971 106 112 -0.88 -0.33 moderate
group1 group2 n1.x n2.x p p.signif p.adj p.adj.signif effsize n1.y n2.y conf.low conf.high Cohens’ d
low high 167 168 0.636 ns 0.636 ns 0.0518 166 168 -0.16 0.27 negligible

Regression (exploratory)

Integrity3

Summary

Both factors
stakes ai_training variable n mean sd se ci
low yes_ai integrity3 57 4.246 1.243 0.165 0.330
high yes_ai integrity3 57 3.912 1.154 0.153 0.306
low control integrity3 51 4.706 0.986 0.138 0.277
high control integrity3 55 4.273 1.096 0.148 0.296
low no_ai integrity3 57 5.000 0.906 0.120 0.240
high no_ai integrity3 55 5.273 0.932 0.126 0.252
By ai_training
ai_training variable n mean sd se ci
yes_ai integrity3 114 4.079 1.206 0.113 0.224
control integrity3 106 4.481 1.062 0.103 0.205
no_ai integrity3 112 5.134 0.925 0.087 0.173
By stakes
stakes variable n mean sd se ci
low integrity3 165 4.648 1.098 0.085 0.169
high integrity3 167 4.479 1.207 0.093 0.184

Two-Way ANOVA

## $output1
## Anova Table (Type II tests)
## 
## Response: integrity3
##                    Sum Sq  Df F value    Pr(>F)    
## ai_training         63.69   2 28.2455 4.866e-12 ***
## stakes               2.14   1  1.8995   0.16908    
## ai_training:stakes   8.07   2  3.5800   0.02898 *  
## Residuals          367.53 326                      
## ---
## Signif. codes:  0 '***' 0.001 '**' 0.01 '*' 0.05 '.' 0.1 ' ' 1
## 
## $output2
## # Effect Size for ANOVA (Type II)
## 
## Parameter          | Eta2 (partial) |       95% CI
## --------------------------------------------------
## ai_training        |           0.15 | [0.09, 1.00]
## stakes             |       5.79e-03 | [0.00, 1.00]
## ai_training:stakes |           0.02 | [0.00, 1.00]
## 
## - One-sided CIs: upper bound fixed at [1.00].
## $output3
## # Effect Size for ANOVA (Type II)
## 
## Parameter          | Cohen's f (partial) |      95% CI
## ------------------------------------------------------
## ai_training        |                0.42 | [0.32, Inf]
## stakes             |                0.08 | [0.00, Inf]
## ai_training:stakes |                0.15 | [0.03, Inf]
## 
## - One-sided CIs: upper bound fixed at [Inf].

Plots Two-Way

stakes group1 group2 n1 n2 p p.signif p.adj p.adj.signif effsize conf.low conf.high Cohens’ d
low yes_ai control 58 51 0.0253
0.0759 ns NA NA NA NA
low yes_ai no_ai 58 58 0.0002 *** 0.0008 *** NA NA NA NA
low control no_ai 51 58 0.1510 ns 0.1510 ns NA NA NA NA
high yes_ai control 58 55 0.0755 ns 0.1510 ns NA NA NA NA
high yes_ai no_ai 58 55 0.0000 **** 0.0000 **** NA NA NA NA
high control no_ai 55 55 0.0000 **** 0.0000 **** -0.9828 -1.46 -0.59 large
ai_training group1 group2 n1 n2 p p.signif p.adj p.adj.signif effsize conf.low conf.high Cohens’ d
yes_ai low high 58 58 0.1410 ns 0.2380 ns NA NA NA NA
control low high 51 55 0.0353
0.1059 ns 0.4146 0.06 0.84 small
no_ai low high 58 55 0.1190 ns 0.2380 ns NA NA NA NA

One-Way ANOVAs

## $output1
## Anova Table (Type II tests)
## 
## Response: integrity3
##             Sum Sq  Df F value    Pr(>F)    
## ai_training  63.93   2   27.84 6.759e-12 ***
## Residuals   377.74 329                      
## ---
## Signif. codes:  0 '***' 0.001 '**' 0.01 '*' 0.05 '.' 0.1 ' ' 1
## 
## $output2
## # Effect Size for ANOVA
## 
## Parameter   | Eta2 |       95% CI
## ---------------------------------
## ai_training | 0.14 | [0.09, 1.00]
## 
## - One-sided CIs: upper bound fixed at [1.00].
## $output3
## # Effect Size for ANOVA
## 
## Parameter   | Cohen's f |      95% CI
## -------------------------------------
## ai_training |      0.41 | [0.31, Inf]
## 
## - One-sided CIs: upper bound fixed at [Inf].
## $output1
## Anova Table (Type II tests)
## 
## Response: integrity3
##           Sum Sq  Df F value Pr(>F)
## stakes      2.38   1  1.7901 0.1818
## Residuals 439.29 330               
## 
## $output2
## # Effect Size for ANOVA
## 
## Parameter |     Eta2 |       95% CI
## -----------------------------------
## stakes    | 5.40e-03 | [0.00, 1.00]
## 
## - One-sided CIs: upper bound fixed at [1.00].
## $output3
## # Effect Size for ANOVA
## 
## Parameter | Cohen's f |      95% CI
## -----------------------------------
## stakes    |      0.07 | [0.00, Inf]
## 
## - One-sided CIs: upper bound fixed at [Inf].

Plots One-Way

group1 group2 n1.x n2.x p p.signif p.adj p.adj.signif effsize n1.y n2.y conf.low conf.high Cohens’ d
yes_ai control 116 106 0.0057 ** 0.0057 ** -0.3531 114 106 -0.62 -0.08 small
yes_ai no_ai 116 113 0.0000 **** 0.0000 **** -0.9806 114 112 -1.28 -0.71 large
control no_ai 106 113 0.0000 **** 0.0000 **** -0.6567 106 112 -0.95 -0.39 moderate
group1 group2 n1.x n2.x p p.signif p.adj p.adj.signif effsize n1.y n2.y conf.low conf.high Cohens’ d
low high 167 168 0.182 ns 0.182 ns 0.1469 165 167 -0.07 0.36 negligible

Regression (exploratory)

Autonomy

Reliability diagnostics

Overall reliability
raw_alpha std_alpha avg_inter_item_r n_items
0.872 0.874 0.698 3
Reliability if an item is dropped (raw_alpha rising above the overall value flags a problem item)
raw_alpha std.alpha G6(smc) average_r S/N alpha se var.r med.r
autonomy1 0.791 0.804 0.672 0.672 4.090 0.022 NA 0.672
autonomy2 0.875 0.878 0.782 0.782 7.169 0.013 NA 0.782
autonomy3 0.778 0.782 0.642 0.642 3.586 0.024 NA 0.642
Item statistics – r.drop is the corrected item-total correlation (low / negative = weak item)
n raw.r std.r r.cor r.drop mean sd
autonomy1 332 0.908 0.904 0.843 0.787 4.346 1.435
autonomy2 333 0.847 0.863 0.736 0.696 4.480 1.265
autonomy3 332 0.927 0.915 0.865 0.806 4.193 1.589

Autonomy1

Summary

Both factors
stakes ai_training variable n mean sd se ci
low yes_ai autonomy1 58 3.500 1.657 0.218 0.436
high yes_ai autonomy1 58 3.121 1.403 0.184 0.369
low control autonomy1 51 4.529 1.065 0.149 0.300
high control autonomy1 54 4.407 0.981 0.134 0.268
low no_ai autonomy1 57 5.333 0.690 0.091 0.183
high no_ai autonomy1 54 5.296 0.903 0.123 0.247
By ai_training
ai_training variable n mean sd se ci
yes_ai autonomy1 116 3.310 1.540 0.143 0.283
control autonomy1 105 4.467 1.020 0.100 0.197
no_ai autonomy1 111 5.315 0.798 0.076 0.150
By stakes
stakes variable n mean sd se ci
low autonomy1 166 4.446 1.429 0.111 0.219
high autonomy1 166 4.247 1.437 0.112 0.220

Two-Way ANOVA

## $output1
## Anova Table (Type II tests)
## 
## Response: autonomy1
##                    Sum Sq  Df F value Pr(>F)    
## ai_training        229.76   2 83.9080 <2e-16 ***
## stakes               2.79   1  2.0414 0.1540    
## ai_training:stakes   1.81   2  0.6595 0.5178    
## Residuals          446.32 326                   
## ---
## Signif. codes:  0 '***' 0.001 '**' 0.01 '*' 0.05 '.' 0.1 ' ' 1
## 
## $output2
## # Effect Size for ANOVA (Type II)
## 
## Parameter          | Eta2 (partial) |       95% CI
## --------------------------------------------------
## ai_training        |           0.34 | [0.27, 1.00]
## stakes             |       6.22e-03 | [0.00, 1.00]
## ai_training:stakes |       4.03e-03 | [0.00, 1.00]
## 
## - One-sided CIs: upper bound fixed at [1.00].
## $output3
## # Effect Size for ANOVA (Type II)
## 
## Parameter          | Cohen's f (partial) |      95% CI
## ------------------------------------------------------
## ai_training        |                0.72 | [0.61, Inf]
## stakes             |                0.08 | [0.00, Inf]
## ai_training:stakes |                0.06 | [0.00, Inf]
## 
## - One-sided CIs: upper bound fixed at [Inf].

Plots Two-Way

stakes group1 group2 n1 n2 p p.signif p.adj p.adj.signif effsize conf.low conf.high Cohens’ d
low yes_ai control 58 51 0e+00 **** 1e-04 **** -0.7293 -1.12 -0.37 moderate
low yes_ai no_ai 58 58 0e+00 **** 0e+00 **** NA NA NA NA
low control no_ai 51 58 7e-04 *** 7e-04 *** NA NA NA NA
high yes_ai control 58 55 0e+00 **** 0e+00 **** NA NA NA NA
high yes_ai no_ai 58 55 0e+00 **** 0e+00 **** NA NA NA NA
high control no_ai 55 55 1e-04 **** 1e-04 *** NA NA NA NA
ai_training group1 group2 n1 n2 p p.signif p.adj p.adj.signif effsize conf.low conf.high Cohens’ d
yes_ai low high 58 58 0.186 ns 0.558 ns 0.2471 -0.14 0.66 small
control low high 51 55 0.543 ns 1.000 ns NA NA NA NA
no_ai low high 58 55 0.808 ns 1.000 ns NA NA NA NA

One-Way ANOVAs

## $output1
## Anova Table (Type II tests)
## 
## Response: autonomy1
##             Sum Sq  Df F value    Pr(>F)    
## ai_training 230.24   2  83.993 < 2.2e-16 ***
## Residuals   450.92 329                      
## ---
## Signif. codes:  0 '***' 0.001 '**' 0.01 '*' 0.05 '.' 0.1 ' ' 1
## 
## $output2
## # Effect Size for ANOVA
## 
## Parameter   | Eta2 |       95% CI
## ---------------------------------
## ai_training | 0.34 | [0.27, 1.00]
## 
## - One-sided CIs: upper bound fixed at [1.00].
## $output3
## # Effect Size for ANOVA
## 
## Parameter   | Cohen's f |      95% CI
## -------------------------------------
## ai_training |      0.71 | [0.61, Inf]
## 
## - One-sided CIs: upper bound fixed at [Inf].
## $output1
## Anova Table (Type II tests)
## 
## Response: autonomy1
##           Sum Sq  Df F value Pr(>F)
## stakes      3.28   1  1.5968 0.2073
## Residuals 677.89 330               
## 
## $output2
## # Effect Size for ANOVA
## 
## Parameter |     Eta2 |       95% CI
## -----------------------------------
## stakes    | 4.82e-03 | [0.00, 1.00]
## 
## - One-sided CIs: upper bound fixed at [1.00].
## $output3
## # Effect Size for ANOVA
## 
## Parameter | Cohen's f |      95% CI
## -----------------------------------
## stakes    |      0.07 | [0.00, Inf]
## 
## - One-sided CIs: upper bound fixed at [Inf].

Plots One-Way

group1 group2 n1.x n2.x p p.signif p.adj p.adj.signif effsize n1.y n2.y conf.low conf.high Cohens’ d
yes_ai control 116 106 0 **** 0 **** -0.8767 116 105 -1.16 -0.61 large
yes_ai no_ai 116 113 0 **** 0 **** -1.6244 116 111 -1.91 -1.33 large
control no_ai 106 113 0 **** 0 **** -0.9303 105 111 -1.24 -0.64 large
group1 group2 n1.x n2.x p p.signif p.adj p.adj.signif effsize n1.y n2.y conf.low conf.high Cohens’ d
low high 167 168 0.207 ns 0.207 ns 0.1387 166 166 -0.07 0.36 negligible

Regression (exploratory)

Autonomy2

Summary

Both factors
stakes ai_training variable n mean sd se ci
low yes_ai autonomy2 58 4.207 1.484 0.195 0.390
high yes_ai autonomy2 58 3.741 1.222 0.160 0.321
low control autonomy2 51 4.549 1.119 0.157 0.315
high control autonomy2 54 4.222 1.127 0.153 0.308
low no_ai autonomy2 57 4.965 1.017 0.135 0.270
high no_ai autonomy2 55 5.236 0.942 0.127 0.255
By ai_training
ai_training variable n mean sd se ci
yes_ai autonomy2 116 3.974 1.373 0.128 0.253
control autonomy2 105 4.381 1.130 0.110 0.219
no_ai autonomy2 112 5.098 0.986 0.093 0.185
By stakes
stakes variable n mean sd se ci
low autonomy2 166 4.572 1.262 0.098 0.193
high autonomy2 167 4.389 1.265 0.098 0.193

Two-Way ANOVA

## $output1
## Anova Table (Type II tests)
## 
## Response: autonomy2
##                    Sum Sq  Df F value    Pr(>F)    
## ai_training         73.25   2 26.8241 1.633e-11 ***
## stakes               2.52   1  1.8436   0.17546    
## ai_training:stakes   8.63   2  3.1608   0.04369 *  
## Residuals          446.46 327                      
## ---
## Signif. codes:  0 '***' 0.001 '**' 0.01 '*' 0.05 '.' 0.1 ' ' 1
## 
## $output2
## # Effect Size for ANOVA (Type II)
## 
## Parameter          | Eta2 (partial) |       95% CI
## --------------------------------------------------
## ai_training        |           0.14 | [0.09, 1.00]
## stakes             |       5.61e-03 | [0.00, 1.00]
## ai_training:stakes |           0.02 | [0.00, 1.00]
## 
## - One-sided CIs: upper bound fixed at [1.00].
## $output3
## # Effect Size for ANOVA (Type II)
## 
## Parameter          | Cohen's f (partial) |      95% CI
## ------------------------------------------------------
## ai_training        |                0.41 | [0.31, Inf]
## stakes             |                0.08 | [0.00, Inf]
## ai_training:stakes |                0.14 | [0.02, Inf]
## 
## - One-sided CIs: upper bound fixed at [Inf].

Plots Two-Way

stakes group1 group2 n1 n2 p p.signif p.adj p.adj.signif effsize conf.low conf.high Cohens’ d
low yes_ai control 58 51 0.1490 ns 0.1618 ns -0.2580 -0.60 0.10 small
low yes_ai no_ai 58 58 0.0012 ** 0.0046 ** NA NA NA NA
low control no_ai 51 58 0.0809 ns 0.1618 ns NA NA NA NA
high yes_ai control 58 55 0.0227
0.0681 ns NA NA NA NA
high yes_ai no_ai 58 55 0.0000 **** 0.0000 **** -1.3655 -1.89 -0.92 large
high control no_ai 55 55 0.0000 **** 0.0000 **** NA NA NA NA
ai_training group1 group2 n1 n2 p p.signif p.adj p.adj.signif effsize conf.low conf.high Cohens’ d
yes_ai low high 58 58 0.0677 ns 0.2031 ns 0.3425 -0.04 0.74 small
control low high 51 55 0.1390 ns 0.2780 ns NA NA NA NA
no_ai low high 58 55 0.1460 ns 0.2780 ns NA NA NA NA

One-Way ANOVAs

## $output1
## Anova Table (Type II tests)
## 
## Response: autonomy2
##             Sum Sq  Df F value    Pr(>F)    
## ai_training  73.52   2  26.509 2.107e-11 ***
## Residuals   457.60 330                      
## ---
## Signif. codes:  0 '***' 0.001 '**' 0.01 '*' 0.05 '.' 0.1 ' ' 1
## 
## $output2
## # Effect Size for ANOVA
## 
## Parameter   | Eta2 |       95% CI
## ---------------------------------
## ai_training | 0.14 | [0.08, 1.00]
## 
## - One-sided CIs: upper bound fixed at [1.00].
## $output3
## # Effect Size for ANOVA
## 
## Parameter   | Cohen's f |      95% CI
## -------------------------------------
## ai_training |      0.40 | [0.30, Inf]
## 
## - One-sided CIs: upper bound fixed at [Inf].
## $output1
## Anova Table (Type II tests)
## 
## Response: autonomy2
##           Sum Sq  Df F value Pr(>F)
## stakes      2.79   1  1.7479 0.1871
## Residuals 528.33 331               
## 
## $output2
## # Effect Size for ANOVA
## 
## Parameter |     Eta2 |       95% CI
## -----------------------------------
## stakes    | 5.25e-03 | [0.00, 1.00]
## 
## - One-sided CIs: upper bound fixed at [1.00].
## $output3
## # Effect Size for ANOVA
## 
## Parameter | Cohen's f |      95% CI
## -----------------------------------
## stakes    |      0.07 | [0.00, Inf]
## 
## - One-sided CIs: upper bound fixed at [Inf].

Plots One-Way

group1 group2 n1.x n2.x p p.signif p.adj p.adj.signif effsize n1.y n2.y conf.low conf.high Cohens’ d
yes_ai control 116 106 0.0108
0.0108 * -0.3219 116 105 -0.60 -0.05 small
yes_ai no_ai 116 113 0.0000 **** 0.0000 **** -0.9376 116 112 -1.23 -0.67 large
control no_ai 106 113 0.0000 **** 0.0000 **** -0.6779 105 112 -0.98 -0.41 moderate
group1 group2 n1.x n2.x p p.signif p.adj p.adj.signif effsize n1.y n2.y conf.low conf.high Cohens’ d
low high 167 168 0.187 ns 0.187 ns 0.1449 166 167 -0.05 0.37 negligible

Regression (exploratory)

Autonomy3

Summary

Both factors
stakes ai_training variable n mean sd se ci
low yes_ai autonomy3 56 3.250 1.587 0.212 0.425
high yes_ai autonomy3 58 2.776 1.545 0.203 0.406
low control autonomy3 51 4.176 1.090 0.153 0.307
high control autonomy3 55 4.073 1.052 0.142 0.284
low no_ai autonomy3 57 5.404 1.033 0.137 0.274
high no_ai autonomy3 55 5.527 0.790 0.107 0.214
By ai_training
ai_training variable n mean sd se ci
yes_ai autonomy3 114 3.009 1.577 0.148 0.293
control autonomy3 106 4.123 1.066 0.104 0.205
no_ai autonomy3 112 5.464 0.920 0.087 0.172
By stakes
stakes variable n mean sd se ci
low autonomy3 164 4.287 1.546 0.121 0.238
high autonomy3 168 4.101 1.629 0.126 0.248

Two-Way ANOVA

## $output1
## Anova Table (Type II tests)
## 
## Response: autonomy3
##                    Sum Sq  Df  F value Pr(>F)    
## ai_training        340.53   2 113.9439 <2e-16 ***
## stakes               1.97   1   1.3198 0.2515    
## ai_training:stakes   5.15   2   1.7220 0.1803    
## Residuals          487.14 326                    
## ---
## Signif. codes:  0 '***' 0.001 '**' 0.01 '*' 0.05 '.' 0.1 ' ' 1
## 
## $output2
## # Effect Size for ANOVA (Type II)
## 
## Parameter          | Eta2 (partial) |       95% CI
## --------------------------------------------------
## ai_training        |           0.41 | [0.35, 1.00]
## stakes             |       4.03e-03 | [0.00, 1.00]
## ai_training:stakes |           0.01 | [0.00, 1.00]
## 
## - One-sided CIs: upper bound fixed at [1.00].
## $output3
## # Effect Size for ANOVA (Type II)
## 
## Parameter          | Cohen's f (partial) |      95% CI
## ------------------------------------------------------
## ai_training        |                0.84 | [0.73, Inf]
## stakes             |                0.06 | [0.00, Inf]
## ai_training:stakes |                0.10 | [0.00, Inf]
## 
## - One-sided CIs: upper bound fixed at [Inf].

Plots Two-Way

stakes group1 group2 n1 n2 p p.signif p.adj p.adj.signif effsize conf.low conf.high Cohens’ d
low yes_ai control 58 51 2e-04 *** 2e-04 *** NA NA NA NA
low yes_ai no_ai 58 58 0e+00 **** 0e+00 **** NA NA NA NA
low control no_ai 51 58 0e+00 **** 0e+00 **** NA NA NA NA
high yes_ai control 58 55 0e+00 **** 0e+00 **** -0.9765 -1.40 -0.61 large
high yes_ai no_ai 58 55 0e+00 **** 0e+00 **** -2.2246 -2.96 -1.74 large
high control no_ai 55 55 0e+00 **** 0e+00 **** -1.5640 -2.23 -1.06 large
ai_training group1 group2 n1 n2 p p.signif p.adj p.adj.signif effsize conf.low conf.high Cohens’ d
yes_ai low high 58 58 0.109 ns 0.327 ns NA NA NA NA
control low high 51 55 0.619 ns 0.958 ns 0.0969 -0.32 0.48 negligible
no_ai low high 58 55 0.479 ns 0.958 ns NA NA NA NA

One-Way ANOVAs

## $output1
## Anova Table (Type II tests)
## 
## Response: autonomy3
##             Sum Sq  Df F value    Pr(>F)    
## ai_training 341.41   2  113.63 < 2.2e-16 ***
## Residuals   494.25 329                      
## ---
## Signif. codes:  0 '***' 0.001 '**' 0.01 '*' 0.05 '.' 0.1 ' ' 1
## 
## $output2
## # Effect Size for ANOVA
## 
## Parameter   | Eta2 |       95% CI
## ---------------------------------
## ai_training | 0.41 | [0.34, 1.00]
## 
## - One-sided CIs: upper bound fixed at [1.00].
## $output3
## # Effect Size for ANOVA
## 
## Parameter   | Cohen's f |      95% CI
## -------------------------------------
## ai_training |      0.83 | [0.72, Inf]
## 
## - One-sided CIs: upper bound fixed at [Inf].
## $output1
## Anova Table (Type II tests)
## 
## Response: autonomy3
##           Sum Sq  Df F value Pr(>F)
## stakes      2.85   1  1.1303 0.2885
## Residuals 832.81 330               
## 
## $output2
## # Effect Size for ANOVA
## 
## Parameter |     Eta2 |       95% CI
## -----------------------------------
## stakes    | 3.41e-03 | [0.00, 1.00]
## 
## - One-sided CIs: upper bound fixed at [1.00].
## $output3
## # Effect Size for ANOVA
## 
## Parameter | Cohen's f |      95% CI
## -----------------------------------
## stakes    |      0.06 | [0.00, Inf]
## 
## - One-sided CIs: upper bound fixed at [Inf].

Plots One-Way

group1 group2 n1.x n2.x p p.signif p.adj p.adj.signif effsize n1.y n2.y conf.low conf.high Cohens’ d
yes_ai control 116 106 0 **** 0 **** -0.8219 114 106 -1.09 -0.56 large
yes_ai no_ai 116 113 0 **** 0 **** -1.8982 114 112 -2.36 -1.53 large
control no_ai 106 113 0 **** 0 **** -1.3502 106 112 -1.80 -0.96 large
group1 group2 n1.x n2.x p p.signif p.adj p.adj.signif effsize n1.y n2.y conf.low conf.high Cohens’ d
low high 167 168 0.288 ns 0.288 ns 0.1167 164 168 -0.1 0.33 negligible

Regression (exploratory)

AI attitudes

Reliability diagnostics

Overall reliability
raw_alpha std_alpha avg_inter_item_r n_items
0.978 0.976 0.954 2
Reliability if an item is dropped (raw_alpha rising above the overall value flags a problem item)
raw_alpha std.alpha G6(smc) average_r S/N alpha se var.r med.r
ai_attitude 0.957 0.954 0.909 0.954 20.544 NA 0 0.954
ai_feeling 0.955 0.954 0.909 0.954 20.544 NA 0 0.954
Item statistics – r.drop is the corrected item-total correlation (low / negative = weak item)
n raw.r std.r r.cor r.drop mean sd
ai_attitude 331 0.988 0.988 0.965 0.956 3.115 1.698
ai_feeling 329 0.988 0.988 0.965 0.956 3.100 1.696

Ai Attitude

Summary

Both factors
stakes ai_training variable n mean sd se ci
low yes_ai ai_attitude 57 3.439 1.690 0.224 0.449
high yes_ai ai_attitude 58 3.086 1.931 0.254 0.508
low control ai_attitude 50 3.340 1.698 0.240 0.482
high control ai_attitude 54 3.222 1.538 0.209 0.420
low no_ai ai_attitude 57 2.965 1.762 0.233 0.468
high no_ai ai_attitude 55 2.655 1.468 0.198 0.397
By ai_training
ai_training variable n mean sd se ci
yes_ai ai_attitude 115 3.261 1.817 0.169 0.336
control ai_attitude 104 3.279 1.610 0.158 0.313
no_ai ai_attitude 112 2.812 1.625 0.154 0.304
By stakes
stakes variable n mean sd se ci
low ai_attitude 164 3.244 1.720 0.134 0.265
high ai_attitude 167 2.988 1.672 0.129 0.255

Two-Way ANOVA

## $output1
## Anova Table (Type II tests)
## 
## Response: ai_attitude
##                    Sum Sq  Df F value  Pr(>F)  
## ai_training         15.86   2  2.7721 0.06401 .
## stakes               5.79   1  2.0232 0.15587  
## ai_training:stakes   0.84   2  0.1468 0.86351  
## Residuals          929.52 325                  
## ---
## Signif. codes:  0 '***' 0.001 '**' 0.01 '*' 0.05 '.' 0.1 ' ' 1
## 
## $output2
## # Effect Size for ANOVA (Type II)
## 
## Parameter          | Eta2 (partial) |       95% CI
## --------------------------------------------------
## ai_training        |           0.02 | [0.00, 1.00]
## stakes             |       6.19e-03 | [0.00, 1.00]
## ai_training:stakes |       9.03e-04 | [0.00, 1.00]
## 
## - One-sided CIs: upper bound fixed at [1.00].
## $output3
## # Effect Size for ANOVA (Type II)
## 
## Parameter          | Cohen's f (partial) |      95% CI
## ------------------------------------------------------
## ai_training        |                0.13 | [0.00, Inf]
## stakes             |                0.08 | [0.00, Inf]
## ai_training:stakes |                0.03 | [0.00, Inf]
## 
## - One-sided CIs: upper bound fixed at [Inf].

Plots Two-Way

stakes group1 group2 n1 n2 p p.signif p.adj p.adj.signif effsize conf.low conf.high Cohens’ d
low yes_ai control 58 51 0.7670 ns 1.0000 ns NA NA NA NA
low yes_ai no_ai 58 58 0.1430 ns 0.7150 ns NA NA NA NA
low control no_ai 51 58 0.2620 ns 0.7860 ns NA NA NA NA
high yes_ai control 58 55 0.6660 ns 1.0000 ns NA NA NA NA
high yes_ai no_ai 58 55 0.1700 ns 0.7150 ns 0.2507 -0.09 0.62 small
high control no_ai 55 55 0.0769 ns 0.4614 ns NA NA NA NA
ai_training group1 group2 n1 n2 p p.signif p.adj p.adj.signif effsize conf.low conf.high Cohens’ d
yes_ai low high 58 58 0.300 ns 0.9 ns NA NA NA NA
control low high 51 55 0.711 ns 0.9 ns NA NA NA NA
no_ai low high 58 55 0.314 ns 0.9 ns NA NA NA NA

One-Way ANOVAs

## $output1
## Anova Table (Type II tests)
## 
## Response: ai_attitude
##             Sum Sq  Df F value  Pr(>F)  
## ai_training  15.49   2  2.7132 0.06781 .
## Residuals   936.15 328                  
## ---
## Signif. codes:  0 '***' 0.001 '**' 0.01 '*' 0.05 '.' 0.1 ' ' 1
## 
## $output2
## # Effect Size for ANOVA
## 
## Parameter   | Eta2 |       95% CI
## ---------------------------------
## ai_training | 0.02 | [0.00, 1.00]
## 
## - One-sided CIs: upper bound fixed at [1.00].
## $output3
## # Effect Size for ANOVA
## 
## Parameter   | Cohen's f |      95% CI
## -------------------------------------
## ai_training |      0.13 | [0.00, Inf]
## 
## - One-sided CIs: upper bound fixed at [Inf].
## $output1
## Anova Table (Type II tests)
## 
## Response: ai_attitude
##           Sum Sq  Df F value Pr(>F)
## stakes      5.42   1  1.8837 0.1709
## Residuals 946.22 329               
## 
## $output2
## # Effect Size for ANOVA
## 
## Parameter |     Eta2 |       95% CI
## -----------------------------------
## stakes    | 5.69e-03 | [0.00, 1.00]
## 
## - One-sided CIs: upper bound fixed at [1.00].
## $output3
## # Effect Size for ANOVA
## 
## Parameter | Cohen's f |      95% CI
## -----------------------------------
## stakes    |      0.08 | [0.00, Inf]
## 
## - One-sided CIs: upper bound fixed at [Inf].

Plots One-Way

group1 group2 n1.x n2.x p p.signif p.adj p.adj.signif effsize n1.y n2.y conf.low conf.high Cohens’ d
yes_ai control 116 106 0.9370 ns 0.9370 ns -0.0104 115 104 -0.290 0.27 negligible
yes_ai no_ai 116 113 0.0464
0.1305 ns 0.2600 115 112 0.005 0.54 small
control no_ai 106 113 0.0435
0.1305 ns 0.2883 104 112 0.010 0.57 small
group1 group2 n1.x n2.x p p.signif p.adj p.adj.signif effsize n1.y n2.y conf.low conf.high Cohens’ d
low high 167 168 0.171 ns 0.171 ns 0.1509 164 167 -0.06 0.37 negligible

Regression (exploratory)

Ai Feeling

Summary

Both factors
stakes ai_training variable n mean sd se ci
low yes_ai ai_feeling 57 3.596 1.602 0.212 0.425
high yes_ai ai_feeling 58 3.069 1.927 0.253 0.507
low control ai_feeling 48 3.312 1.715 0.248 0.498
high control ai_feeling 54 3.093 1.557 0.212 0.425
low no_ai ai_feeling 57 2.930 1.710 0.226 0.454
high no_ai ai_feeling 55 2.618 1.533 0.207 0.415
By ai_training
ai_training variable n mean sd se ci
yes_ai ai_feeling 115 3.330 1.786 0.167 0.330
control ai_feeling 102 3.196 1.629 0.161 0.320
no_ai ai_feeling 112 2.777 1.626 0.154 0.304
By stakes
stakes variable n mean sd se ci
low ai_feeling 162 3.278 1.688 0.133 0.262
high ai_feeling 167 2.928 1.692 0.131 0.258

Two-Way ANOVA

## $output1
## Anova Table (Type II tests)
## 
## Response: ai_feeling
##                    Sum Sq  Df F value  Pr(>F)  
## ai_training         19.27   2  3.4092 0.03426 *
## stakes              10.58   1  3.7418 0.05394 .
## ai_training:stakes   1.37   2  0.2425 0.78481  
## Residuals          912.99 323                  
## ---
## Signif. codes:  0 '***' 0.001 '**' 0.01 '*' 0.05 '.' 0.1 ' ' 1
## 
## $output2
## # Effect Size for ANOVA (Type II)
## 
## Parameter          | Eta2 (partial) |       95% CI
## --------------------------------------------------
## ai_training        |           0.02 | [0.00, 1.00]
## stakes             |           0.01 | [0.00, 1.00]
## ai_training:stakes |       1.50e-03 | [0.00, 1.00]
## 
## - One-sided CIs: upper bound fixed at [1.00].
## $output3
## # Effect Size for ANOVA (Type II)
## 
## Parameter          | Cohen's f (partial) |      95% CI
## ------------------------------------------------------
## ai_training        |                0.15 | [0.03, Inf]
## stakes             |                0.11 | [0.00, Inf]
## ai_training:stakes |                0.04 | [0.00, Inf]
## 
## - One-sided CIs: upper bound fixed at [Inf].

Plots Two-Way

stakes group1 group2 n1 n2 p p.signif p.adj p.adj.signif effsize conf.low conf.high Cohens’ d
low yes_ai control 58 51 0.3880 ns 0.7760 ns NA NA NA NA
low yes_ai no_ai 58 58 0.0351
0.2106 ns NA NA NA NA
low control no_ai 51 58 0.2450 ns 0.7350 ns NA NA NA NA
high yes_ai control 58 55 0.9410 ns 0.9410 ns NA NA NA NA
high yes_ai no_ai 58 55 0.1580 ns 0.7200 ns 0.2581 -0.13 0.65 small
high control no_ai 55 55 0.1440 ns 0.7200 ns NA NA NA NA
ai_training group1 group2 n1 n2 p p.signif p.adj p.adj.signif effsize conf.low conf.high Cohens’ d
yes_ai low high 58 58 0.114 ns 0.342 ns NA NA NA NA
control low high 51 55 0.499 ns 0.626 ns NA NA NA NA
no_ai low high 58 55 0.313 ns 0.626 ns NA NA NA NA

One-Way ANOVAs

## $output1
## Anova Table (Type II tests)
## 
## Response: ai_feeling
##             Sum Sq  Df F value  Pr(>F)  
## ai_training  18.75   2   3.304 0.03797 *
## Residuals   924.94 326                  
## ---
## Signif. codes:  0 '***' 0.001 '**' 0.01 '*' 0.05 '.' 0.1 ' ' 1
## 
## $output2
## # Effect Size for ANOVA
## 
## Parameter   | Eta2 |       95% CI
## ---------------------------------
## ai_training | 0.02 | [0.00, 1.00]
## 
## - One-sided CIs: upper bound fixed at [1.00].
## $output3
## # Effect Size for ANOVA
## 
## Parameter   | Cohen's f |      95% CI
## -------------------------------------
## ai_training |      0.14 | [0.02, Inf]
## 
## - One-sided CIs: upper bound fixed at [Inf].
## $output1
## Anova Table (Type II tests)
## 
## Response: ai_feeling
##           Sum Sq  Df F value Pr(>F)  
## stakes     10.05   1  3.5207 0.0615 .
## Residuals 933.64 327                 
## ---
## Signif. codes:  0 '***' 0.001 '**' 0.01 '*' 0.05 '.' 0.1 ' ' 1
## 
## $output2
## # Effect Size for ANOVA
## 
## Parameter | Eta2 |       95% CI
## -------------------------------
## stakes    | 0.01 | [0.00, 1.00]
## 
## - One-sided CIs: upper bound fixed at [1.00].
## $output3
## # Effect Size for ANOVA
## 
## Parameter | Cohen's f |      95% CI
## -----------------------------------
## stakes    |      0.10 | [0.00, Inf]
## 
## - One-sided CIs: upper bound fixed at [Inf].

Plots One-Way

group1 group2 n1.x n2.x p p.signif p.adj p.adj.signif effsize n1.y n2.y conf.low conf.high Cohens’ d
yes_ai control 116 106 0.5580 ns 0.5580 ns 0.0784 115 102 -0.18 0.36 negligible
yes_ai no_ai 116 113 0.0138
0.0414 * 0.3240 115 112 0.06 0.59 small
control no_ai 106 113 0.0699 ns 0.1398 ns 0.2576 102 112 0.02 0.57 small
group1 group2 n1.x n2.x p p.signif p.adj p.adj.signif effsize n1.y n2.y conf.low conf.high Cohens’ d
low high 167 168 0.0615 ns 0.0615 ns 0.2069 162 167 0.0031 0.43 small

Regression (exploratory)

Ai Use (single item)

Ai Use

Summary

Both factors
stakes ai_training variable n mean sd se ci
low yes_ai ai_use 55 4.636 1.253 0.169 0.339
high yes_ai ai_use 58 4.983 0.868 0.114 0.228
low control ai_use 50 3.180 0.983 0.139 0.279
high control ai_use 54 3.093 0.937 0.128 0.256
low no_ai ai_use 57 1.439 1.488 0.197 0.395
high no_ai ai_use 55 1.836 1.630 0.220 0.441
By ai_training
ai_training variable n mean sd se ci
yes_ai ai_use 113 4.814 1.082 0.102 0.202
control ai_use 104 3.135 0.956 0.094 0.186
no_ai ai_use 112 1.634 1.565 0.148 0.293
By stakes
stakes variable n mean sd se ci
low ai_use 162 3.062 1.837 0.144 0.285
high ai_use 167 3.335 1.765 0.137 0.270

Two-Way ANOVA

## $output1
## Anova Table (Type II tests)
## 
## Response: ai_use
##                    Sum Sq  Df  F value  Pr(>F)    
## ai_training        567.63   2 187.3961 < 2e-16 ***
## stakes               4.23   1   2.7925 0.09567 .  
## ai_training:stakes   3.79   2   1.2496 0.28801    
## Residuals          489.19 323                     
## ---
## Signif. codes:  0 '***' 0.001 '**' 0.01 '*' 0.05 '.' 0.1 ' ' 1
## 
## $output2
## # Effect Size for ANOVA (Type II)
## 
## Parameter          | Eta2 (partial) |       95% CI
## --------------------------------------------------
## ai_training        |           0.54 | [0.48, 1.00]
## stakes             |       8.57e-03 | [0.00, 1.00]
## ai_training:stakes |       7.68e-03 | [0.00, 1.00]
## 
## - One-sided CIs: upper bound fixed at [1.00].
## $output3
## # Effect Size for ANOVA (Type II)
## 
## Parameter          | Cohen's f (partial) |      95% CI
## ------------------------------------------------------
## ai_training        |                1.08 | [0.96, Inf]
## stakes             |                0.09 | [0.00, Inf]
## ai_training:stakes |                0.09 | [0.00, Inf]
## 
## - One-sided CIs: upper bound fixed at [Inf].

Plots Two-Way

stakes group1 group2 n1 n2 p p.signif p.adj p.adj.signif effsize conf.low conf.high Cohens’ d
low yes_ai control 58 51 0 **** 0 **** NA NA NA NA
low yes_ai no_ai 58 58 0 **** 0 **** NA NA NA NA
low control no_ai 51 58 0 **** 0 **** NA NA NA NA
high yes_ai control 58 55 0 **** 0 **** NA NA NA NA
high yes_ai no_ai 58 55 0 **** 0 **** 2.4273 1.88 3.28 large
high control no_ai 55 55 0 **** 0 **** NA NA NA NA
ai_training group1 group2 n1 n2 p p.signif p.adj p.adj.signif effsize conf.low conf.high Cohens’ d
yes_ai low high 58 58 0.089 ns 0.267 ns NA NA NA NA
control low high 51 55 0.644 ns 0.644 ns NA NA NA NA
no_ai low high 58 55 0.180 ns 0.360 ns NA NA NA NA

One-Way ANOVAs

## $output1
## Anova Table (Type II tests)
## 
## Response: ai_use
##             Sum Sq  Df F value    Pr(>F)    
## ai_training 569.56   2  186.72 < 2.2e-16 ***
## Residuals   497.20 326                      
## ---
## Signif. codes:  0 '***' 0.001 '**' 0.01 '*' 0.05 '.' 0.1 ' ' 1
## 
## $output2
## # Effect Size for ANOVA
## 
## Parameter   | Eta2 |       95% CI
## ---------------------------------
## ai_training | 0.53 | [0.48, 1.00]
## 
## - One-sided CIs: upper bound fixed at [1.00].
## $output3
## # Effect Size for ANOVA
## 
## Parameter   | Cohen's f |      95% CI
## -------------------------------------
## ai_training |      1.07 | [0.95, Inf]
## 
## - One-sided CIs: upper bound fixed at [Inf].
## $output1
## Anova Table (Type II tests)
## 
## Response: ai_use
##            Sum Sq  Df F value Pr(>F)
## stakes       6.16   1  1.8979 0.1693
## Residuals 1060.60 327               
## 
## $output2
## # Effect Size for ANOVA
## 
## Parameter |     Eta2 |       95% CI
## -----------------------------------
## stakes    | 5.77e-03 | [0.00, 1.00]
## 
## - One-sided CIs: upper bound fixed at [1.00].
## $output3
## # Effect Size for ANOVA
## 
## Parameter | Cohen's f |      95% CI
## -----------------------------------
## stakes    |      0.08 | [0.00, Inf]
## 
## - One-sided CIs: upper bound fixed at [Inf].

Plots One-Way

group1 group2 n1.x n2.x p p.signif p.adj p.adj.signif effsize n1.y n2.y conf.low conf.high Cohens’ d
yes_ai control 116 106 0 **** 0 **** 1.6410 113 104 1.28 2.08 large
yes_ai no_ai 116 113 0 **** 0 **** 2.3654 113 112 1.96 2.91 large
control no_ai 106 113 0 **** 0 **** 1.1473 104 112 0.85 1.54 large
group1 group2 n1.x n2.x p p.signif p.adj p.adj.signif effsize n1.y n2.y conf.low conf.high Cohens’ d
low high 167 168 0.169 ns 0.169 ns -0.1519 162 167 -0.4 0.05 negligible

Regression (exploratory)