Skip to content

Commit dcfef4c

Browse files
SvenKlaassenSvenKlaassen
committed
rerun ssm simulations
1 parent 5d842f0 commit dcfef4c

File tree

6 files changed

+190
-0
lines changed

6 files changed

+190
-0
lines changed

‎results/ssm/ssm_mar_ate_config.yml‎

Lines changed: 74 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,74 @@
1+
simulation_parameters:
2+
repetitions: 1000
3+
max_runtime: 19800
4+
random_seed: 42
5+
n_jobs: -2
6+
dgp_parameters:
7+
theta:
8+
- 1.0
9+
n_obs:
10+
- 500
11+
dim_x:
12+
- 20
13+
learner_definitions:
14+
lasso: &id001
15+
name: LassoCV
16+
logit: &id002
17+
name: Logistic
18+
rfr: &id003
19+
name: RF Regr.
20+
params:
21+
n_estimators: 200
22+
max_features: 20
23+
max_depth: 5
24+
min_samples_leaf: 2
25+
rfc: &id004
26+
name: RF Clas.
27+
params:
28+
n_estimators: 200
29+
max_features: 20
30+
max_depth: 5
31+
min_samples_leaf: 2
32+
lgbmr: &id005
33+
name: LGBM Regr.
34+
params:
35+
n_estimators: 500
36+
learning_rate: 0.01
37+
lgbmc: &id006
38+
name: LGBM Clas.
39+
params:
40+
n_estimators: 500
41+
learning_rate: 0.01
42+
dml_parameters:
43+
learners:
44+
- ml_g: *id001
45+
ml_m: *id002
46+
ml_pi: *id002
47+
- ml_g: *id003
48+
ml_m: *id004
49+
ml_pi: *id004
50+
- ml_g: *id001
51+
ml_m: *id004
52+
ml_pi: *id004
53+
- ml_g: *id003
54+
ml_m: *id002
55+
ml_pi: *id004
56+
- ml_g: *id003
57+
ml_m: *id004
58+
ml_pi: *id002
59+
- ml_g: *id005
60+
ml_m: *id006
61+
ml_pi: *id006
62+
- ml_g: *id001
63+
ml_m: *id006
64+
ml_pi: *id006
65+
- ml_g: *id005
66+
ml_m: *id002
67+
ml_pi: *id006
68+
- ml_g: *id005
69+
ml_m: *id006
70+
ml_pi: *id002
71+
confidence_parameters:
72+
level:
73+
- 0.95
74+
- 0.9

‎results/ssm/ssm_mar_ate_coverage.csv‎

Lines changed: 19 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,19 @@
1+
Learner g,Learner m,Learner pi,level,Coverage,CI Length,Bias,repetition
2+
LGBM Regr.,LGBM Clas.,LGBM Clas.,0.9,0.937,1.1020474646866227,0.25225717557270916,1000
3+
LGBM Regr.,LGBM Clas.,LGBM Clas.,0.95,0.976,1.3131705488242713,0.25225717557270916,1000
4+
LGBM Regr.,LGBM Clas.,Logistic,0.9,0.925,0.9396009375831231,0.21523318689504592,1000
5+
LGBM Regr.,LGBM Clas.,Logistic,0.95,0.967,1.1196035728213285,0.21523318689504592,1000
6+
LGBM Regr.,Logistic,LGBM Clas.,0.9,0.927,0.7652547530061172,0.16892900789678272,1000
7+
LGBM Regr.,Logistic,LGBM Clas.,0.95,0.976,0.9118572803769212,0.16892900789678272,1000
8+
LassoCV,LGBM Clas.,LGBM Clas.,0.9,0.94,1.0416524703569756,0.23136599807480204,1000
9+
LassoCV,LGBM Clas.,LGBM Clas.,0.95,0.979,1.2412054743683776,0.23136599807480204,1000
10+
LassoCV,Logistic,Logistic,0.9,0.918,0.5983979591318811,0.13819869402679225,1000
11+
LassoCV,Logistic,Logistic,0.95,0.961,0.7130351473854032,0.13819869402679225,1000
12+
LassoCV,RF Clas.,RF Clas.,0.9,0.915,0.5159726010062256,0.11685996635828219,1000
13+
LassoCV,RF Clas.,RF Clas.,0.95,0.966,0.6148192753515406,0.11685996635828219,1000
14+
RF Regr.,Logistic,RF Clas.,0.9,0.914,0.5740315353572116,0.13374033079721487,1000
15+
RF Regr.,Logistic,RF Clas.,0.95,0.967,0.6840007626548271,0.13374033079721487,1000
16+
RF Regr.,RF Clas.,Logistic,0.9,0.916,0.5717174746911912,0.13251444813486235,1000
17+
RF Regr.,RF Clas.,Logistic,0.95,0.964,0.6812433893000642,0.13251444813486235,1000
18+
RF Regr.,RF Clas.,RF Clas.,0.9,0.917,0.5204895028483878,0.12032384089569902,1000
19+
RF Regr.,RF Clas.,RF Clas.,0.95,0.957,0.6202014958648324,0.12032384089569902,1000

‎results/ssm/ssm_mar_ate_metadata.csv‎

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,2 @@
1+
DoubleML Version,Script,Date,Total Runtime (minutes),Python Version,Config File
2+
0.10.0,SSMMarATECoverageSimulation,2025-06-05 10:19,32.703589328130086,3.12.9,scripts/ssm/ssm_mar_ate_config.yml

‎results/ssm/ssm_nonig_ate_config.yml‎

Lines changed: 74 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,74 @@
1+
simulation_parameters:
2+
repetitions: 1000
3+
max_runtime: 19800
4+
random_seed: 42
5+
n_jobs: -2
6+
dgp_parameters:
7+
theta:
8+
- 1.0
9+
n_obs:
10+
- 500
11+
dim_x:
12+
- 20
13+
learner_definitions:
14+
lasso: &id001
15+
name: LassoCV
16+
logit: &id002
17+
name: Logistic
18+
rfr: &id003
19+
name: RF Regr.
20+
params:
21+
n_estimators: 200
22+
max_features: 20
23+
max_depth: 5
24+
min_samples_leaf: 2
25+
rfc: &id004
26+
name: RF Clas.
27+
params:
28+
n_estimators: 200
29+
max_features: 20
30+
max_depth: 5
31+
min_samples_leaf: 2
32+
lgbmr: &id005
33+
name: LGBM Regr.
34+
params:
35+
n_estimators: 500
36+
learning_rate: 0.01
37+
lgbmc: &id006
38+
name: LGBM Clas.
39+
params:
40+
n_estimators: 500
41+
learning_rate: 0.01
42+
dml_parameters:
43+
learners:
44+
- ml_g: *id001
45+
ml_m: *id002
46+
ml_pi: *id002
47+
- ml_g: *id003
48+
ml_m: *id004
49+
ml_pi: *id004
50+
- ml_g: *id001
51+
ml_m: *id004
52+
ml_pi: *id004
53+
- ml_g: *id003
54+
ml_m: *id002
55+
ml_pi: *id004
56+
- ml_g: *id003
57+
ml_m: *id004
58+
ml_pi: *id002
59+
- ml_g: *id005
60+
ml_m: *id006
61+
ml_pi: *id006
62+
- ml_g: *id001
63+
ml_m: *id006
64+
ml_pi: *id006
65+
- ml_g: *id005
66+
ml_m: *id002
67+
ml_pi: *id006
68+
- ml_g: *id005
69+
ml_m: *id006
70+
ml_pi: *id002
71+
confidence_parameters:
72+
level:
73+
- 0.95
74+
- 0.9

‎results/ssm/ssm_nonig_ate_coverage.csv‎

Lines changed: 19 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,19 @@
1+
Learner g,Learner m,Learner pi,level,Coverage,CI Length,Bias,repetition
2+
LGBM Regr.,LGBM Clas.,LGBM Clas.,0.9,0.906,1.5821140101993176,0.39941487645605,1000
3+
LGBM Regr.,LGBM Clas.,LGBM Clas.,0.95,0.958,1.8852051201504163,0.39941487645605,1000
4+
LGBM Regr.,LGBM Clas.,Logistic,0.9,0.935,2.3216975230755064,0.6217489058523816,1000
5+
LGBM Regr.,LGBM Clas.,Logistic,0.95,0.974,2.7664732312123816,0.6217489058523816,1000
6+
LGBM Regr.,Logistic,LGBM Clas.,0.9,0.834,1.1194612001997861,0.31096250226975036,1000
7+
LGBM Regr.,Logistic,LGBM Clas.,0.95,0.904,1.3339202945055102,0.31096250226975036,1000
8+
LassoCV,LGBM Clas.,LGBM Clas.,0.9,0.907,1.4773761863865273,0.3819267464776803,1000
9+
LassoCV,LGBM Clas.,LGBM Clas.,0.95,0.957,1.760402305402313,0.3819267464776803,1000
10+
LassoCV,Logistic,Logistic,0.9,0.857,1.8486984724368598,0.524196741214989,1000
11+
LassoCV,Logistic,Logistic,0.95,0.92,2.202860099452095,0.524196741214989,1000
12+
LassoCV,RF Clas.,RF Clas.,0.9,0.78,0.6505940752158618,0.20476023599261262,1000
13+
LassoCV,RF Clas.,RF Clas.,0.95,0.872,0.7752306558374706,0.20476023599261262,1000
14+
RF Regr.,Logistic,RF Clas.,0.9,0.708,0.7687129167631139,0.2667490928514026,1000
15+
RF Regr.,Logistic,RF Clas.,0.95,0.814,0.9159779366500982,0.2667490928514026,1000
16+
RF Regr.,RF Clas.,Logistic,0.9,0.892,1.437280071189879,0.396115809059242,1000
17+
RF Regr.,RF Clas.,Logistic,0.95,0.949,1.7126248372934632,0.396115809059242,1000
18+
RF Regr.,RF Clas.,RF Clas.,0.9,0.779,0.6653233603546214,0.20524894117905498,1000
19+
RF Regr.,RF Clas.,RF Clas.,0.95,0.857,0.7927816816047267,0.20524894117905498,1000

‎results/ssm/ssm_nonig_ate_metadata.csv‎

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,2 @@
1+
DoubleML Version,Script,Date,Total Runtime (minutes),Python Version,Config File
2+
0.10.0,SSMNonIgnorableATECoverageSimulation,2025-06-05 10:40,19.940552759170533,3.12.9,scripts/ssm/ssm_nonig_ate_config.yml

0 commit comments

Comments
 (0)