Skip to content

Commit 157d43f

Browse files
SvenKlaassenSvenKlaassen
committed
rerun apo sim
1 parent 11afbed commit 157d43f

File tree

7 files changed

+145
-0
lines changed

7 files changed

+145
-0
lines changed

‎results/irm/apo_config.yml‎

Lines changed: 49 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,49 @@
1+
simulation_parameters:
2+
repetitions: 1000
3+
max_runtime: 19800
4+
random_seed: 42
5+
n_jobs: -2
6+
dgp_parameters:
7+
n_obs:
8+
- 500
9+
n_levels:
10+
- 2
11+
linear:
12+
- true
13+
learner_definitions:
14+
linear: &id001
15+
name: Linear
16+
logit: &id002
17+
name: Logistic
18+
lgbmr: &id003
19+
name: LGBM Regr.
20+
params:
21+
n_estimators: 500
22+
learning_rate: 0.01
23+
min_child_samples: 10
24+
lgbmc: &id004
25+
name: LGBM Clas.
26+
params:
27+
n_estimators: 500
28+
learning_rate: 0.01
29+
min_child_samples: 10
30+
dml_parameters:
31+
treatment_level:
32+
- 0
33+
- 1
34+
- 2
35+
trimming_threshold:
36+
- 0.01
37+
learners:
38+
- ml_g: *id001
39+
ml_m: *id002
40+
- ml_g: *id003
41+
ml_m: *id004
42+
- ml_g: *id003
43+
ml_m: *id002
44+
- ml_g: *id001
45+
ml_m: *id004
46+
confidence_parameters:
47+
level:
48+
- 0.95
49+
- 0.9

‎results/irm/apo_coverage.csv‎

Lines changed: 25 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,25 @@
1+
Learner g,Learner m,Treatment Level,level,Coverage,CI Length,Bias,repetition
2+
LGBM Regr.,LGBM Clas.,0,0.9,0.923,8.535462056273152,2.0255827803361752,1000
3+
LGBM Regr.,LGBM Clas.,0,0.95,0.968,10.170630351290903,2.0255827803361752,1000
4+
LGBM Regr.,LGBM Clas.,1,0.9,0.915,34.31276092012859,8.463655678765429,1000
5+
LGBM Regr.,LGBM Clas.,1,0.95,0.969,40.886176442476604,8.463655678765429,1000
6+
LGBM Regr.,LGBM Clas.,2,0.9,0.901,33.644464659560505,8.44195706768521,1000
7+
LGBM Regr.,LGBM Clas.,2,0.95,0.953,40.08985233177513,8.44195706768521,1000
8+
LGBM Regr.,Logistic,0,0.9,0.913,5.611262078064704,1.3129445023644262,1000
9+
LGBM Regr.,Logistic,0,0.95,0.96,6.686231164049146,1.3129445023644262,1000
10+
LGBM Regr.,Logistic,1,0.9,0.906,7.131142409013338,1.601689163860689,1000
11+
LGBM Regr.,Logistic,1,0.95,0.952,8.497280281526653,1.601689163860689,1000
12+
LGBM Regr.,Logistic,2,0.9,0.926,7.123330875617923,1.5793207930346633,1000
13+
LGBM Regr.,Logistic,2,0.95,0.961,8.487972265379696,1.5793207930346633,1000
14+
Linear,LGBM Clas.,0,0.9,0.91,5.450702479855432,1.2788345107461965,1000
15+
Linear,LGBM Clas.,0,0.95,0.953,6.494912602502952,1.2788345107461965,1000
16+
Linear,LGBM Clas.,1,0.9,0.934,9.871742629461385,2.0208159577876965,1000
17+
Linear,LGBM Clas.,1,0.95,0.977,11.762906863787386,2.0208159577876965,1000
18+
Linear,LGBM Clas.,2,0.9,0.935,7.196139854742809,1.5705772035604926,1000
19+
Linear,LGBM Clas.,2,0.95,0.971,8.574729515081229,1.5705772035604926,1000
20+
Linear,Logistic,0,0.9,0.915,5.333252473490304,1.262628265253654,1000
21+
Linear,Logistic,0,0.95,0.951,6.354962287965668,1.262628265253654,1000
22+
Linear,Logistic,1,0.9,0.907,5.409257288463179,1.2841258169966927,1000
23+
Linear,Logistic,1,0.95,0.947,6.445527610957087,1.2841258169966927,1000
24+
Linear,Logistic,2,0.9,0.909,5.362180231077127,1.2686475779103141,1000
25+
Linear,Logistic,2,0.95,0.949,6.389431837167295,1.2686475779103141,1000

‎results/irm/apo_metadata.csv‎

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,2 @@
1+
DoubleML Version,Script,Date,Total Runtime (minutes),Python Version,Config File
2+
0.10.0,APOCoverageSimulation,2025-06-04 15:38,79.44047049681346,3.12.3,scripts/irm/apo_config.yml

‎results/irm/apos_causal_contrast.csv‎

Lines changed: 9 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,9 @@
1+
Learner g,Learner m,level,Coverage,CI Length,Bias,Uniform Coverage,Uniform CI Length,repetition
2+
LGBM Regr.,LGBM Clas.,0.9,0.95,31.91721104409269,7.529968087228317,1.0,37.4636413071499,10
3+
LGBM Regr.,LGBM Clas.,0.95,1.0,38.03170270495524,7.529968087228317,1.0,43.241464165962284,10
4+
LGBM Regr.,Logistic,0.9,0.95,5.304714488934599,1.027836049470268,0.9,6.251613923340696,10
5+
LGBM Regr.,Logistic,0.95,1.0,6.320957181976872,1.027836049470268,1.0,7.198738181726997,10
6+
Linear,LGBM Clas.,0.9,1.0,6.438241354759464,1.314536189350619,1.0,7.653944769218363,10
7+
Linear,LGBM Clas.,0.95,1.0,7.671637750826568,1.314536189350619,1.0,8.702704094524151,10
8+
Linear,Logistic,0.9,0.85,1.1652765429848944,0.3017518264953267,0.9,1.3833080428519742,10
9+
Linear,Logistic,0.95,0.95,1.388512642618938,0.3017518264953267,0.9,1.5824304649513923,10

‎results/irm/apos_config.yml‎

Lines changed: 49 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,49 @@
1+
simulation_parameters:
2+
repetitions: 10
3+
max_runtime: 19800
4+
random_seed: 42
5+
n_jobs: -2
6+
dgp_parameters:
7+
n_obs:
8+
- 500
9+
n_levels:
10+
- 2
11+
linear:
12+
- true
13+
learner_definitions:
14+
linear: &id001
15+
name: Linear
16+
logit: &id002
17+
name: Logistic
18+
lgbmr: &id003
19+
name: LGBM Regr.
20+
params:
21+
n_estimators: 500
22+
learning_rate: 0.01
23+
min_child_samples: 10
24+
lgbmc: &id004
25+
name: LGBM Clas.
26+
params:
27+
n_estimators: 500
28+
learning_rate: 0.01
29+
min_child_samples: 10
30+
dml_parameters:
31+
treatment_levels:
32+
- - 0
33+
- 1
34+
- 2
35+
trimming_threshold:
36+
- 0.01
37+
learners:
38+
- ml_g: *id001
39+
ml_m: *id002
40+
- ml_g: *id003
41+
ml_m: *id004
42+
- ml_g: *id003
43+
ml_m: *id002
44+
- ml_g: *id001
45+
ml_m: *id004
46+
confidence_parameters:
47+
level:
48+
- 0.95
49+
- 0.9

‎results/irm/apos_coverage.csv‎

Lines changed: 9 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,9 @@
1+
Learner g,Learner m,level,Coverage,CI Length,Bias,Uniform Coverage,Uniform CI Length,repetition
2+
LGBM Regr.,LGBM Clas.,0.9,0.9666666666666666,24.23829065815574,5.364818286446242,1.0,30.821279617475888,10
3+
LGBM Regr.,LGBM Clas.,0.95,1.0,28.88170470514485,5.364818286446242,1.0,34.908362344740716,10
4+
LGBM Regr.,Logistic,0.9,0.9333333333333333,6.661576667942033,1.3024704354536263,1.0,8.197479425135544,10
5+
LGBM Regr.,Logistic,0.95,1.0,7.937758190445909,1.3024704354536263,1.0,9.401107266465424,10
6+
Linear,LGBM Clas.,0.9,1.0,7.396692188822489,1.5391733226732347,1.0,9.104167961217458,10
7+
Linear,LGBM Clas.,0.95,1.0,8.813702360671227,1.5391733226732347,1.0,10.378182198628407,10
8+
Linear,Logistic,0.9,0.9666666666666666,5.385540707553376,1.002895084709317,0.9,5.849824289521431,10
9+
Linear,Logistic,0.95,1.0,6.417267561760002,1.002895084709317,1.0,6.847571899501526,10

‎results/irm/apos_metadata.csv‎

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,2 @@
1+
DoubleML Version,Script,Date,Total Runtime (minutes),Python Version,Config File
2+
0.10.0,APOSCoverageSimulation,2025-06-04 14:15,0.6359844247500102,3.12.3,scripts/irm/apos_config.yml

0 commit comments

Comments
 (0)