Skip to content

Commit 72c9ea7

Browse files
author
Github Actions
committed
Ravin Kohli: Add seed to dataset creation (#202)
1 parent f108374 commit 72c9ea7

20 files changed

+205
-486
lines changed
0 Bytes
Binary file not shown.
0 Bytes
Binary file not shown.
0 Bytes
Binary file not shown.
0 Bytes
Binary file not shown.

refactor_development_regularization_cocktails/_modules/autoPyTorch/api/tabular_classification.html

Lines changed: 2 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -272,7 +272,8 @@ <h1>Source code for autoPyTorch.api.tabular_classification</h1><div class="highl
272272
<span class="n">validator</span><span class="o">=</span><span class="n">InputValidator</span><span class="p">,</span>
273273
<span class="n">resampling_strategy</span><span class="o">=</span><span class="n">resampling_strategy</span><span class="p">,</span>
274274
<span class="n">resampling_strategy_args</span><span class="o">=</span><span class="n">resampling_strategy_args</span><span class="p">,</span>
275-
<span class="n">dataset_name</span><span class="o">=</span><span class="n">dataset_name</span>
275+
<span class="n">dataset_name</span><span class="o">=</span><span class="n">dataset_name</span><span class="p">,</span>
276+
<span class="n">seed</span><span class="o">=</span><span class="bp">self</span><span class="o">.</span><span class="n">seed</span>
276277
<span class="p">)</span>
277278
<span class="k">if</span> <span class="ow">not</span> <span class="n">return_only</span><span class="p">:</span>
278279
<span class="bp">self</span><span class="o">.</span><span class="n">InputValidator</span> <span class="o">=</span> <span class="n">InputValidator</span>

refactor_development_regularization_cocktails/_sources/advanced_tabular/example_custom_configuration_space.rst.txt

Lines changed: 28 additions & 33 deletions
Original file line numberDiff line numberDiff line change
@@ -46,7 +46,7 @@ the search. Currently, there are two changes that can be made to the space:-
4646

4747
.. code-block:: none
4848
49-
<smac.runhistory.runhistory.RunHistory object at 0x7fc41b387d00> [TrajEntry(train_perf=2147483648, incumbent_id=1, incumbent=Configuration:
49+
<smac.runhistory.runhistory.RunHistory object at 0x7fa65ea0d7f0> [TrajEntry(train_perf=2147483648, incumbent_id=1, incumbent=Configuration:
5050
data_loader:batch_size, Value: 32
5151
encoder:__choice__, Value: 'OneHotEncoder'
5252
feature_preprocessor:__choice__, Value: 'NoFeaturePreprocessor'
@@ -87,7 +87,7 @@ the search. Currently, there are two changes that can be made to the space:-
8787
trainer:StandardTrainer:use_stochastic_weight_averaging, Value: True
8888
trainer:StandardTrainer:weighted_loss, Constant: 1
8989
trainer:__choice__, Value: 'StandardTrainer'
90-
, ta_runs=0, ta_time_used=0.0, wallclock_time=0.0019719600677490234, budget=0), TrajEntry(train_perf=0.14035087719298245, incumbent_id=1, incumbent=Configuration:
90+
, ta_runs=0, ta_time_used=0.0, wallclock_time=0.0022118091583251953, budget=0), TrajEntry(train_perf=0.16959064327485385, incumbent_id=1, incumbent=Configuration:
9191
data_loader:batch_size, Value: 32
9292
encoder:__choice__, Value: 'OneHotEncoder'
9393
feature_preprocessor:__choice__, Value: 'NoFeaturePreprocessor'
@@ -128,19 +128,19 @@ the search. Currently, there are two changes that can be made to the space:-
128128
trainer:StandardTrainer:use_stochastic_weight_averaging, Value: True
129129
trainer:StandardTrainer:weighted_loss, Constant: 1
130130
trainer:__choice__, Value: 'StandardTrainer'
131-
, ta_runs=1, ta_time_used=14.711710453033447, wallclock_time=16.210379123687744, budget=5.555555555555555)]
132-
{'accuracy': 0.8439306358381503}
133-
| | Preprocessing | Estimator | Weight |
134-
|---:|:------------------------------------------------------------------|:----------------------------------------------------------|---------:|
135-
| 0 | None | RFClassifier | 0.32 |
136-
| 1 | None | KNNClassifier | 0.2 |
137-
| 2 | None | CatBoostClassifier | 0.16 |
138-
| 3 | None | SVC | 0.12 |
139-
| 4 | None | ExtraTreesClassifier | 0.08 |
140-
| 5 | None | LGBMClassifier | 0.04 |
141-
| 6 | SimpleImputer,OneHotEncoder,StandardScaler,NoFeaturePreprocessing | no embedding,MLPBackbone,FullyConnectedHead,nn.Sequential | 0.04 |
142-
| 7 | SimpleImputer,OneHotEncoder,StandardScaler,NoFeaturePreprocessing | no embedding,MLPBackbone,FullyConnectedHead,nn.Sequential | 0.04 |
143-
<smac.runhistory.runhistory.RunHistory object at 0x7fc419b097c0> [TrajEntry(train_perf=2147483648, incumbent_id=1, incumbent=Configuration:
131+
, ta_runs=1, ta_time_used=15.02844500541687, wallclock_time=16.55308246612549, budget=5.555555555555555)]
132+
{'accuracy': 0.8670520231213873}
133+
| | Preprocessing | Estimator | Weight |
134+
|---:|:------------------------------------------------------------------|:-------------------------------------------------------------|---------:|
135+
| 0 | None | CatBoostClassifier | 0.34 |
136+
| 1 | None | RFClassifier | 0.24 |
137+
| 2 | SimpleImputer,OneHotEncoder,NoScaler,PolynomialFeatures | no embedding,ResNetBackbone,FullyConnectedHead,nn.Sequential | 0.14 |
138+
| 3 | None | ExtraTreesClassifier | 0.1 |
139+
| 4 | None | LGBMClassifier | 0.08 |
140+
| 5 | SimpleImputer,OneHotEncoder,StandardScaler,NoFeaturePreprocessing | no embedding,MLPBackbone,FullyConnectedHead,nn.Sequential | 0.06 |
141+
| 6 | None | SVC | 0.02 |
142+
| 7 | None | KNNClassifier | 0.02 |
143+
<smac.runhistory.runhistory.RunHistory object at 0x7fa65ee32b50> [TrajEntry(train_perf=2147483648, incumbent_id=1, incumbent=Configuration:
144144
data_loader:batch_size, Value: 32
145145
encoder:__choice__, Value: 'NoEncoder'
146146
feature_preprocessor:__choice__, Value: 'NoFeaturePreprocessor'
@@ -179,7 +179,7 @@ the search. Currently, there are two changes that can be made to the space:-
179179
trainer:StandardTrainer:use_stochastic_weight_averaging, Value: True
180180
trainer:StandardTrainer:weighted_loss, Constant: 1
181181
trainer:__choice__, Value: 'StandardTrainer'
182-
, ta_runs=0, ta_time_used=0.0, wallclock_time=0.0016453266143798828, budget=0), TrajEntry(train_perf=0.15204678362573099, incumbent_id=1, incumbent=Configuration:
182+
, ta_runs=0, ta_time_used=0.0, wallclock_time=0.001974344253540039, budget=0), TrajEntry(train_perf=0.2222222222222222, incumbent_id=1, incumbent=Configuration:
183183
data_loader:batch_size, Value: 32
184184
encoder:__choice__, Value: 'NoEncoder'
185185
feature_preprocessor:__choice__, Value: 'NoFeaturePreprocessor'
@@ -218,22 +218,17 @@ the search. Currently, there are two changes that can be made to the space:-
218218
trainer:StandardTrainer:use_stochastic_weight_averaging, Value: True
219219
trainer:StandardTrainer:weighted_loss, Constant: 1
220220
trainer:__choice__, Value: 'StandardTrainer'
221-
, ta_runs=1, ta_time_used=9.260286808013916, wallclock_time=10.778798341751099, budget=5.555555555555555)]
222-
{'accuracy': 0.8439306358381503}
223-
| | Preprocessing | Estimator | Weight |
224-
|---:|:--------------------------------------------------------------|:----------------------------------------------------------------|---------:|
225-
| 0 | None | CatBoostClassifier | 0.28 |
226-
| 1 | None | KNNClassifier | 0.18 |
227-
| 2 | None | SVC | 0.12 |
228-
| 3 | SimpleImputer,NoEncoder,Normalizer,PolynomialFeatures | no embedding,ResNetBackbone,FullyConnectedHead,nn.Sequential | 0.1 |
229-
| 4 | None | ExtraTreesClassifier | 0.08 |
230-
| 5 | SimpleImputer,NoEncoder,StandardScaler,NoFeaturePreprocessing | no embedding,ShapedMLPBackbone,FullyConnectedHead,nn.Sequential | 0.06 |
231-
| 6 | None | RFClassifier | 0.04 |
232-
| 7 | SimpleImputer,NoEncoder,StandardScaler,NoFeaturePreprocessing | no embedding,ShapedMLPBackbone,FullyConnectedHead,nn.Sequential | 0.04 |
233-
| 8 | SimpleImputer,NoEncoder,StandardScaler,NoFeaturePreprocessing | no embedding,ShapedMLPBackbone,FullyConnectedHead,nn.Sequential | 0.04 |
234-
| 9 | SimpleImputer,NoEncoder,StandardScaler,PolynomialFeatures | no embedding,ShapedMLPBackbone,FullyConnectedHead,nn.Sequential | 0.02 |
235-
| 10 | SimpleImputer,NoEncoder,StandardScaler,PolynomialFeatures | no embedding,ShapedMLPBackbone,FullyConnectedHead,nn.Sequential | 0.02 |
236-
| 11 | None | LGBMClassifier | 0.02 |
221+
, ta_runs=1, ta_time_used=9.633345603942871, wallclock_time=11.128498792648315, budget=5.555555555555555)]
222+
{'accuracy': 0.8554913294797688}
223+
| | Preprocessing | Estimator | Weight |
224+
|---:|:----------------------------------------------------|:-------------------------------------------------------------|---------:|
225+
| 0 | SimpleImputer,NoEncoder,NoScaler,PolynomialFeatures | no embedding,ResNetBackbone,FullyConnectedHead,nn.Sequential | 0.7 |
226+
| 1 | None | RFClassifier | 0.1 |
227+
| 2 | None | CatBoostClassifier | 0.06 |
228+
| 3 | SimpleImputer,NoEncoder,NoScaler,PolynomialFeatures | no embedding,ResNetBackbone,FullyConnectedHead,nn.Sequential | 0.04 |
229+
| 4 | None | LGBMClassifier | 0.04 |
230+
| 5 | None | ExtraTreesClassifier | 0.04 |
231+
| 6 | None | SVC | 0.02 |
237232
238233
239234
@@ -362,7 +357,7 @@ the search. Currently, there are two changes that can be made to the space:-
362357
363358
.. rst-class:: sphx-glr-timing
364359

365-
**Total running time of the script:** ( 11 minutes 35.768 seconds)
360+
**Total running time of the script:** ( 11 minutes 39.384 seconds)
366361

367362

368363
.. _sphx_glr_download_advanced_tabular_example_custom_configuration_space.py:

0 commit comments

Comments
 (0)