Presets and configs
dtControl currently uses some confusing terminology. We have the --config
switch that allows us to select user config files (.yml
storing user presets). We also have _config.json
files which stores the dataset metadata. It was pointed out by @kushgrover that these terminologies are confusing and I agree completely with him.
I propose that
- We start calling the user/system config files that store presets as preset files.
- We rename the
--config
switch to--load-presets
or something on those lines. - We change the
dataset_config.json
todataset_metadata.json
or evendataset.metadata
- We allow users to select the metadata file manually using a new
--metadata
switch
My guess is that would have to make changes in cli
, in BenchmarkSuite
, the DatasetLoader
as well as the frontend.
Finally, the documentation must also be updated.