Document deeper insights of hierachical schema, keys and external tables #150
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Cette branche repond aux trois issues suivantes: - Expand dictionary documentation with reference to hierarchical structures #81 - Be more explicit on the impact of keys in multi-table schema #87 - Improve documentation on external tables #146 Assez delicat: bien relire pour evaluer l'interet, la forme et le fond Idealement, faire relire par differents profiles (Luc-Aurelien, Alexis, Vladimir...), voir organiser une reunion de travail.
popescu-v
reviewed
Oct 30, 2025
| ### Khiops Hierarchical Schemas | ||
|
|
||
| While traditional databases are designed for **efficient, reliable data storage and retrieval** | ||
| across various technologies, Khiops **extends the single-table data schema** used in data mining by a |
There was a problem hiding this comment.
I would say "typically used in data mining".
popescu-v
reviewed
Oct 30, 2025
| **hierarchical schema** that supports **domain knowledge encoding, automated feature engineering and predictive modeling**. | ||
| This approach bridges the gap between raw relational data and the analytical needs of machine learning workflows. | ||
|
|
||
| Database technologies cover a wide range, each suited to specific needs: simple storage, hierarchical, relational, |
There was a problem hiding this comment.
"cover a wide range of data storage schemata"?
popescu-v
reviewed
Oct 30, 2025
|
|
||
| In memory, this hierarchical structure closely resembles objects in programming languages, | ||
| which can be composed of sub-objects or arrays of sub-objects. | ||
| Khiops dictionaries serve as the language that allows us to describe and formalize this structure effectively. |
There was a problem hiding this comment.
s/serve as a language/provide a language/
There was a problem hiding this comment.
s/effectively/concisely and in an expressive manner/
popescu-v
reviewed
Oct 30, 2025
|
|
||
| In the context of Khiops, **keys** are introduced within each dictionary solely to facilitate reading data from files | ||
| and constructing hierarchical in-memory instances. | ||
| These keys are organized hierarchically in accordance with the Khiops dictionary schema: the key fields of a parent entity are |
There was a problem hiding this comment.
s/in accordance with/according to/
popescu-v
reviewed
Oct 30, 2025
|
|
||
| - **Shared Data and Computations:** | ||
| Loading external tables into memory allows for shared access to data and derived variables, which are computed once and reused within each process. | ||
| - However, processing external tables is resource-intensive: it is not parallelized and must be performed separately for each process, unlike main instances where each process handles a subset. |
There was a problem hiding this comment.
s/unlike main instances where each process handles a subset/unlike standard tables, which are processed in parallel and each process handles a subset of the table/
popescu-v
requested changes
Oct 30, 2025
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Cette PR répond aux trois issues suivantes:
Assez délicat: bien relire pour évaluer l’intérêt, la forme et le fond
Idéalement, faire relire par différents profiles (@lucaurelien, @alexisbondu, @popescu-v, ...), voire organiser une réunion de travail.