🚧 Kids First: Chromosome 18 - Proof of Concept

[awarkow]

Kids First Proof of Concept

Using KF Chromosome 18 study to test out new dbt models

1. Source data is loaded into the warehouse using pipeline tool here and named according to KF Short Code + file name.

2. Data dictionaries generated using DEVA, then passed onto Brenda who generates the base models for the study using another pipeline tool.

• src models remain mostly untouched, other than minor corrections
• stb models must be updated to reference the correct fields

3. Appropriate int modles that contain major pivots/transformations needed to harmonize the dataset (restructuring data, joins,.etc) are created.

• Similar to an ingest packages extract_configs
• currently working through bugs generating phenotypes using MapDragon CLI tool so kf_chr_18_int_phenotypes uses uncurated data and is still WIP

4. Program specific stable tables that extract needed information for the access model

• These tables should be written with the access model in mind
• Currently based heavily on common access model, but could potentially simplify for KF. Lots of models left untouched
• Is this where global IDs come in?

Continues work in D3B-2726