Step 2 - Our Analysis

Moderation

Once the data on system maturity has been collected via the survey, the NELP team then go through a process of moderation to ensure that the data is consistent across Places.

The first step consists of researchers reviewing the submitted scores, descriptions, and supporting information, before assigning confidence ratings. Where there are scores which have lower confidence, Places are asked to review the data and provide additional justifications where possible.

Following this, Places are invited to moderation meetings where they can collaboratively discuss their scores with other Places and members of the NELP team, to share learning and understanding of how the conditions are interpreted.

Finally, researchers in the NELP team undertake cross-case moderation, where scores for a particular condition are checked across all places for consistency.

Analysis

Once data from all three sources has been collected and processed, configurational analysis is undertaken using the EvalC3 tool. This tool allows us to search for patterns in the dataset leading towards outcomes of interest. The outcomes of this analysis are presented in decision trees, where sets of conditions which predict an outcome are grouped together. For a full description of the steps to use EvalC3, please see the methods section of this site.