Model Evaluation Open Version

This open version of the Guide Wiki Page displays the i* construct as per the i* Style of the University of Toronto. Use Comment tab above to read or write comments about this i* construct. Scroll down to see variations of this construct for other i* modeling styles.

9.2 Model Evaluation

Although the concepts of ability, workability, viability and believability are useful for model analysis, often, especially in complicated models, it is difficult to assess these concepts in an ad-hoc manner. In order to help answer analysis questions using i* models in a systematic and consistent way, a qualitative evaluation procedure has been introduced. This procedure uses a set of qualitative evaluation labels that represent the satisfaction or denial level of each element in the model. Initial evaluation labels reflecting an analysis question are placed in the model. These labels are then propagated throughout the model using a combination of set propagation rules and human judgment. The results of this propagation are interpreted in order to answer the analysis question. This process is repeated for additional analysis questions. Often, analysis leads to a modification of the model, when areas of the model which do not convey the intended meaning are discovered and modified. The entire process is intended to be iterative, with cycles of model evaluation and modification until a viable design alternative, or routines for all goals have been found and the model is believable.

This section discusses the main concepts, notation, propagation rules and steps of the i* evaluation procedure. The provided rules are provided only as guidelines that can be adapted by intermediate and advanced users as appropriate in more advanced situations. A running example is used to make the explanation more concrete. The procedure is presented step-by-step:

  • Step 1 Decide on an analysis question
  • Step 2 Give initial Labels to elements based on the question that you have decided to apply in Step 1
  • Step 3 Propagate Label values
  • Step 4 Interpret the results
  • Step 5 Iteration: Repeat steps 1 to 4 for each analysis question, modify the model if needed.

For each step, general recommendations and guidelines, associated with discussions and illustrations, are provided.
This section is intended only as a summary of the i* evaluation procedure. For additional discussions on using i* models for evaluation, including the general algorithm, convergence, termination, and human judgment see Horkoff (2006), Horkoff (2004), Horkoff and Yu (2005), Horkoff, Yu, and Liu (2004), Horkoff, Yu, and Liu (200), and Horkoff and Yu (2005).

Return to the stable version of this page

Instructions for Guideline authors/contributors

Below is the space designated to post possible variations. Please do not edit or alter the original guideline above.

Please provide the following information for each variation:
1. Name of Modeling Framework/School/Location/Research Group
2. Variation and explanation
3. Example(s)

Learn how to upload and use an image in the wiki page

You can use the Comment tab to post additional comments about this guideline or its variations outside this space. The Comment tab displays your comments at the bottom of this page. (Do not use the Discuss tab).

Add variations here.

Return to the stable version of this page

Created by samer. Last Modification: Monday 05 of May, 2008 16:48:33 GMT-0000 by samer.