ID: 30231
Added: 2003-05-22 8:55
Modified: 2004-12-21 0:33
Refreshed: 2009-01-07 22:47
|
 |

Document(s) 12 of 13
Glossary| TERM | DEFINITION |
|---|
|
|---|
Assessment | Often used as a synonym for evaluation; sometimes recommended for approaches that report measurement without making judgments on the measurements. | Assumptions | The external factors, influences, situations or conditions that are necessary for project success. Assumptions are external factors that are quite likely but not certain to occur and which are important for the success of the project or program, but which are largely or completely beyond the control of project management. | Audit | An examination or review that assesses and reports on the extent to which a condition, process or performance conforms to predetermined standards or criteria. | Baseline/Baseline data | The set of conditions existing at the outset of a program. Periodic comparisons to the baseline state can determine progress, or lack thereof. | Benchmark | A reference point or standard against which progress or achievements may be compared. | Benchmarking | Compares that which is being measured to a benchmark such as best practices in the field, including professional or scientific standards. | Bias | The extent to which a measurement or method systematically underestimates or overestimates a value. |
Capabilities | Resources within a society that influence the type and scale of activity undertaken by individuals and organizations (e.g., natural resources, infrastructure, human resources, technology). | Capacity | Organizational and technical abilities, relationships and values that enable countries, organizations, groups and individuals at any level to carry out functions and achieve their development objectives over time. | Capacity building | The ability of individuals, groups, institutions and organizations to identify and solve development problems over time. | Capacity development | The process by which individuals, organizations, institutions and societies develop their individual and collective abilities to perform functions, solve problems and set and achieve objectives. | Case | The phenomenon to be investigated in case study research. The term is also used for clinical “cases” such as the behavior pattern of an individual. | Case study | A research process focused on understanding a specific phenomenon, within its real life context, generally involving multiple sources of information. | Ceremonial assessments | Refers to the control of data to a few offices and individuals during an assessment of organizational performance with the intent of carefully hiding any criticism directed at the organization in question. | Client | The person, group or agency that has commissioned an evaluation and to whom the evaluator has legal responsibility. |
Conclusion | A reasoned judgment based on a synthesis of findings. | Conflict of interest | When there is a clash between the private interest and the public interest of a person responsible for an evaluation. It is not necessarily fatal to validity (e.g., self-evaluation is a legitimate strategy), but may affect credibility unless various interests are suitably balanced. | Culture | Set of values, guiding beliefs, understandings and ways of thinking that are shared by members of an organization and are taught to new members. Culture represents the unwritten, informal standards of an organization. | Dependent variable | A variable that is thought to be affected or influenced by a program. | Effectiveness | The extent to which objectives or planned outputs have been achieved. | Empowerment evaluation | Empowers those involved in an evaluation study by giving them new knowledge of their performance. Enabling environment. | Enabling environment | Attitudes, policies and practices that stimulate and support effective and efficient functioning of organizations and individuals. | Evaluability | The extent to which a project or program has been defined in such a way as to enable subsequent evaluation. | Financial viability | An organization’s ability to maintain the inflow of financial resources greater than the outflow. | Finding | A factual statement about the program based on evidence. It may involve a synthesis of data and, therefore, judgment. |
Focus group | A carefully planned and moderated informal discussion where one person’s ideas bounce off those of another, creating a chain reaction of informative dialogue. The purpose is to address a specific topic in depth and in a comfortable environment in order to elicit a wide range of opinions, attitudes, feelings and perceptions from a group of individuals who share some common experience relative to the dimension under study. | Governance | Issues and problems involved in aligning the interests of those who manage an organization with those who are responsible for its results, who own it, and with outsiders who have a stake in the organization. | Impact | The ultimate planned and unplanned consequences of a program; an expression of the changes actually produced as a result of the program, typically several years after the program has stabilized or been completed. | Indicator | An explicit measure used to determine performance; a signal that reveals progress towards objectives; a means of measuring what actually happens against what has been planned in terms of quality, quantity and timeliness. | Infrastructure | Reference to the basic conditions (facilities and technology) that allow work to go on within the organization (e.g., adequate lighting, clean water). | Input | Resources that are required for achieving the stated results by producing the intended outputs through relevant activities (e.g., human resources, materials, services). | Institutional ethos | Implicit or unwritten codes that include cultural values, norms, religious precepts and taboos. Also known as “informal rules of the game.” |
Leadership | Process whereby an individual engages in processes of influencing a group of individuals to achieve a common purpose. | Likert scale | A scale that asks respondents to indicate the extent to which they agree or disagree with a statement. Five and seven point scales are the most common; three can be used for special situations and children. | Logic models | The translation of assumptions and mental models of individuals into understandable and familiar systems that complement the needs and expectations of an organization, thus allowing it to make logical decisions. | Missing data | Data that the evaluator intended to collect but was unable to for a variety reasons (e.g., the inability to interview a key informant, limited access to a research setting, blank items on a questionnaire, data entry errors). | Monitoring | An ongoing process to verify systematically that planned activities or processes take place as expected or that progress is being made in achieving planned outputs. | Motivation | An intrinsic and moral desire to achieve a purpose. | Niche management | Type of management that involves the identification of and concentration on a competitively valuable capability (or set of capabilities) that an organization has more of or can do better than its rivals. | Objective | Expresses a particular effect that the program is expected to achieve if completed successfully according to plan. | Ongoing relevance | Ability of an organization to meet the needs and gain the support of its priority stakeholders in the past, present and future. |
Opportunity cost | The value that one gives up by selecting one of several mutually exclusive alternatives. | Outcome | An effect or consequence of a program in the medium term. Between an output that is short term and one that is often considered to be five years or more from the program intervention. A medium-term result that is the logical consequence of achieving a combination of outputs. | Output | The physical products, institutional and operational changes, or improved skills and knowledge to be achieved by the project or program as a result of good management of inputs and activities. The immediate, visible, concrete and tangible consequences of project inputs. | Primary data | Information obtained first-hand by the researcher. | Program | A group of related projects, services and activities directed to the achievement of specific goals. | Program evaluation | The process of making judgments about a program based on information and analysis relative to such issues as relevance, cost-effectiveness and success for its stakeholders. | Program rationale | The fundamental reason(s) why a program exists, together with its underlying assumptions. | Project | A planned undertaking designed to achieve certain specific objectives within a given budget and a specified period of time. | Project trap | A situation in which a project takes precedence over an organization and its mission, possibly leading to organizational decline. |
Qualitative data | Data that use non-numeric information for description. Generally words, but may include photographs and films, audio recordings, and artifacts. | Quantitative data | Information that describes, explains and reports on phenomena using numbers. | Questionnaire | A set of written questions used to collect data from respondents. | Relevance | The degree to which the purpose of a project or program remains valid and pertinent. | Reliability | The quality of a measurement process that would produce similar results from (1) repeated observations of the same condition or event, or from (2) multiple observations of the same condition or event by different means. Reliability also refers to the extent that a data collection instrument will yield the same results each time it is administered. In qualitative research, reliability refers to the extent that different researchers, given exposure to the same situation, would reach the same conclusions. | Result | Describable or measurable change in a given state that is derived from a cause-and-effect relationship. | Return on investment | In fiscal evaluation, the ratio of benefits to costs, generally expressed as a percentage. | Rules | Legal or regulatory structures within an organization. Rules are one of the most important ingredients of an enabling environment. | Sample | A subset of a population. |
Stakeholders | Any group within or outside an organization that has a stake in the organization’s performance. Creditors, suppliers, employees and owners are all stakeholders. | Success | A favorable program or project result that is assessed in terms of such considerations as effectiveness, impact, sustainability and contributions to capacity development. | Terms of reference | The focus and boundaries of a contract research project, including a statement about who the research is for, the research objective, major issues and questions, and sometimes the schedule and available resources. | Triangulation | A process of using multiple data sources, data collection methods, and/or theories to validate research findings, help eliminate bias, and detect errors or anomalies in discoveries. | Unit of analysis | The actual object being investigated (e.g., persons, classrooms, organizations, nations). | Validity | The largest methodological challenge to organizational assessment, validity refers to the ability of a methodology to be relevant and meaningful as well as appropriate to an organization’s mission. | Validity of an evaluation | The extent to which an evaluation’s conclusions are justified by the data presented. | Variable | A characteristic that can assume any one of a range of values. | Work plan | A document that details the resources and methodology to be used in conducting an evaluation. |

Document(s) 12 of 13
|
 |