Data Analysis And Report Writing

Purpose

  • Provide an overview of the data analysis process
  • Provide an overview of the preparation of Preliminary and Final Reports
  • Discuss dissemination of analysed data results

Process for report preparation

Before producing tabulations and writing reports, the following tasks should be completed:

  • Carry out basic checks of data quality (non-sampling errors)
  • Calculate response rates Response rates lower than 90% suggests results may be biased; include response rates in the reports
  • Check for variables with large numbers of missing values Make sure not a problem with data entry or editing; any variable with 10% or more missing values use with caution; if very high do not use at all
  • Check for variables with large numbers of “don’t know” or “other” answers                                                                                             Large numbers of DKs can indicate difficulty understanding the questions; High proportions of “other” indicates questionnaire did not account for most common responses
  • Check for expected patterns in the data Unexpected patterns may result from faulty sample design, improper implementation of the sample, interviewer errors, or respondents’ inaccurate answers.
  • Decide on basic background variables and their groupings Often include geographic areas, level of education, urban/rural residence, male/female, wealth quintiles, etc.
  • Decide on minimum sample sizes for displaying results Cells based on very small numbers of cases are not reliable and should not be shown; results based on fewer than 25 unweighted cases should not be shown.

Producing a Preliminary Report

  • Objective: To convey the main results of the survey quickly and to stimulate interest in the current situation among government agencies, NGOs, other multilateral donors, the press and the public
  • Length: 15-20 pages
  • When: Within one month to six weeks following the end of fieldwork

Outline of Preliminary Report

Background and objectives of the survey

Results

Sample and fieldwork methodology

  • Sample design
  • Response rates
  • Questionnaires
  • Fieldwork and field staff
  • Processing of data

Circulation of Preliminary Report and Dissemination of Findings

  • Circulation – Distribute to relevant government institutions, NGOs, donors, and the press
  • Meeting – Present results at a meeting with representatives of key agencies and the press
  • Press release – Prepare a press release summarizing main results

Outline of Final Report

  • Executive summary
  • Introduction and background
  • Data quality and sample characteristics
  • Results (with sections by topic)
  • Sample design
  • Survey instruments

Circulation of Final Report and Dissemination of Findings

Distribution – to key government agencies, NGOs, donors, researchers and the press

Regional and international circulation – by UNICEF, and at meetings and conferences

Meeting on main findings – All major participants in the survey should be invited to a meeting to present main findings

Specific topics – Meetings and presentations that focus on specific topics can also be arranged and may lead to additional analysis of the data

Further Analysis of the Data

MICS data can be used for statistical analysis beyond that contained in the survey report

The data collected should be exploited as fully as possible

  • Potential topics for further analysis:
  • Analysis of data quality
  • Analysis of trends
  • Identification of “most vulnerable” groups
  • Examination of health outcomes for orphans versus other children
  • Multivariate analyses of determinants of child health or schooling outcomes
0