Formative evaluation of an arithmetic game for out-of-school children in Sudan

Education for children in the developing world is in crisis, and children growing up in war are already at the sharp end of global development challenges: of the 57 million primary-age children who are out of school, almost half live in conflict zones1. This research is grounded in the issues of educating children living in these zones, with a particular focus on innovative approaches to access via online and distance learning using ICT. Within this approach, a mathematics game was developed in close cooperation with the Ministry of Education in Sudan, the Ahfad University for Women in Khartoum and children from target communities. The intention is to develop a game that enables children from those communities to autonomously learn mathematics covering a curriculum of three years.
The objective of this research is to describe the design of this game in relation to its requirements – educational, contextual, cultural and from a game design perspective. An additional goal was to find out if children can play the game, want to play it, and will play it again. For pragmatic reasons this evaluation has been carried out in The Netherlands, with a total of 14 Arabic speaking children. Their backgrounds were Egyptian, Moroccan and Sudanese. The ages varied between 5 and 9, and the group was made up of seven girls and eight boys. The game was played on three consecutive Saturdays; most children (8) played the game three times, some children played the game once (2) or twice (5). Using observation forms, semi-structured interviews – with the children and with their parents – and questionnaires, data about motivation, enjoyment, perceived difficulty and cooperation were collected.
The results of the evaluation show that average enjoyment increased slightly over the three weeks: from 3.5 on a 5-point Likert scale in week 1 to 3.9 in week 3. The average perceived difficulty was low: starting at 2.6 in week 1 and decreasing in week two and three to 1.7. Average motivation was high: 4.5 on a 5-point Likert scale, and stayed almost the same during the evaluation. Average cooperation was high: around 4.5 on a 5-point Likert scale. The setting of this evaluation did not completely reflect the situation in Sudan; the children lived in The Netherlands and knew their mathematics. Still, it has provided worthwhile feedback to improve the game further.