|Smart Library on Globalization|
Smart Library on Globalization > Genocide > Topic 2: Approaches to Studying Genocide > Overview: Approaches to Studying Genocide
How to Get the Facts in Darfur
It is difficult to estimate the number of civilians killed in Darfur. The region is remote and the Sudanese government has no interest in the truth being known. Two investigators map out a method for finding these elusive numbers.
When one country attacks another the open nature of the conflict makes it relatively easy to get a sense of the nature and the extent of the violence. But what about government violence within a country? If a government shuts off all access to the country (as happened in Cambodia and Sudan), how can we get a clear sense of the nature and extent of the violence?
The solution isn't easy, but Andreas Hofer Petersen and Lise-Lotte Tullin come up with a way to get a reliable sense of the violence in Darfur. Their careful analysis provides confidence in their claims.
But how do they do it?
Gather Good Data
We live in an age of information. But not all of it can be trusted. Sifting reliable information from opinion and hearsay is difficult without a set of guiding principles. This is particularly a challenge when a government actively seeks to hide information. Petersen and Tullin use the following principles to gather information on the events in Darfur.
Exclude Questionable Data
Setting rules for what data to include is only one part of the process of gathering good data. You also need to set ahead of time what information you will not include.
For instance, you may decide that you want to use only eye-witness testimony. However, can you trust all sources to eye-witness testimony to be equally accurate? Is testimony reported by Sudanese news sources as trustworthy as eye-witness testimony reported in UN documents? Probably not.
Petersen and Tullin excluded sources from groups associated in any way with the fighting. Both government and rebel sources were excluded. Also, the authors excluded information from NGOs linked to Darfur ethnic groups overseas. It is possible that the testimony provided by the some of these sources is accurate. However, because these groups have a vested interest in the conflict, there is always the suspicion that the information will have been “spun” to fit the group's objectives. Better to play it safe and throw out some good information than to be too relaxed and include faulty information.
The investigators also excluded witness testimony that did not provide exact numbers of people killed or specific reference to dead people (for example, “my father,” “my daughter,” etc.) Expressions like “people were killed” or “many people died” were excluded from the data set.
Define Terms Carefully
In order to analyze data you need to be able to categorize the data. In order to categorize data you have to have clear definitions. This may be particularly difficult with testimony—people don't always tell their stories the same way.
For instance, Petersen and Tullin wanted to get an estimate of how many villages in Darfur had been attacked. The problem was that eye-witnesses didn't always give an exact number. When a witness stated that there were “attacks on villages,” did they mean two villages or fifty villages? When a witness said that “several” villages were attacked, did “several” mean three? Seven? Eleven? There is no way to tell.
Petersen and Tullin decided to define the terms in this way:
This allowed the authors to translate testimony into numbers. Calculating the number of villages attacked in this way almost certainly underestimated the number of villages attacked. However, taking a conservative approach protected the authors from being accused of exaggeration.
Cross-Check with Other Reliable Sources
There is no perfect data source. Even reliable data sources admit the possibility of error. Different interpretations are possible from the same set of data. One way to address these issues is to check the facts in one data source against other reliable data sources.
For instance, an eye-witness may say that a particular village was attacked on a particular date or in a specific month. However, other sources may indicate that this isn't plausible (for instance, because of other evidence that the village had been destroyed some time before that). This doesn't mean that a particular witness is lying. It only means that human memories are not perfect.
Petersen and Tullin corroborate accounts of attacks on Darfur villages in two ways:
Calculate Estimates Using Different Assumptions
Even with all these precautions, there is still room for error. And, since all the relevant information cannot be known in these situations, the investigators have no choice but to make certain assumptions. Others can always question your assumptions. So, two ways to lessen the likelihood that your calculations will be discredited are:
Petersen and Tullin's approach to estimating the number of civilians killed in Darfur is a good example of this.
Using the above criteria, Petersen and Tullin were able to identify 101 villages where they could get a specific death toll. The total death toll for these 101 villages was 5733. This meant that there were an average of 57 people killed per attacked village.
But, how to estimate the number of people killed in all of Darfur? Surely there were people killed outside these 101 villages?
The investigators knew that there were 2800 villages on the OCHA list. They combined satellite scans and the information from the 101 villages in their sample to estimate that 58% of the villages in Darfur had been burned by September 2005. This gave them one way to calculate the number killed in Darfur:
Simple and straightforward calculation. But is it right? Can we really trust that an average of 57 people were killed per village? Petersen and Tullin take a different approach to estimating the average number of people killed per village.
The above change in the estimate of people killed occurs only by changing one assumption (the average number of people killed per village). But, what if we changed the assumptions about how many villages there are in Darfur? The OCHA numbers are a good reference point, but are they right? What if we change the number of deaths we know about (5733) by taking out deaths reported in “prison camps?” Prison camps are not the same as villages after all (are people killed more frequently or less frequently in prison camps?). How would this change our calculation?
It should be clear that changing assumptions can make for significant changes in the estimates of the number of people killed.
Petersen and Tullin recalculate their estimates by changing a number of assumptions. After recalculating several times they finally come up with a range. They provide a minimum and maximum estimate (based on different assumptions) of the number of people killed in the violence in Darfur: 56,840 to 128,000.
Data and Methods:
Data consisted of information from a wide range of resources, including: extensive searches of newspapers, the internet and electronic libraries; all available reports by NGOs, human rights organizations, the UN and the African Union. The authors used a strict set of inclusion and exclusion criteria to determine whether to include a particular eye-witness account in the data set.
From the eye-witness accounts the authors were able to estimate the number of villages attacked and the number of people who died in each village.
The authors used several alternative assumptions to extrapolate from their sample to the general population in Darfur. This allowed them to calculate a range of people killed in Darfur during the target period.
Not reported. [Bloodhound?]
Petersen, A.H. and Tullin, L. 2006.The Scorched Earth of Darfur: Patterns in Death and Destruction Reported by the People of Darfur. January 2001-September 2005. Copenhagen: Bloodhound.
Other Keytexts from this source