2005-10-26

Long post: The "human security" report

Last week I promised a response to the UBC Human Security Report. I have finally got through it, and have several responses. Since the response is mostly critical, I want to preface it by saying that I am not dismissing the report out of hand. It represents a very ambitious and original effort to tie together a lot of information that is usually available only in scattered fashion, and also to begin measuring several important things that nobody has measured systematically yet. In that sense, it is a major and meaningful piece of work. This has to be appreciated – along with the fact that hardly anybody gets anything big right the first time out. My criticisms have to do with the categories and methods they use, and also with what seems to be the absence of a framework that would let them interpret both data they have and data that are not available.

First, one big reservation: the title of the report would suggest that it is about “human security,” but every previous use I have seen of this term defines it much more broadly. I understand “human security” as an effort to shift the balance of understanding security away from the strategic concerns of governments and toward the everyday concerns of actual humans. The idea is that the security of the world derives in large measure from how secure people feel in their lives, and that secure people make the greatest contribution to peace. Think of Mary Kaldor's big question: would money and effort be better spent building armed borders around the “green zones” of the world, or contributing to the everyday security of all of those people in the “red zones” who are too often the unprotected victims of violence?

The authors argue, essentially, that they are already measuring quite a lot, and that to take into account all of the factors that might make humans feel secure would be impossible to manage (p. viii). Fair enough – but then what they have produced is not a report on “human security.” When they begin repeating hypotheses (p. 42) about how democracies are more peaceful than other states (hypotheses which are based on a long tradition of deriving definitions from a dependent variable), the claim begins to matter. Developments that took place later than the period covered by the research, like the wars in Iraq and Afghanistan, call the general hypothesis into question: interethnic and intercommunal violence were promoted, torture was reintroduced on an official level, and these things were done by states the authors would define as neither poor nor authoritarian.

The next big objection has to do with theory and methods. One of the first rules of research is that researchers have to recognise that the information that is available will not always tell them everything that they want to know. Also, information cannot think or talk, so it will not tell you what it means all by itself. This is why theoretical frameworks are necessary: they give guidelines as to how to interpret the things you know, and how to anticipate the things you do not know. No decent researcher has ever given “just the facts.”

The main claim of the report is that, although just about everyone believes otherwise, the world is a safer and more peaceful place than it has been in the last 20 to 25 years. They characterise the changes as a “radical improvement in global security” (p. 3). Surprised? The authors want you to be, they regard their report as a major challenge to the conventional wisdom. A word now about “conventional wisdom”: this is a delightful phrase which is usually deployed to suggest that what most people believe is not true, and it works because so many people regard the possibility of becoming “conventional” with contempt and dread. But there is another side to this – it might be that if a lot of people regard something as being true, that is because it is true. This is why “conventional wisdom” cannot really be challenged with a “conventional” label, but has to be challenged with persuasive evidence.

So what is their persuasive evidence? Their argument basically runs like this: 1) there are fewer wars than there used to be, 2) wars are less deadly than they used to be, and 3) there is a decline in the number of incidents of organized killing outside of war. The favored explanation the report gives for all of these is the end of the Cold War, with secondary attention given to the increased involvement of the UN in conflicts. Let's look at the three major points one by one.

On the number of wars – first of all, it is not entirely clear what is measured by counting the number (p. 17) of wars. It is not a general measure of risk. Second, the decline in the number of wars is a conclusion driven by a definition. They define war as a conflict involving two states in which there are 1000 or more “battle deaths” in a year (fewer battle deaths would make a “conflict,” and if only one state is involved it is a “civil war": nothing on how these distinctions are made or whether conflicts between nonmilitary organisations are counted). To give an idea of how misleading the number of wars is as an indicator of security, consider Rwanda in 1994: the number of battle deaths in the conflict between the Rwandan army and the Rwandan Patriotic Front does not pass the threshold of 1000 to be called a war, while the report's categories have no way of counting the at least 800,000 victims of the most intensive genocide in recorded history. The figures the report interprets as a decline in war are entirely consistent with unsettling facts that are already well known: wars are less likely to be conducted between states than inside them, they are less likely to be conducted by soldiers than by private, semilegal or illegal armed forces (or in internal conflicts, by police or semiformal “services”), and the doctrine of “force protection” makes “battle death” one of the least likely consequences of war.

So on to their second point, that wars have become less deadly than they used to be. The report demonstrates what was already known: wars have become less deadly – to soldiers. Again, the conclusions trumpet a result which is not a finding but an artifact of methodology. The data which demonstrate the effects of technologies which prevent armies from coming into contact with one another are already well known (and they do not demonstrate this persuasively, but choose a data set which consistently offers lower estimates of fatalities than other data sets [p.30]). Their observation that “non-state conflicts involved considerably fewer fatalities” (p. 21) is true only in relation to “battle deaths.” On the issue of civilian victims, the authors perform a methodological trick. First they note (correctly) that data on civilian victims have not been systematically gathered in the past. They attempt to address this by commissioning a study of civilian victims in 2002 and 2003. Then they base a global claim about the decline of victimhood on figures which show a decline in the number of civilian victims between 2002 and 2003! This would be like concluding, if it rained yesterday and is not raining today, that the long-term incidence of rain is declining. Only longitudinal data can demonstrate that a trend exists, and data comparing a small number of cases over an inconsequential stretch of time can maybe demonstrate a blip, or maybe demonstrate a theme for future research, but cannot possibly give a basis for a conclusion.

The section dealing with deaths not directly related to war (and deaths which are not “battle deaths” -- which is the largest category!) is probably the single most frustrating section of the report. There are several points where they observe that evidence is either unreliable or not collected systematically, an observation which is both true and useful and which offers a guide to future research.

But there are also several points that demonstrate the changing nature of political violence (the use of child soldiers, violence carried out by proxies rather than by military forces, the deliberate targeting of civilians, the intentional production of displaced populations, the “strategic” use of sexual violence, the production of hunger and disease), but which are not incorporated into the general analysis because their theoretical framework has no place for them. People tend to fear their governments (p. 48), but the authors have no explanation why. So while they know that in contemporary wars armed forces will “avoid major military confrontations but frequently target civilians,” and that powerful states use “high-tech weaponry against far weaker opponents who have few or no allies” (p. 34), they have no way of addressing these developments. Despite evidence that in contemporary wars “battle deaths” constitute at most 29%, and at least less than 2% of war deaths (p. 128), their model insists on using “battle deaths” as a measure of danger. These flaws in the report do not derive from the authors not knowing the facts. It is probably to their credit that the data which would negate their conclusions are right in the report. The flaws derive from their effort to describe human security in the dated and inappropriate terms of Realpolitik.

Add to this that there are several points (the number of victims of political violence, the number of displaced persons, the rate of violent crimes such as homicide and rape, the frequency of sexual violence in wars, the probability of “indirect” victimhood due to war conditions) on which the authors not only admit that there is a lack of reliable evidence, but explain the factors leading to a lack of evidence – and then go on to draw a conclusion! At one point (p. 7), they take underreporting to be evidence of a decline in human rights violations (!). A lack of evidence may be a problem to be observed, but can hardly be basis for conclusions. The desire to argue that the world is a safer place seems to have been stronger than the support for the argument. To the authors' credit, though, at several points they promise that areas on which they have insufficient information (such as “indirect” war deaths, p. 126) will be a theme of the next report.

Generally, the evidence and conclusions seem to be at odds with one another, and this seems to be the result of trying to apply an old and weak theoretical framework to new and challenging conditions. The end of the Cold War has not meant that conflicts have ended; it means that they have changed. Accounting for those changes is probably more the job of a generation than one that can be accomplished by generating a report. The UCB team deserves a lot of credit for presenting what they know and initiating the dialogue. Better to consider their contribution as the first word rather than the last.

8 comments:

Katja R. said...

What you wrote is a good summary of the report which personally I wouldn't even glorify but then I'm not in the position to comment other than as a 'civilian'.

I wanted to add that when there is that kind of very thin, preliminary study, if one could really quite call it that, I think this sort of thing is why guys like John1975 get so frustrated and angry with the academic world. Not haveing spent lots of time in that world, they aren't able to 1. judge the qualifications of a given researcher, 2. most people includeing a lot of my student friends can't tell good research from bad, to put it bluntly they are fooled by the big words. 3. a person who's actually been in an area just AFTER a conflict or DUREING perhaps, might know first hand that some conclusions definately are wrong. Which is where your remark on 'conventional wisdom' really applies, a soldier, a contractor, a humanitarian worker, or a civilian in such an area KNOWS with their own blood, flesh, bones, mind and heart that the world is definately not a safer place. So when studies like that come out or the people makeing these sorts of studies go blundering around their neighborhood, of course they resent it very much. They can't tell who really is a qualified person and they don't really have time to find out and in the situation they are in, they really can't afford to care. So people who are not careful doing studies really cause in my opinin a lot of harm to people in the academic field.
A study like the UBC study saying something like the world being a safer place makes anyone who has spent any real time in such a place as BiH, Serbia, Rwanda very angry.
While they may have gotten a good start, it's definately premature of them to have a website up and to publicise themselves. I think it might be related to another minefield in the world of Academe, namely 'publish or perish'
Some of the problem comes from the very objective dry language in the academic world. Haveing been through a class where I was taught how to write technical papers, a useful skill, one of the hardest things about it was learning how to put forward your opinion in that language, with the citations and all that and I am here to say it isn't a lot of fun. My instructor did a good job with us, he likes to use controversial topics like sex and religion because people have a hard time doing that type of writeing about that type of subject.
He handles his job pressure by writeing some of the WORST damn poetry I ever read. He puts in it all the words and feelings which can't go into a research paper, a piece of technical writeing or a report. The very language of such reports, devoid of normal levels of expression, written at a very high register makes it hard to take and I think that is why academic people get so often accused of not being in the real world. It's not fair but I think that's why it happens.
And yes I would agree this cannot be considered the last word on the subject. You are being very charitable and diplomatic to consider it even that in my personal opinion. A bunch of fifth graders from the school down the street would have, given the facts done better.
The danger of such premature release of research and results is very great in such times as we live in.
Again a really good summary thanks.

Eric Gordy said...

Think of it as less of a summary and more of a critique. The authors want you to believe that their report changes everything, and if you look at their work closely, it does not.

I think of it as a part of my teaching job: learning to do an analysis of research means forcing the researchers to step down from the authority that their titles give them, and deal with the issues instead. A lot of academic style is designed to intimidate people, and keep this odd little preserve closed to everyone but a few people.

Katja R. said...
This comment has been removed by a blog administrator.
Katja R. said...

I had to delete my earlier comment as I was not able to finish it, was going out to a candle light vigil because of the fact that the 2000th American soldier has died as a result of the war in Iraq.
What I had to say earlier is that yes academic language indeed is designed to intimidate, for that reason there are many people outside acedemic life who are viscerally upset by it. Actually it's a sound isntinct on their part, but they then deprive themselves of good information that they could use.
Most people never learn how to do research, good research, or how to evaluate the soundness of other people's research. They as well never learn how to question shakey, inadequate research in an effective manner.
They end up believeing what they are told and never questioning it. This way a person can be lied to.
People in general don't have enough time to be well informed and I know too that a lot of people REFUSE to be well informed. That is a sad thing.
You cannot have democracy or a free country in those conditions.

John1975 said...

I think the correct word to use is "offensive", not "intimidating".

I actually tried to force myself to sit down and read all of this report. I barely made it through the first Adobe sections listed on the web site.

First; I hate adobe and think it the worst software ever developed.

Second; I actually found myself laughing out loud at some of the statements. I'm not going to go into it now for I'm just too damn tired.

What I can say is this; the only people who seem to give two cents about this report or even try to "debate" it are those in the Academic world.

Those in the "real-world" have known this since their childhood.

With all due respect, common sense should tell you the security of the individual sucks!

Don't get me wrong though, this is just my initial "report" on this and I will surely read the entire thing when I get the time.

The fact of the matter is; the only person this report considers is the upper-middle to upper class.

Governments and this upper class for the most part do not care about the lower class.

Well, for me, that's who I care about. I come from their "roots", so to speak.

I would be willing to bet my life that if you got a bunch of academic types together who were tasked with explaining this report at a lower class level, every single one would laugh because, weather it be true or not, the lower class citizen would honestly believe that not a single government official actually cares about them and already know the answer.

So, when it actually comes down to it, this report doesn't mean "CRAP". It's culmination of thoughts and the reading of other reports.

If you truly want the answer, go spend any significant time with the "peasants".

Respectfully,

John

Eric Gordy said...

The reason I am not responding is that I am waiting to see whether anybody will come to defend the report. As bad as it seems (and maybe as bad as I made it seem), I want to hear the arguments. The preface was written by Desmond Tutu -- that's about as close as you can get to having your preface written by God.

But yeah, I don't like reading things with Adobe either.

Katja R. said...

@ John, not all academic people hate the 'peasants' some actually give a damn, and yes I do find sometimes the blandness of academic language more offensive than intimidateing myself! When I said the whole academic field loses because of it, because it's so easy to hide bad research that way, I was thinking of guys like you.

As far as a preface by Desmond Tutu goes, well isn't that Special! He got coopted some time ago, there's a nice old 60s word! It means selling out without actually getting the money in your own hands.

Only God is God and only His Prophets speak for Him!

I think Adobe reeks, in my studies I'm forced to deal too much with it,the late start Billing and Codeing class has even MORE of it because we have to learn to fill out those forms invented by our Alien Preying Mantis Headed Overlords called CMS 1500 forms. This is the form that has medical bills on it and all the stuff about what you had and what they did to you about it. I don't plan on working in Billing and Codeing as much as in Medical Interpreting but you can't just take Medical Interpreting you need other training to go with it and it won't hurt me to know how to fill it out, interpreters often have to fill it out on the patient's behalf. The other hot software I've come to loathe, hate and despise is Quicktime. I can't get the damn thing to install and I really want to find the little jerk or jerks who invented it and commit a few war crims on them...

ohkfm is today's secret Klingon word, it means 'cough'

John1975 said...

Sorry but, I'm not going to read the rest of this report. I'm just too tired at the end of each day and don't have the motivation.

I did try but when I saw how long it was I knew there was no way. Sorry for taking the "easy" route.

And I do realize "not all people hate the peasants".