Intelligence cycle management

From Citizendium
Jump to navigation Jump to search
This article is developing and not approved.
Main Article
Discussion
Related Articles  [?]
Bibliography  [?]
External Links  [?]
Citable Version  [?]
 
This editable Main Article is under development and subject to a disclaimer.

The intelligence cycle is a continuous process of collecting, analyzing, disseminating, and managing intelligence information in the context of government and military affairs. Based both the discoveries in the cycle and on changing world conditions, priorities need constant adjustment.

An intelligence "consumer" might be a junior infantry officer who wants to know what is on the other side of the next hill, or could be the head of a government who wants to know if a foreign leader is blustering or really will go to war over a certain point. Intelligence organizations are not, and should never be expected to be, infallible; but, when properly managed and tasked, can be among the most valuable tools of national government. There is a case in which intelligence services (and sensors managed by intelligence specialists) have provided the information that let operational commanders decide that a nuclear attack was not in progress, thereby preventing the launch of an unnecessary "counterstrike."[1]

Nevertheless, there are a number of ways in which intelligence management can fail. Leaders can pervert the function of intelligence (failures in direction), such as demanding only information that supports a policy already decided, or directing intelligence organizations to violate civil liberties. Failures in collection can cause analysts to draw the wrong conclusions. Failures in dissemination, often caused by excessive concern with security, can prevent timely and accurate intelligence to reach the operational personnel who can act on it.

The principles of intelligence have been discussed and developed from the earliest writers on warfare [2] to the most recent on technology [3]. The human mind remains at its core: extracting meaning from a flood of correct, incorrect, and misleading information.

This is the top of a hierarchy of articles which discuss the four major parts of the intelligence cycle: tasking, collection, analysis, and dissemination. Tasking, since it is so intimately associated with the management of the cycle, is the subject of the present article.

"Intelligence" defined

Johnston's ethnographic study of analytic culture[4] established the following "consensus" definitions for intelligence, intelligence analysis, and intelligence errors:

  • Definition 1: Intelligence is secret state or group activity to understand or influence foreign or domestic entities.
  • Definition 2: Intelligence analysis is the application of individual and collective cognitive methods to weigh data and test hypotheses within a secret socio-cultural context.
  • Definition 3: Intelligence errors are factual inaccuracies in analysis resulting from poor or missing data; intelligence failure is systemic organizational surprise resulting from incorrect, missing, discarded, or inadequate hypotheses.

Management of the intelligence cycle

One basic model of the intelligence process is called the intelligence cycle. This model can be applied [5]. Like all basic models, it does not reflect the fullness of real-world operations. Nevertheless, it is worth introducing, then pointing out some of its failures, and then presenting more real-world models. Once reasonable real-world models can be refined, the activities making it up can be discussed. Intelligence is processed information. The activities of the intelligence cycle obtain and assemble information, convert it into intelligence and make it available to its users. The intelligence cycle comprises four phases:

  1. Direction: Deciding what is to be monitored and analyzed
  2. Collection: The obtaining of raw information using a variety of collection disciplines
  3. Processing: Refining and analyzing the information
  4. Dissemination: Providing the results of processing to consumers, including consumers in the intelligence community, including use of intelligence information in net assessment and strategic gaming.

These four phases are the absolute minimum to describe the process of intelligence, but, minimally, several other activities should be considered. Remember that the output of the intelligence cycle, if accepted, drives operations, which, in turn, produce new material to go into another iteration of the intelligence cycle. Consumers should give the intelligence organization broad directions, and the highest level will set budgets.

Intelligence Cycle with Organizational inputs and outputs

Representative Failures in Exercising the Cycle

Any circular cycle is as weak as its weakest component. At one time or another, a national or organizational intelligence process has broken down, thus causing failure in the cycle.

Each of the four main categories has, in different countries and at different times, failed terribly. Policymakers have denied the services direction to work on critical matters. Intelligence services have failed to collect critical information. The services have analyzed data incorrectly. There have been failures to disseminate intelligence quickly enough, or to the right decisionmakers.

There have been failures to protect the intelligence process itself from opposing intelligence services.

A major problem, in several aspects of the enhanced cycle, is stovepiping. In the traditional intelligence use of the term, stovepiping keeps the output of different collection systems separated from one another. This has several negative effects. First, it prevents one discipline from cross-checking another. In World War II, both sides doubled clandestine agents and used them to send disinformation back to their own countries.[6] While the content of the human intelligence (HUMINT) they sent might seem reasonable, direction finding, a discipline of signals intelligence (SIGINT) might have shown they were transmitting from Gestapo or MI5 headquarters. Measurement and signature analysis (MASINT) on the style of their radio procedure could have indicated that an impostor, or perhaps the real agent but under duress, was sending.

Second, a newer usage of stovepiping is bypassing the regular analysis of raw intelligence, and sending only raw intelligence that supports a particular position to the highest national leadership.

Failures in Direction

The highest policy levels of government set, in the broadest sense, intelligence priorities and policies. In some cases, heads of government give quite specific orders, but illegal ones. Others may be more on the level of "Do what you gotta do". Of course, in certain countries, the law is merely what the dictator decrees.

Stalin rejects warning

Stalin received a warning document, in May 1939, about The Future Plans of Aggression by Fascist Germany, based on a German briefing obtained by Soviet spies in Warsaw. A Soviet agent first reported that Hitler planned to declare war on the Soviet Union in March 1941, and refined the estimate, by February 28, to May 20.

This intelligence was corroborated by sources in Bucharest, Budapest, Sofia and Rome, to say nothing of the information provided by the spy Richard Sorge (code-named Ramsay) in Tokyo [7] in which the authors detail the undercover operations of the spy ring headed by Richard Sorge and Hotsumi Ozaki which transmitted highly secret information from Tokyo to the Soviet Union between 1933 and 1941. On April 17 a Prague informant predicted a German invasion in the second half of June. The precise date and time of the invasion were revealed by a reliable source in Berlin fully three days before the Germans attacked.

All of this Stalin ignored. Typically, he scrawled on the bottom of the Prague report: English provocation! Investigate! On May 19, Sorge predicted that 150 divisions were being readied by the Germans for an invasion of the Soviet Union. Stalin retorted with an expletive.

The result was that literally nothing was done to prepare for the German assault, which was code-named Operation Barbarossa. Soviet planes were not camouflaged. Troops were not in defensive positions; indeed they were ordered not to occupy such positions, for fear of provoking the Germans. Worse, Stalin responded to the gathering storm with yet another purge of suspected threats to his own authority.

Political conflict

In democracies with a check-and-balance system, it may be that the legislative branch, or the parliamentary opposition (especially if a government fell over something that might be intelligence-related), will review the role of the government in a failure. In totalitarian systems, there still may be checks and balances, as in the Soviet Union relying on the Party and the Army to check the Organs of State Security.

Unfortunately, especially in the United States, this may be a partisan witch-hunt rather than an unbiased exploration. Some of the investigations of US activities, by independent bipartisan commissions, have tended to be more objective than the legislative committees with the majority party in control.

This is not to suggest that some American congressional reviews have not been fair and objective; some have been quite professional. One example is the Senate Select Committee on Intelligence's investigation if NSA had placed a "back door" into the Data Encryption Standard (DES), a matter of some concern because NSA required that the theory of some parts of the DES algorithm remain classified. [8] Some years later, when DES was essentially obsolete, the actual reason for the classification was revealed. The review simply said there was a reason and it was not a back door. Eventually, it was learned that the reason was that the details of the algorithm revealed a vulnerability to, and countermeasures against, a then-classified technique called differential cryptanalysis. That technique could be used against many targets besides DES.

UK Government and Iraq

"The language of the Butler report was likewise comparatively understated. It avoided the often hectoring and accusatory tone of the Senate Select Committee report on US prewar intelligence on Iraq, stayed away from personalizing blame, and examined the Iraq failure chiefly in terms of the “collective responsibility” ethos of Britain’s ... government and the collegiality of the UK Joint Intelligence Committee (JIC) system... But it also has to be said that intelligence analysis (or assessment, in UK parlance) is generally the least appreciated and least addressed aspect of the intelligence process in the UK. On the one hand, this is because assessment is scholarly rather than sexy; on the other, as has been pointed out in a number of forums elsewhere, assessment is viewed in the UK as a government function and not specifically as an intelligence function.

"The conclusions reached by Butler’s review team were also less hostile than those of the Senate Select Committee. To be sure, they found that a measure of groupthink had been at work— in looking for evidence to corroborate the suspicions that the JIC had insisted on sustaining despite a lack of hard evidence (a long-recognized, inherent risk of the JIC system’s collegial methods) and a tendency to overcompensate for the optimistic assessments of the limits of Iraqi nuclear developments discredited after the first Gulf War.

"[Lord Butler] expressed a number of concerns regarding the effectiveness of the intelligence validation components of the Secret Intelligence Service’s management structure—the “Requirements” side of SIS. One of the factors behind the failure of UK Iraq assessments was the practice of placing “greater weight” upon a number of human intelligence (HUMINT) reports “than they could reasonably bear,”[9]

Observations on UK versus US Oversight

Paul Pillar, National Intelligence Officer for the Middle East between 2000 and 2005, observed "Intelligence affects the nation's interests through its effect on policy. No matter how much the process of intelligence gathering itself is fixed, the changes will do no good if the role of intelligence in the policymaking process is not also addressed.... But a few steps, based on the recognition that the intelligence-policy relationship is indeed broken, could reduce the likelihood that such a breakdown will recur.

"On this point, the United States should emulate the United Kingdom, where discussion of this issue has been more forthright, by declaring once and for all that its intelligence services should not be part of public advocacy of policies still under debate. In the United Kingdom, Prime Minister Tony Blair accepted a commission of inquiry's conclusions that intelligence and policy had been improperly commingled in such exercises as the publication of the "dodgy dossier," the British counterpart to the United States' Iraqi WMD white paper, and that in the future there should be a clear delineation between intelligence and policy. An American declaration should take the form of a congressional resolution and be seconded by a statement from the White House. Although it would not have legal force, such a statement would discourage future administrations from attempting to pull the intelligence community into policy advocacy. It would also give some leverage to intelligence officers in resisting any such future attempts.

"The proper relationship between intelligence gathering and policymaking sharply separates the two functions....Congress, not the administration, asked for the now-infamous October 2002 National Intelligence Estimate (NIE) on Iraq's unconventional weapons programs, although few members of Congress actually read it. (According to several congressional aides responsible for safeguarding the classified material, no more than six senators and only a handful of House members got beyond the five-page executive summary.) As the national intelligence officer for the Middle East, I was in charge of coordinating all of the intelligence community's assessments regarding Iraq; the first request I received from any administration policymaker for any such assessment was not until a year into the war.

"The legislative branch is the appropriate place for monitoring the intelligence-policy relationship. But the oversight should be conducted by a nonpartisan office modeled on the Government Accountability Office (GAO) and the Congressional Budget Office (CBO). Such an office would have a staff, smaller than that of the GAO or the CBO, of officers experienced in intelligence and with the necessary clearances and access to examine questions about both the politicization of classified intelligence work and the public use of intelligence. As with the GAO, this office could conduct inquiries at the request of members of Congress. It would make its results public as much as possible, consistent with security requirements, and it would avoid duplicating the many other functions of intelligence oversight, which would remain the responsibility of the House and Senate intelligence committees." [10]

Failures in Collection

In the WWII UK Double Cross System[6], all German spies in the British Isles were captured, and given a choice between execution and becoming a double agent. The British-controlled double agents were part of a larger strategic deception operation, the principal intention of which was to make the Germans believe that the main Allied invasion would come at some place other than the actual beaches of Normandy.

Only those German reconnaissance aircraft that would pass over appropriately arranged decoys were allowed to complete their missions, and the Allies generated dummy signals corresponding to imaginary units whose organization and position was supportive of the overall deception plans. HUMINT, IMINT, and SIGINT were all collecting plausible data and returning it to the Germans. The Germans were unable to use collection techniques that revealed the real Allied plan.

Due to limited resources, the US and South Koreans did not give a high priority to a potential attack, in 1950, by the North Koreans. COMINT on North Korea was only an incidental by-product of monitoring the Chinese and Soviets. The main attack came as a surprise.

Failures in Analysis

There have been analytical failures, sometimes of imagination and sometimes of interpretation, since the beginning of modern intelligence. Prior to the 1941 Japanese attack on Pearl Harbor, US Navy intelligence did not adequately consider the British air strike against Italian capital ships in Taranto Harbor, but there was an assumption that torpedo nets were not needed at Pearl Harbor. It is not clear if the Pacific Fleet intelligence officers had clear reporting on Taranto, or if they considered it at all. At the time, there were organizational relations we would consider odd today, such as COMINT being in the Office of Naval Communications rather than the Office of Naval Intelligence. Weapons capabilities seemed restricted to the Bureau of Ordnance.

During the war in Vietnam, there were constant analytic disputes among the Military Assistance Command Vietnam, the Office of the Secretary of Defense, and the Central Intelligence Agency[11]. That the intelligence organizations in the military command were more optimistic is unsurprising, and not even indicative of something being seriously wrong -- as long as there are independent intelligence organizations to cross-check.

Even within these organizations, there were disputes. "Skepticism and pessimism about Vietnam were present chiefly among those officers who produced finished intelligence in the form of National Intelligence Estimates and in Intelligence Directorate (then the DDI) publications: that is, analysts in the Office of National Estimates (ONE), the Office of [Economic] Research and Reports, and the South Vietnam Branch of the Office of Current Intelligence (OCI). Such views were generally a bit less evident among officers of the North Vietnam Branch of OCI..."[12]

Another serious problem to be avoided is mindset or "groupthink." Any intelligence agency can fall into the trap of not questioning basic assumptions that affect much subsequent analysis. It is essential that competitive or redundant analysis be encouraged. Currently and historically, less than a tenth of what the United States spends on intelligence is devoted to analysis; it is the least expensive dimension of intelligence. Not all duplication is wasteful[13]. This has been a continuing issue with Bomb damage assessment, going back to the beginnings of aerial bombardment. Even with considerably improved sensors in 1991, it remains a problem, and, as with the Vietnam case, there tended to be increasingly more pessimistic analyses in the theater command, the Department of Defense, and the CIA. It may well be that increasing weapon precision, UAV followup, and even such things as the towed video link following a Tactical Tomahawk into the target, which this is finally coming under control.

Failures in Dissemination

Perhaps the most studied failure of a country to respond to a threat, because the operational commanders did not receive the warning circulating among analysts and policymakers, is the 1941 Japanese attack on Pearl Harbor, Hawaii. It was clear that Japan was preparing to break diplomatic relations, often an immediate prelude to war. Only the last part of the diplomatic dispatch seemed a war warning.

Even though US intelligence literally had the strategic warning in hand before the less skilled Japanese diplomats allowed to handle the dispatch, there were failures in transmitting the warnings to the field. This was due to a combination of factors, including Army-Navy rivalry, a less sophisticated communications system that did not confirm reception by the right commands, and reluctance to micromanage field commanders.

Failures in Acceptance

"What was Josef Stalin thinking when he allied himself with Adolf Hitler for nearly two years at the beginning of World War II? What did Stalin know about Hitler's intentions to turn on him, and when did he know it[14]?". In his book[15], David E. Murphy, former chief of CIA Soviet Operations, makes two points of significance in response to Ferguson[16] The first is the extent to which the Soviet spy network in Europe continued to deliver first-rate intelligence, despite Stalin's best efforts to purge it out of existence. It was not just the British establishment the Soviets managed to penetrate; there were agents in the German economics ministry, air ministry and foreign ministry, not to mention the American Embassy in Moscow.

Germany told the Soviets that their troops were being massed on the Soviet borders to keep them clear of British air raids, that dozens of German planes were violating Soviet airspace merely because their pilots were inexperienced and that talk of a German invasion plan was a cynical British smear designed to provoke a Nazi-Soviet war. [16] It is odd that the Soviets, so adept at maskirovka, were so deceived by deception rather than secrecy.

Failures in Counterintelligence

No intelligence organization is immune to having its personnel subverted. See Counter-intelligence.

Models of Intelligence and Information

The intelligence cycle is only a model. Budgetary and policy direction are hierarchically above it. In reality, it is not a cycle, but a series of parallel activities. "Collection and analysis, which are supposed to work in tandem, in fact work more properly in parallel. Finally, the idea that decision makers wait for the delivery of intelligence before making policy decisions is equally incorrect. In the modern era, policy officials seem to want intelligence to support policy rather than to inform it. The Intelligence Cycle also fails to consider either counter-intelligence or covert action. [17]" The OODA loop developed by John Boyd, discussed in the context of the Intelligence Cycle below, may come somewhat closer, as OODA is action-oriented and spiraling, rather than a continuing circle.

In principle, within the cycle, "intelligence agencies are faced with the task of determining intelligence priorities, a process known as threat assessment. Experts and policymakers gather periodically to evaluate the perils that confront the United States and establish a ladder of priorities from the most dangerous (Tiers 1A and 1B) to the least (Tier 4). Bias and guesswork enter the picture, along with the limitations caused by the uncertainty that surrounds the future. Where should one place China in the threat assessment? What about Russia, or Cuba? The outcome of these debates shapes the priorities for some $44 billion worth of intelligence spending each year. It also determines the areas U.S. spies will [try to] infiltrate, sets the orbits for surveillance satellites, and establishes the flight patterns of reconnaissance aircraft. To improve the threat assessment process, the United States has undertaken nine major inquiries into its intelligence apparatus since the end of the Cold War. Each has found a failure to clearly delineate priorities [18].

National/Strategic

"Establishing the intelligence requirements of the policy makers...is management of the entire intelligence cycle, from identifying the need for data to delivering an intelligence product to a consumer. It is the beginning and the end of the cycle--the beginning because it involves drawing up specific collection requirements and the end because finished intelligence, which supports policy decisions, generates new requirements.

"The whole process depends on guidance from public officials. Policymakers-- the President, his aides, the National Security Council, and other major departments and agencies of government--initiate requests for intelligence. Issue coordinators interact with these public officials to establish their core concerns and related information requirements. These needs are then used to guide collection strategies and the production of appropriate intelligence products[19]".

Military/operational

Intelligence requirements are determined by the commander to support his operational needs. The commander's requirement (sometimes called Essential Elements of Intelligence (EEIs)) initiates the Intelligence cycle. Operational and tactical intelligence always should help the commander select an action.

Each intelligence source has different characteristics which can be used but which may also be limiting. IMINT, for instance, may depend on weather, satellite orbits or the ability of aircraft to elude ground defenses, and time for analysis. Other sources may take considerable time to collect the necessary information. MASINT depends on having built a library of signatures of normal sensor readings, such that deviations stand out.

In rare cases, intelligence is taken from such extremely sensitive sources that it cannot be used without exposing the methods or persons providing such intelligence. One of the strengths of the British penetration of the German Enigma cryptosystem was that no information learned from it was ever used for operations, unless there was a plausible cover story that the Germans believed was the reason for Allied victories. If, for example, the movement of a ship was learned through Enigma COMINT, a reconnaissance aircraft was sent into the same area, and allowed to be seen by the Axis, so they thought the resulting sinking was due to IMINT.

CCIRM

The Collection Coordination Intelligence Requirements Management (CCIRM) system is the NATO doctrine for intelligence collection management, although it differs from US doctrine[20]. From the US perspective, CCIRM manages requests for information (RFI) rather than the collection itself, which caused some friction when working with US collection assets. Within NATO, requests for information flowed through the chain of command to the CCIRM manager. Where the US sees collection management as a "push" or proactive process, NATO sees this as "pull" or reactive.

CCIRM takes information requests and routes them to collection elements

In NATO doctrine, CCIRM joins and intelligence analysis (including fusion) to provide intelligence services to the force commander. Senior NATO commanders receive intelligence information in the form of briefings, summaries, reports and other intelligence estimates. Combat commanders receive more specific documents, entitled [[Intelligence Preparation of the Battlespace (IPB). While these reports and briefings convey critical information, they lack the full context in which the intelligence cell assembled them. In coalition warfare, not all sources may be identified outside that cell. Even though the material presented gives key information and recommendations, and assumptions for these interpretations are given, the context

...not in a strong evidential sense, pointing exactly to the specific intelligence information that justifies these interpretations. As a result, it is not always easy for the commander to determine whether a particular interpretation has been compromised by new intelligence information, without constant interaction with the intelligence analysts. Conversely, security constraints may prevent the analyst from explaining exactly why a particular command decision might compromise existing intelligence gathering operations. As a result, most of the detailed intelligence analyses, including alternative hypotheses and interpretations, remain in the heads of intelligence officers who rely on individual communication skills to present their brief and keep the commander informed when the situation changes.[21]

Experience in Bosnia and Kosovo demonstrated strain between CCIRM and US procedures, although the organizations learned by experience. Operation Joint Endeavor, began in 1995, with Operation Deliberate Force going to a much higher level of combat. Operation Allied Force, a more intense combat situation in Kosovo, began on 24 March 1999.

Intelligence Friction in Bosnia

Things worked better in Bosnia than Kosovo. "The majority of intelligence that the United States produced was tailored, timely, and releasable to IFOR. The U.S. intelligence community consistently disseminated actionable intelligence without divulging sensitive sources and methods." [20] The early phases were more typical of peace operations, and an efficient liaison system worked well.

Perhaps a major reason for Bosnian success was deployment of adequate intelligence management organizations. When NATO interoperability and security restrictions became a problem, national component capabilities often worked around the difficulties. Two U.S. theater-level analysis centers supported the U.S. and NATO requests for information. The U.S. Army, Europe Combat Intelligence Readiness Facility (UCIRF) in Germany, had all-source capability and a sensitive compartmented information facility|Sensitive Compartmented Information Facility (SCIF), while the United States European Command (USEUCOM) Joint Analysis Center (JAC) in England, integrated imagery and other intelligence and inserted releasable information into the coalition-wide system. [20]

A wide range of technological intelligence systems were used, from NATO, UK, French and German and US organizations. Manned aerial sensors, including the U-2 Dragon Lady, P-3 Orions, E-8 Joint STARS, RC-135 RIVET JOINT, and the NATO E-3 Sentrys (and to a lesser extent the U.S. E-2Cs). These systems could respond to changing conditions by modifying their mission while in flight. These systems had one disadvantage in that they put personnel at risk so the standoff requirements tended to limit the depth of the sensor capabilities.

The unmanned aerial vehicles (UAVs) did not put personnel at risk, provided reduced detection (smaller cross-section), and supplied a broad range of collection technologies (SIGINT, ELINT, Electro-optical MASINT, Electro-optical infrared, and live video). Their greatest limitation was their lack of flexibility; they either needed to be pre-programmed or controlled by personnel within line of sight.

French and British HUMINT was strong, along with US Special Operations Forces. OSINT (open source intelligence) provided indications and warning of increased tensions in local areas, supported predictive analysis efforts, and helped focus and queue other collection efforts. MASINT (Measurement and Signature Intelligence) was used to support treaty compliance, early warning, and force protection. Dissemination of OSINT material helped establish common understandings.

Intelligence Friction in Kosovo

In the Kosovo operation, a relatively small Battlefield Coordination Detachment, intended to be part of a larger organization including all-source air and ground intelligence cells, was split from a Combined Air Operations Center in Macedonia, and dispatched with an ad hoc unit,

In Kosovo, a US Battlefield Coordination Element (BCE) is an Echelons above Corps organization now called a battlefield coordination detachment (BCD)...The BCE was already deployed with a combined air operations center (CAOC) ... in support of Task Force (TF) Able Sentry in the Republic of Macedonia. The BCD was the only intelligence augmentation to TF Hawk, a U.S. V Corps contingency force consisting of attack aviation, a multiple-launch rocket system (MLRS) battalion...and maneuver forces. [22]"

Under US doctrine for a combined task force (CTF) operation, "the air component (ACC) and land component (LCC) headquarters work hand-in-hand. The LCC has the intelligence support structure needed to develop the enemy ground order of battle, identify enemy vulnerabilities and offer possible courses of action. The ground commander pushes the intelligence to the [Combined Forces] CFACC through the BCE intelligence section, providing clarity of the enemy ground situation. The LCC drives the focus for collecting, tracking, targeting and attacking enemy ground forces. In this operation, it was a problem that the CAOC did not have the ground intelligence structure to perform detailed Intelligence Preparation of the Battlespace (IPB) and relied on the analyzed intelligence relayed through the BCE from the LCC’s organic intelligence element.

Because TF Hawk's BCD was the only all-source US intelligence unit in the operation, it was unable to provide the services that it could have if in the larger intelligence center for which it was intended. Not only was there no all-source US ground intelligence, but the TF Hawk Ground Analysis Cell (ACE)...controlled who could access specific pieces of information within US-Only channels. The coalition Ground Analysis Cell could not use US-only data, depriving the coalition commander of a common enemy ground picture. Not only specialized data could not be shared, the doctrine did not support the use of the Hunter UAV.

UAVs have tremendous potential in combat, but before TF Hawk gained control of the Hunter, all US and NATO UAVs and drones were run by the National Collection Management Cell (NCMC), with full IMINT access. Using CCIRM, it deconflicted US theater, national and NATO targets. Thus [national-level] process ensured efficient, non-redundant coverage and maximum support available for theater collection. One of the lessons learned was the need for what became called "Direct TV for war", the Global Broadcast Service.

When TF Hawk gained control of the MQ-5 Hunter UAV, the Hunter sorties were no longer synchronized with the NATO and US-only surveillance and deconfliction systems. This both prevented continuous coverage of key targets, but also led to circumstances where a target, identified by Hunter, could not be attacked because the UAV that found the target was on a different schedule than were strike resources.

UAV resources need to be controlled at a level that permits deconfliction and synchronization. The controlling headquarters certainly should be responsive to the needs of the tactical commander, but there are control issues that should not be of concern at the tactical level.

Boyd OODA Loop

John Boyd created a model of decision and action, originally for air-to-air fighter combat, but which has proven useful in many areas of conflict. His model has four phases, which, while not usually stated in terms of the intelligence cycle, do relate to that cycle:

  1. Observe: become aware of a threat or opportunity
  2. Orient: put the observation into the context of other information
  3. Decide: make the best possible action plan that can be carried out in a timely manner
  4. Act: carry out the plan.

After the action, the actor observes again, to see the effects of the action. If the cycle works properly, the actor has initiative, and can orient, decide, and act even faster in the second and subsequent iterations of the Boyd loop.

Interactions between commanders and the Boyd loop

Eventually, if the Boyd process works as intended, the actor will "get inside the opponent's loop". When the actor's Boyd cycle dominates the opponent's, the actor is acting repeatedly, based on reasoned choices, while the opponent is still trying to understand what is happening.

While Boyd treated his cycle as self-contained, it is reasonable to extend it to meeting the intelligence cycle. Observation can be an output of the collection phase, while orientation is an output of analysis.

Interactions between the intelligence cycle and the Boyd loop

Eventually, actions taken, and their results, affect the senior commanders. From the commanders, rather than the intelligence side, come guidelines on the preferred decisions and actions.

Interactions between commanders and the Boyd loop

Tasking and Direction

At the highest level of direction, rational policies, the effects of personalities, and culture can dominate the assignments given to the intelligence services.

Policy Factors

Western governments tend to have, at best, creative tension among their law enforcement and national security organizations, foreign-oriented versus domestic-oriented organizations, and public versus private interests. There is usually a conflict between clandestine intelligence and covert action, which may compete for resources in the same organization.

Balancing Law Enforcement and National Security

The first opposition is law enforcement versus intelligence. The two are very different worlds. Intelligence is oriented toward the future and seeks to inform policy makers. It lives in a blizzard of uncertainty where the "truth" will never be known for certain. Because intelligence strives above all to protect its sources and methods, intelligence officials want desperately to stay out of the chain of evidence so they will never have to testify in court. By contrast, law enforcement is not interested in policy. Rather, its business is the prosecution of cases. And law enforcement knows that if it is to make a case, it must be prepared to reveal something of how it knows what it knows.

The Council on Foreign Relations[13] recommended that "foreign policy ought to take precedence over law enforcement when it comes to overseas operations. The bulk of U.S. intelligence efforts overseas are devoted to traditional national security concerns; as a result, law enforcement must ordinarily be a secondary concern. FBI and DEA agents operating abroad should not be allowed to act independently of either the ambassador or the CIA lest pursuit of evidence or individuals for prosecution cause major foreign policy problems or complicate ongoing intelligence and diplomatic activities. (The same should hold for any Defense Department personnel involved in intelligence activity overseas.) There are likely to be exceptions, and a degree of case-by-case decision-making will be inevitable. What is needed most is a Washington-based interagency mechanism involving officials from intelligence, law enforcement, and foreign policy to sort out individual cases. One now exists; the challenge is to make it work.

"At home, law enforcement should have priority and the intelligence community should continue to face restraints in what it can do vis-à-vis American citizens." The protection of civil liberties remains essential. National organizations intended for foreign operations, or military support, should operate within the home country only under specific authorization and when there is no other way to achieve the desired result. ... Regardless, the ability of intelligence agencies to give law enforcement incidentally acquired information on U.S. citizens at home or overseas ought to be continued. There should be no prohibition (other than those based on policy) on the intelligence community collecting information against foreign persons or entities. The question of what to do with the information, however, should be put before policymakers if it raises foreign policy concerns. [13]

President Harry Truman had legitimate concerns about creating a "Gestapo", so insisted that the new CIA not have law enforcement or domestic authority. In an era of transnational terrorism and organized crime, there may not be clean distinctions between domestic and foreign activities [23].

Public versus Private

"During the Cold War, national security was a federal government monopoly. To be sure, private citizens and corporations were involved, but there was a neat correspondence between the threat as defined and the federal government's national security machinery that was developed to meet that threat. The war against terrorism and homeland security will be much less a federal government monopoly. Citizens of democracies and the economy are already suffering the inconvenience and higher business costs of much tighter security. And tragically, more ordinary citizens are likely to die from transnational terrorism." [23]

Public and private interests can both complement and conflict when it comes to economic intelligence. Multination corporations usually have capable intelligence capabilities in their core business, although they may not call them such. Lloyds of London has superb knowledge of maritime affairs. Oil companies have extensive information on world resources and energy demands. Investment banks can track capital flow.

This becomes especially difficult when private organizations seek to use national capabilities for their private benefit. Sometimes, a quid pro quo may be involved. Collection of secret economic information can be by several means-mostly SIGINT and HUMINT. The more sensitive reconnaissance satellites may not be needed to get substantially correct imagery; earth resources satellites may give adequate, or even better detail -- reconnaissance satellites tend not to have the multispectral scanners that are best for agricultural or other economic information.

The private sector may already have good information on trade policy, resources, foreign exchange, and other economic factors. This may not be "open source" in the sense of being published, but can be bought, reliably, from research firms that need not have the overhead of all-source security. The intelligence agencies can use their all-source capability for verification rather than original collection. Intelligence agencies, working with national economic and diplomatic employees, can develop policy alternatives for negotiators.

One subtle aspect of the role of economic intelligence is the interdependence of the continental and world economies. The economic health of Mexico clearly affects the United States, just as the Turkish economy is of concern to the European Community. In a post-cold-war environment, the roles of Russia and China are still evolving. Japan, with a history of blurred lines between industry and government, may regard a policy, perfectly ethical for them, which would be questionable in North America or Eastern Europe. New groupings such as the Shanghai Cooperative Organization are principally economic. Economic measures also may be used to pressure specific countries, as, for example, South Africa while it sustained a policy of apartheid, or Sudan while there is widespread persecution in Darfur.

Clandestine Intelligence versus Covert Action

Clandestine and covert operations share many attributes, but also have distinct differences. They may share, for example, a technical capability for cover and forgery, and need secret logistical support. The essence of covert action is that its sponsor cannot be proven. One term of art is that the sponsor has "plausible deniability." In some cases, such as sabotage, the target indeed may not be aware of the action. Assassinations, however, are immediately known, but, if the assassin escapes or is killed in the action, the sponsor may never be known other than to the sponsor. [24] for one policy review.

Coordination of HUMINT and Covert Action
See also: Clandestine HUMINT and Covert Action

Experience has shown that some high level of government needs to be aware of both clandestine and covert field activities, to prevent them interfering with one another, and with secret activities that may not be in the field. For example, one WWII failure took place when Office of Strategic Services (OSS) field agents broke into the Japanese Embassy in Lisbon, and stole cryptographic materials. Of course, this allowed past communications to be read. The net effect of this operation was disastrous, as the particular cryptosystem had been broken by cryptanalysis, who were reading the traffic in parallel with the intended recipients. The covert burglary -- the Japanese did not catch the OSS team, so were not certain who did it -- caused the Japanese to change cryptosystems, invalidating the clandestine work of the cryptanalysts[25].

Even in democracies, HUMINT resources have been abused. In the case of the US, these have involved such things as Iran-Contra and support to the "plumbers unit" of the Nixon campaign and administration, as well as infiltrating legal groups using a justification of force protection. British actions in Northern Ireland, and against terror groups in Gibraltar and elsewhere, have been criticized, as have French actions against Greenpeace. "...Contrary to widespread impressions, one problem with the clandestine services has been a lack of initiative brought about by a fear of retroactive discipline and a lack of high-level support. " [13] "In the aftermath of the Vietnam War, the public and its representatives convinced themselves that the intelligence services were somehow the enemies of the American people."[26]; the clandestine services become increasingly risk-averse. This difficulty of these issues were recently emphasized with by Barack Obama's saying that line intelligence collectors would be defended if using questionable interrogation methods authorized by their management.

Common Risks and Resources

Clandestine collection entails many more risks than the technical collection disciplines. Therefore, how and when it is used must be highly selective, responding to carefully screened and highest priority requirements...It cannot be kept "on the shelf" and called out whenever needed. There must be some minimal ongoing capability that can be expanded in response to consumer needs. This has become increasingly difficult for clandestine services, as diplomats, in response to budget pressures, has reduced its presence that could provide official cover.

The House Committee on Intelligence, in 1996, [27] recommended a single Clandestine Service (CS) should include those components of the Defense HUMINT Service (DHS) that undertake clandestine collection as well. The congressional concern about strategic military HUMINT, however, may not apply to military special operations forces or to force protection. "This is not meant to preclude the Service Intelligence Chiefs from carrying out those clandestine collection activities specifically related to the tactical needs of their Military Departmental customers or field commanders.

Clandestine HUMINT and covert action involve the only part of governments that are required, on a routine basis, to break foreign laws. "As several former DCIs have pointed out, the clandestine services are also the DCI's most important "action arm," not only running covert action programs at the direction of the President (a function whose utility we believe will continue to be important), but also in managing most the IC's liaison with foreign government leaders and security services. The House Intelligence Committee's Community 21 study suggested analysis should be separate from both covert action and clandestine HUMINT, or other clandestine collection that breaks foreign laws. HUMINT is and should be part of a larger IC-wide collection plan.

Political Misuse

Nowhere has political abuse of intelligence services been greater than in totalitarian states, where the use of what the Soviets called the "Organs of State Security" would take on tasks far outside any intelligence mission [28].

"The danger of politicization-the potential for the intelligence community to distort information or judgment in order to please political authorities-is real. Moreover, the danger can never be eliminated if intelligence analysts are involved, as they must be, in the policy process. The challenge is to develop reasonable safeguards while permitting intelligence producers and policymaking consumers to interact. [13]

Prioritization

Upper managers may order the collection department to focus on specific targets, and, on a longer term basis, especially for the technical collection disciplines, may prioritize the means of collection through budgeting resources for one discipline versus another, and, within a discipline, one system rather than another. Collection is not the only thing that must be prioritized; the analysts need to know where to start in what is often a flood of information.

Specialized intelligence collection methods need to be reserved for information not available through open means. It is not an accident that in most intelligence and operations watch centers, a television set is always tuned to the Cable News Network. While initial news reports may be fragmentary, this particular part of OSINT is a powerful part of warning, but not necessarily of detailed analyses.

"Collection priorities must not only be those subjects that are policy-relevant but also involve information that the intelligence community can best (or uniquely) ascertain."[13]

One other aspect of analysis merits mention, namely, the balance between current intelligence and long-term estimates. For years the culture of the intelligence community, in particular that of the CIA, favored the latter. But it is precisely in long- term analysis of familiar subjects and broad trends where secret information tends to be less critical and government analysts are for the most part no better and often not as good as their counterparts in academia and the private sector. Also, many estimates are likely to be less relevant to busy policymakers, who must focus on the immediate.

To the extent long-term estimates are produced, they ought to be concise, written by individuals, and sources justifying conclusions ought to be shown as they would in any academic work. If the project is a group effort, differences among participants ought to be sharpened and prominently acknowledged. While it is valuable to point out consensus, it is more important that areas of dispute and uncertainty be made clear, than it is to reach a lowest common denominator.

Budgeting

While each nation has its own budgeting process, the major divisions of the US process are representative:

  • National intelligence, often excluding specifically national-level military intelligence,
  • National-level military intelligence
  • Military tactical intelligence
  • Transnational intelligence, often involving law enforcement, for terrorism and organized crime
  • Internal counterintelligence and counterterrorism.

Again depending on the nation, at some level of detail, budgetary information will be classified, as changes in budget indicate changes in priorities. After considerable debate, the US now publishes total budgets for the combination of its intelligence agencies. Depending on the sensitivity of a line item, it may be identified simply as "classified activity", not broken out but briefed to full oversight committees, or only revealed to a small number of officials.

"It should be possible to empower a committee composed of mid-level officials (or aides to senior officials) from the intelligence and policymaking communities to convene regularly to determine and revise priorities. The key is to try to get policymakers to provide guidance for both collection and analysis, to communicate not just what they want but also what they do not.

The CFR proposed a "market constraint" on consumers, in which they could only get a certain amount of intelligence from the intelligence community, before they had to provide additional funding. A different constraint would be that an agency, to get information on a new topic, must agree to stop or reduce coverage on something currently being monitored for it. Even with this consumer-oriented model, the intelligence community itself needs to have a certain amount of resources that it can direct itself, for building basic intelligence and identifying unusual threats.

Especially in nations with advanced technical sensors, there is an interaction between budgeting and technology. For example, the US has tended, in recent years, to use billion-dollar SIGINT satellites, where France has used "swarms" of "microsatellites". The quantity versus quality battle is as evident in intelligence technology as in weapons systems. The US has also fought a stovepipe battle, in which SIGINT and IMINT satellites, in a given orbit, were launched by different agencies. New plans put SIGINT, MASINT, and IMINT sensors, appropriate to a type of orbit, on common platforms.

References

  1. Borning, Alan (2001), Computer System Reliability and Nuclear War, in Martin E. Hellman, Breakthrough: Emerging New Thinking, Soviet and Western Scholars Issue a Challenge to Build a World Beyond War, Foundation for Global Community
  2. Sun Tzu (1963), The Art of War, Oxford University Press
  3. Richelson, Jeffrey T. (2001). The Wizards of Langley: Inside the CIA's Directorate of Science and Technology. 
  4. Johnston, Rob (2005). Analytic Culture in the US Intelligence Community: An Ethnographic Study. Center for the Study of Intelligence, Central Intelligence Agency. Retrieved on 2007-10-29.
  5. US Department of Defense (12 July 2007). Joint Publication 1-02 Department of Defense Dictionary of Military and Associated Terms. Retrieved on 2007-10-01.
  6. 6.0 6.1 Masterman, J. C. (1972). The Double-Cross System in the War of 1939–1945. Yale University Press.  Cite error: Invalid <ref> tag; name "Masterman1972" defined multiple times with different content
  7. Gordon Prange (1984). Target Tokyo: The Story of the Sorge Spy Ring. McGraw-Hill. 
  8. Davies, D.W.; W.L. Price (1989). Security for computer networks, 2nd ed.. John Wiley & Sons. 
  9. Davies, Philip H. J. (2005), "A Critical Look at Britain’s Spy Machinery: Collection and Analysis on Iraq", Studies in Intelligence. Retrieved on 2007-10-23
  10. Pillar, Paul R. (March/April 2006), "Intelligence, Policy,and the War in Iraq", Foreign Affairs. Retrieved on 2007-10-30
  11. Adams, Sam (1994). War of Numbers: An Intelligence Memoir. ISBN 188364223X. 
  12. Ford, Harold P. (1997), "Why CIA Analysts Were So Doubtful About Vietnam: Unpopular Pessimism", Studies in Intelligence. Retrieved on 2007-10-25
  13. 13.0 13.1 13.2 13.3 13.4 13.5 Council on Foreign Relations. Making Intelligence Smarter: The Future of US Intelligence. Retrieved on 2007-10-21.
  14. Nagorski, Andrew (06/27/2005), "Stalin's Blindness: He deceived himself about Hitler, and it cost millions of Russian lives.", Weekly Standard. Retrieved on 2007-10-26
  15. Murphy, David E. (2005). What Stalin Knew: The Enigma of Barbarossa. Yale University Press. ISBN 0300107803. 
  16. 16.0 16.1 Ferguson, Niall (June 12, 2005), "Stalin's Intelligence", New York Times. Retrieved on 2007-10-23 Cite error: Invalid <ref> tag; name "Ferguson" defined multiple times with different content
  17. Hulnick, Arthur S. (6 December 2006), "What's wrong with the Intelligence Cycle (abstract)", Intelligence & National Security 21 (6): 959-979
  18. Johnson, Loch K. (Winter-Spring 2006), "A Framework for Strengthening US Intelligence", Yale Journal of International Affairs
  19. US Intelligence Board (2007). Planning and Direction. Retrieved on 2007-10-22.
  20. 20.0 20.1 20.2 Wentz, Larry. Lessons From Bosnia: The IFOR Experience, IV. Intelligence Operations. Retrieved on 2007-10-26.
  21. Desimone, Roberto, Towards an Ontology for Intelligence Analysis and Collection Management. Retrieved on 2007-10-26
  22. "Lessons Learned from Operation Allied Force in Kosovo", Field Artillery, January-February 2000. Retrieved on 2007-10-26
  23. 23.0 23.1 Treverton, Gregory F. (July 2003), "Reshaping Intelligence to Share with "Ourselves"", Canadian Security Intelligence Service. Retrieved on 2007-10-23
  24. Congressional Research Service (December 6, 2006). Special Operations Forces (SOF) and CIA Paramilitary Operations: Issues for Congress.
  25. Kahn, David (1996). The Codebreakers - The Story of Secret Writing. Scribners. ISBN 0684831309. 
  26. W. Patrick Lang
  27. Staff Study, Select Committee on Intelligence, House of Representatives, One Hundred Fourth Congress (1996). IC21: The Intelligence Community in the 21st Century. Retrieved on 2007-10-26.
  28. Sudoplatov, Pavel; Anatoli Sudoplatov, Jerrold L. Schecter, Leona P. Schecter (1994). Special Tasks: The Memoirs of an Unwanted Witness—A Soviet Spymaster. Little, Brown and Company.