Designing the Right Approach

Table of Contents

Key Decisions
What is the Issue(s)?
Who is the Audience(s)?
Consultation versus Collaboration
Setting Objectives
Degree of Interactivity
Choosing the Right Channel(s)
Concept Development Approach
Managing Identity Issues
Desirability of Identification
Technical Aspects of Identification

While the great advantage of eEngagement is the wide array of approaches that can be applied to resolving policy and participation issues, the disadvantage of this flexibility lies in the difficulty of determining an appropriate approach at the outset of project initiation.

Technologies like the World Wide Web draw their power from the vast array of applications to which the basic technology can be applied. However, the very strength of this technology can lead to ‘option paralysis’. In such cases, determining an appropriate model or program design from the existing case examples, or choosing from the vast array of potential and hypothetical applications that are still being developed, can be extremely complex.

One of the problems associated with eEngagement activities to date has been the tendency to emulate a limited number of options, rather than engage in broader experimentation and refinement. In particular, electronic discussion forums have been among the more popular eEngagement approaches.

It is possible here to recognise a limitation associated with ‘unreflective’ policy transfer and ‘lesson-drawing’ across jurisdictions. The important thing to consider when examining successful case examples from different cultures, jurisdictions, or policy areas is that:

The basic design of an eEngagement approach will be highly influential in determining the success or failure of the final process. Maintaining commitment and support for eEngagement initiatives over time – particularly among key decision-makers – requires careful consideration of the following essential matters:

Key Decisions

During the initiation phase of project proposal planning it is important to consider the following six questions:

  1. What is the issue(s)?
  2. Who are the audience(s)?
  3. Consultation versus collaboration?
  4. What objectives do we have for this activity?
  5. How interactive will this process be?
  6. Which is the right channel (communications technology) to use?

In a normative sense, the ability to define and answer these six questions will define the minimum requirements for project approval within the authorising environment. In addition, the appropriate articulation of answers to these questions (and consideration of any complexity, or contradictions, presented by the answers) will provide a solid foundation for the development of an effective implementation plan.

What is the Issue(s)?

The introduction of any engagement practice (on- or offline) will be predicated on the clear articulation of any information deficit(s) within the organisation, or government, as a whole. However, this is not always the case, even though it is essential to any consideration of the shape and nature of the issue, or issues, under consideration and will be instructive in shaping an appropriate eEngagement strategy.

Three examples of areas requiring careful consideration[1] of the policy issue under review include:

  • where the introduction of eEngagement is being specifically undertaken because of limited public participation in the work of an organisation generally. In this example, it will be important for the project team to ascertain the range of policy questions that will form the subject matter for ongoing consultative processes. A good example of this is the introduction of centralised institutional online consultation tools (where the objective is to establish an ongoing online community or reference group for the organisation), with the expectation that a series of policy issues will be fed through this mechanism on an ongoing or regular basis; or
  • where the particular policy issue under consideration has been handed to the agency by a superordinate body and the agency has been tasked with the process of implementing a consultation process, but has limited control over the capacity to define the issue under review. In this example, the implementing agency may conclude that the issue has greater levels of complexity than the scope of the brief. In such cases, if the agency is unable to receive authorisation for an adjustment to the issue definition provided, (which may be the result of a Parliamentary reference, stem from a electoral commitment or reflect party policy, or due to the proclivities of an individual manager or Minister), the inherent limitations of the issue definition will have to be countered by careful consultative design. A classic example of this problem is where superficial phenomena are specified for consultation, but the agency has been forbidden to examine deeper causal, or contributing, factors due to political sensitivities; or
  • where the nature of the issue itself will – to greater or lesser degree – determine the form taken by the consultation process. Examples include:
    • where the particular area of public policy has been captured by a small ‘insider’ group and there is explicit recognition that participation needs to be broadened through a mechanism which limits the capacity of one organisation to dominate the participatory process;
    • where the policy area has been subject to considerable disputation leading to the development of a polarised set of stakeholders and there is a desire to reconcile these tensions;
    • where the Executive has specified a particular outcome for the process, such as clearly articulated organisational mission statements, community-designed performance targets, or a single jointly-authored final report; or
    • where there are low levels of public understanding of the issue, its nature and/or causal factors and the participatory process necessitates a period of community education prior to data collection or deliberation.

Who is the Audience(s)?

The nature of a policy issue will define the audience or audiences for any engagement activity. A clear understanding of the policy issue can assist in the indentification of a target group and assist understanding of the characteristics of the target audience, leading to:

  • a clear understanding of the likely expectations of the target audience in the participatory process;
  • their level of understanding of the policy issue;
  • appreciation of the issue background, including areas of tension and conflict which need to be presented in context and possibly with care and attention to partisan sensibilities;
  • an appropriate approach to message development, possibly requiring direct contribution from competing stakeholders;
  • some indication of preferred communications channels to reach the audience(s); and
  • likely responses to different models of consultation.

In many circumstances, this will simply require an appropriate period of reflection about the characteristics of groups with whom the agency has had interactions in the past, while some consultative activities may require that specific market research be undertaken to develop an appropriate classification (‘market segmentation’ approach).

Key questions to consider are:

  • is there a single community that can be defined as having internal coherence (e.g. members of the group consider themselves to represent a community)?
    • if so, what are the characteristics of this community?
    • if not, how will the various types of stakeholder groups be classified?
  • are there particular members of the community or stakeholders who could be identified as ‘opinion leaders’ or ‘influentials’? [2]
    • if so, what role will these individuals play in the consultative process (do they expect to play a positive or negative role, can they speak for wider sections of their community, will they be included or excluded at all)?
  • is there a single unit of analysis with regard to stakeholders to be consulted (individuals, family groups, interest groups, businesses, etc.)
  • is there a latent group, [3] or groups, who may be affected by the policy issue, or potential policy responses, which will be incorporated in the consultative process?
    • if so, what are the characteristics of this group and how can this audience be recruited into the eEngagement process given their latent status?
    • at what point will this group or groups be brought into the process (for example, if the policy issue only becomes relevant to them in the event that a specific policy recommendation emerges)?

Exhibit 15: Recognising Different Audience Types in an Extensive Online Engagement Activity

In undertaking a wide-scale online consultation over the development of the new European Union Constitution, the project management team was careful to identify two types of audience:

  • individual members of the public participating in referenda, at the national level, to adopt or reject the final draft; and
  • interest groups and other organisations that have a stake in the development of the European Community. These included business organisations, non-profit groups, parties and ad hoc associations.

The resulting system developed to undertake the online consultation process, Europa, included two parallel consultation processes, one for individuals and the other for organisations.

Consultation versus Collaboration

One aspect of citizen engagement activities that is of particular interest is the capacity for participation activities to go beyond pure consultation (data gathering and collection) to the empowerment of stakeholders and service recipients, thereby giving effect to greater, or lesser, control over the decision-making process. This is often characterised as a conceptual continuum between pure data gathering activities (consultative) and the complete devolution of authority to local communities (direct decision-making).

The desire for greater public control over the process is often predicated on a belief that this can result in either: (a) better decision outcomes; or (b) greater acceptance of outcomes achieved (‘ownership’). This belief, which will be tested as part of the project preparation phase, reflects a recognition of alternative sources of expertise (local knowledge, ‘folk’ wisdom and experiential learning) over classical forms of expertise prized by policy analysts (theory-based knowledge, often entrenched within a scientific mode of inquiry).

This view is often articulated in conceptual models, such as the example provided in Figure 5, the articulation of a linear model starting with complete government control over the process of consultation and data gathering and builds towards complete devolution. As one moves down the spectrum, greater levels of community participation and decision-making are introduced.

Figure 5: The ‘Consultation Continuum’[a]

← Increasing Participation

Consultation

Exclusive government decision-making, little consultation

Control Mode

Listening, dialogue, limited consultation, no impact on decisions

Briefing Mode

More open debate, shared analysis of problems, scope to influence decision-making

Debate Mode

Joint agreement on solutions, strong potential to influence decision-making

Consensus Mode

Joint decision-making with regards to implementation and policy

Coordination Mode

Partnerships

Participation in design and delivery of programs and services

Operational Partnership

Shared decision-making in policy development and program / service design and delivery

Collaborative Partnership

Devolution

Transfer of responsibility for program / service design and delivery

Devolution

a Sourced from Clarkson, Beverley and Rigon, Joanne 1998, Consultation Practices: Departmental Overview, Department of Indian Affairs and Northern Development, Ottawa.

Implications of the Continuum

While this (and similar) ‘consultation continuum’ models[4] (see Appendix A: Policy Cycle Engagement Model) are valuable in allowing public sector managers to consider engagement processes that include greater control by participants over outcomes, this conceptualisation can be criticised for implying a normative progression from consultative processes, through to collaborative approaches, to direct decision-making by members of the consultative group.

In addition, while these models are useful in that they introduce the notion of direct and deliberative democracy to public consultative processes, (long overlooked and excluded from agency planning), it needs to be recognised that the movement from consultation to devolution, or local decision-making, involves both:

  • a radical shift from traditional approaches to public engagement. The nature of the issue and audience, combined with the expectations of senior decision-makers, will be significant in determining the degree to which the engagement process is consultative or collaborative in character; and
  • very different approaches to the management of the activity. As per the discussion in section 2.3, Three Management Approaches, the role of the delivery agency, as one moves from consultation to participation, progresses from a steering, to a cultivating and listening approach.

Often, the implication is that, as one progresses towards more participatory approaches, the level of ‘democracy’ increases. However, this can be problematic if the engagement process is not representative, or where deliberative processes have the capacity to move significant sectors of the wider community to a new policy position that differs signifcantly from 'popular opinion'.

Reconceptualising Consultation and Collaboration

The ‘consultation continuum’ is also limited by its single axis of analysis. The degree to which participants can be active in making decisions regarding the consultative process needs to be considered when making choices about consultation versus collaboration.

Figure 6,[5] sets out a two axis model. The first axis takes account of the continuum illustrated in Figure 5, while the second introduces the notion of control over the interactive environment (the process by which the consultative or deliberative activity will occur).

Figure 6: Consultation and Collaboration
Figure 6: Consultation and Collaboration

Using this approach it is possible to envisage an engagement process that focuses on a range of consultation and collaboration aspects. This allows control, even when a key decision-maker or agency may be cautious about including significant decision-making capacity within the consultation process. In this case, the desire for community control can be incorporated through providing flexibility to participants to determine the structure and processes of the consultative environment. The advantages and limitations of this approach are illustrated in Figure 7. What must be remembered is that the selection of collaborative over consultative approaches marks a departure from common practice and will normally require significant justification or motivation (commonly either a response to ongoing policy failure on the part of government, or the need for a ‘clean slate’ over contested issues).

Figure 7: Comparative Benefits of Consultation versus Collaboration
Figure 7: Comparative Benefits of Consultation versus Collaboration

In making the final selection of a preferred approach, it is important to consider:

  • the benefits of delegation versus consultation, as per Figure 7;
  • the willingness of Executive, or elected, decision-makers to delegate and maintain commitment to delegated outcomes, particularly on politically-contentious or difficult outcomes. This aspect of the choice of deliberative and collaborative approaches is particularly critical, as the failure to act on decisions made in collaborative processes can be particularly toxic to public trust in government;
  • the effectiveness of the selected approach in shifting the level of the policy debate (tone, types of participants), versus other means to achieve these outcomes (widening public debate, using third party organisations etc.); and
  • the response of existing ‘insiders’ or beneficiaries. One of the particular difficulties of engaging the public through more direct decision-making models is the reaction of insider groups whose responses can include boycotting and active resistance to the process.

Setting Objectives

Establishing documented (and published) objectives for the eEngagement process is a necessary primary step in the development of the implementation plan. Where possible, the objectives articulated early in the process will be the basis for evaluation measures used in the latter stages.

Objectives are likely to develop or shift over time, (particularly where the process is citizen-led, or collaborative across agencies). In general terms, however, objectives may be:

  • broad in nature, possibly reflecting a ‘community building’ or ‘visioning’ approach, in which the development of a conversation, or dialogue, amongst participants represents an end in itself. Often, these types of objectives are the most rewarding form of eEngagement activity and result in a tangible and durable, outcome. That said, these types of projects also commonly require considerable planning and coordination, and can, therefore, be complex to develop and administer effectively. eEngagement activities that have broad objectives are at risk of difficulties associated with:
    • matching outcome metrics with performance;
    • maintaining momentum over time; and
    • ensuring ongoing support from senior management and Ministers, who are focused on electoral cycle timeframes; or,
  • Narrowly-focused or instrumental in nature (‘problem resolution’) and, therefore, easier to develop and assess. Given the short-term nature of these activities, managers must be cautious of:
    • accusations of limited cost effectiveness;
    • problems maintaining ongoing commitment to the eEngagement approach following project completion;
    • difficulties maintaining staff and skills in the agency; and
    • ‘flash’ effects (outcome measures) that have limited medium to long term public value.

The articulation of objectives is best undertaken in a clustered manner, particularly where objectives may not be equally amenable to later evaluation. While there is a common desire across government to focus on outcome (over output) measures of productivity and success, this is not always possible and well designed objectives will allow substitution of relevant activity measures for missing outcome data.

Degree of Interactivity

One of the most compelling characteristics of new media for the purposes of public engagement is the use of interactive technologies. Interactivity, in this context, refers to the ability of the consultation process (human aspects) or system (technological aspects) to respond to the actions of the user and vary from a heavily pre-determined process to one that is more flexible.

In this way, the notion of interactivity also has implications for any decision about whether to make a process consultative or collaborative. Interactivity can be defined as ‘to act mutually; to perform reciprocal acts’ and can reflect:

  • the humanising aspect of technology: the way technology responds to the user in a dynamic manner, accommodating their input and/or preferences; and
  • the nature of the eEngagement processes as flexible and user directed, or a pre-determined process.

The desire to create user-friendly technologies, together with the type of eEngagement processes being undertaken, will determine the level of interactivity required and desired. This, in turn, will shape the choice of technology used.

Most digital technologies are interactive to some degree. Even relatively limited channels (2G mobile telephone networks, interactive television, menu-driven ‘static’ DVD videodisks, etc.) provide a great deal of flexibility in terms of the interactivity inherent in the engagement process.

In the eEngagement process, it is common to think of interactivity as a technical characteristic. However, the interactivity of an eEngagement system is commonly the result of deliberative design to incorporate interaction between participants, either vertically (between the participants and the agency), horizontally (between participants), or both.

Exhibit 16: Comparative Interactivity of Two Online Petition Systems

A good comparative example of horizontal and vertical interaction is to compare the parliamentary petitions systems of Queensland (Australia) and the Parliament of Scotland. Both systems provide access to the traditional petition system of their Parliaments, where members of the community can express their view on any issue to the Parliament.

However the two systems differ considerably in their level of interactivity. The Queensland system (http://www.parliament.qld.gov.au/ view/EPetitions%5FQLD/) permits members of the public to sign the petition only – a singular direct interaction with the petition system. The Scottish system (http://epetitions.scottish.parliament.uk/) provides a similar mechanism, but also includes the ability for petitioners to discuss the issue amongst themselves through a moderated online forum that is part of the petitions website.

In thinking about what role interactivity can play in the development of the eEngagement process, consider five types of interactivity:

  • synchronous versus asynchronous interaction: is the process to be conducted in real-time (live) like a public meeting (with the advantages of spontaneity) or will participation be staged over time (allowing greater participation for people without the ability to commit a ‘block’ of time, or allowing a more wide-ranging debate, discussion, or voting process?
  • the number of iterations of interaction: what will the ‘intensity’ of the interaction be? Will it be a series of small interactions, or only a small number of more intense interactions over time? The advantage of the former approach is the extent, range and free-flowing nature of the process, the latter can exhibit a tendency for high-volume participants to ‘drown out’ other voices;
  • the level of interaction between users: is there an explicit desire among participants to have a dialogue, or interaction, with each other? This may be useful where the desire is to stimulate (not lead) a discussion or debate, or in deliberative processes where the participants are tasked with presenting their points of view and arguing these towards a voting process. On the other hand, where there may be particular risks to participants (see section 4.6, Managing Risk ) or, where data collection only is required, interaction of this type may be counter-productive;
  • interaction between different channels: where multiple channels are involved, (or participants split between sub-groups, as in a deliberative conference), one of the core questions may be the cost-benefit of allowing discussion or interaction across these channels. In some cases this may be highly desirable, (e.g. where there is a recognition that different channels will attract different types of participants and the motivation for the eEngagement project is inter-group learning). On the other hand, splitting groups into selected clusters, or teams, can be valuable in moving people out of entrenched positions supported by their peer groups and lead to deeper interactions between individuals;
  • inclusion of elected representatives in the process: this is often one of the more difficult questions to resolve and is highly dependent on the nature of the issue under review and the hosting organisation. In many cases this may represent only token endorsement of the process (e.g. the Ministerial greeting), in others, elected representatives may be a core part of the process, using the project to supplement and enhance their interactions with the community. [6] On the other hand, some consultation units recognise risks in this option, including:
    • the prominence of the individual will detract from public participation;
    • the elected representative may dominate, or hijack, the process to promote a personal viewpoint, or reiterate party/government policy to the exclusion of debate; or
    • the process being used by a partisan group to ‘score points’ (e.g. through ‘stacking’ the forum).

Overall, three questions need to be answered:

  • how much interactivity is needed ?
  • how much interaction does the audience want ?
  • how much interaction can other participants (councillors or members of Parliament, moderating or management staff of the agency) realistically commit to?

As always, the answer often reflects a compromise between these competing forces.

Exhibit 17: SMS Voting – Australia versus the United Kingdom

In the recent extensive pilot of remote voting systems in the United Kingdom, SMS voting was used as one of a number of channels for the voting process (internet, electronic voting booths, paper ballots, postal, mobile telephones). In this example, SMS was seen as particularly valuable in reaching the youth demographic, given a good fit between this channel and that audience. While this was valuable in the UK, the use of compulsory preferential voting systems (and the need to be able to decipher a long ballot paper and navigate it easily) employed in Australia makes this channel of little value.

Choosing the Right Channel(s)

Following consideration of the issues raised above, the selection of the most appropriate channel moves (hopefully) from being a complex technical assessment process, to one where the manager can discriminate between differing engagement needs and balance these against different characteristics (strengths) of various technical options.

The core questions during this phase of the planning process are:

  • what are the available technical options?
  • what are their characteristics?
  • how do these match the audience needs?
  • how do these reflect the objectives of the project?
  • to what extent do they afford the degree and type of interactivity required?

Different target audiences will have higher levels of familiarity with different communications channels than others. A good illustration of this is the way different generations use technologies, like mobile telephones. While older people generally treat these as portable analogues of the landline telephones they grew up with (predominately using voice), younger people are more likely (for a range of reasons, including cost) to demonstrate a higher ratio of SMS to voice using the same technology.

While any generalisations must be treated sceptically, there is a general tendency for people to develop information literacy,[7] technical expertise and confidence in communications technologies (and specific submedia or applications[8]) and software during particular stages of their lifecycle: as they reach adulthood, during their years of formal education and/or the onset of professional employment. This may explain why your parents enjoy media you find uninteresting, while your children enjoy media you find incomprehensible.

Exhibit 18: SMS Consultation

Lancashire County Council uses SMS messages to prompt members of the community for quick responses to a range of questions under consideration. The popularity of SMS, particularly among younger people, provides the Council with the opportunities to target particular elements of the wider community. As the communication channel employed has specific characteristics that limit verbose participation (tending to generate fast feedback, but with short responses), it is useful for a specific type of engagement process (educational and idea generation), but is unsuited for more complex policy issues. See: http://www.lancashire.gov.uk/environment/sms/index.asp

The important point to remember is that selecting the right communications channel can significantly influence the type of participants likely to be attracted to the process. This can sometimes be beneficial, especially if the aim is to achieve segmentation (such as the use of chat for younger people), however, if the aim is to capture a wide cross-section of the community:

  • broad-brush applications are preferable (email, web-based participation, mobile telephony); or
  • multiple applications (channels) will need to be employed.

One of the ongoing strengths of ICTs is the growing convergence of different types of communication applications upon a standard internet protocol that is becoming increasingly available across a wide array of devices.

We can expect to see decreasing costs associated with the incorporation of multiple channels within a single system, or approach, over coming years – making broad-based strategies more cost-effective. The trend towards convergence will also be valuable in reducing administrative costs (for example, seeing web-based interaction and mobile telephone participation served by the same database and management system).