Carrying out Engagement

Abstract type image taken from Light up Lancaster

What makes effective engagement?

There are five steps to effective engagement. These are:

  • Purpose and objectives - why do you want to engage?
  • People - who are you going to engage with?
  • Engagement activities - how are you going to engage?
  • Evaluation - to determine if your engagement meets its purpose and objectives.
  • Recording your engagement activity in Pure or KEEP - this can contribute to raising your reputation and that of the University.
4 linked circles-   'Purpose  ', 'People' and 'Engagement Activities'. Middle - Evaluation. 
<br />

Purpose

Be clear about your purpose for engagement. This will help you to identify the appropriate audience and engagement activities

There are many purposes for carrying out engagement.

Six main categories of purpose have been described by Duncan and Manners (2023). These categories are presented below, adapted to apply to all engagement types.

In many cases an engagement project will have more than one of these purposes.

accordion

4 boxes 'Doing to' 'Doing for' 'Doing with' & 'Doing themselves' Level of Engagement - low to high

Level of engagement

When defining your purpose, it is important to think about your Level of Engagement - how much influence and involvement will those that you engage with have on your research or project? This will have a bearing on the type of engagement activities you decide to carry out.

The ladder of engagement opposite, illustrates the different levels of engagement, with examples below:

Dr Maria Walach when giving her public lecture on Decoding the Northern Lights has inspired members of the public and she may have been given some insight and new perspectives based on the audience’s questions. Maria is speaking to her audience.

In the My Mainway project local residents of a housing estate in Lancaster were consulted on how their estate should be developed for the future. In this case the level of engagement was higher - local residents' views and ideas were listened to and are expected to inform the future plans for the area.

In the Library of Lived Experience project collaboration of those with lived experience of mental health issues was through co-designed workshops. Ultimately the project aimed to empower communities by giving them a framework to support them in setting up their own libraries.

Objectives

Once you are clear on your purpose and the level of engagement then you can set out the objectives that you want to achieve. Depending on the type of engagement activity you may have short, medium, and long-term objectives.

Your objectives will be informed by thinking about:

Outputs – this is what has been made, created or done.

Outcomes – this is what has changed as a result of your outputs.

Impact – this is the longer-term cumulative change that has occurred as a result of the outcome.

Outputs, outcomes and impact

This video, put together for Lancaster University by Jamie Gallagher, Engagement Consultant, provides an excellent introduction to these terms and how they are used in an engagement context. Please note: video only available to LU staff

Your objectives should include your intended outputs and outcomes.

You will need to think carefully about the impact and how this is going to be measured as given its longer-term nature and often resulting from cumulative change it is inherently more difficult to measure, but arguably the most important. The Research Impact team are at hand to offer advice.

Clearly define your objectives and how they will be measured at the beginning of your project. Your evaluation can then be fully integrated into your project and is not simply an add-on activity at the end. And remember to make your objectives SMART objectives.

People

You will need to think about who you want to engage with.

Consider if you wish to reach out broadly to the public or if you want to target a particular group of people or organisations.

As a starting point if you want to engage with the public you may wish to segment your audience, for example, by:

  • Demographic – age, social background, profession, diversity etc.
  • Place
  • Interest
  • Shared circumstances e.g., lived experience, residents living in a particular locality.

You may be reaching out to people in particular organisations such as businesses, community groups, third sector, social enterprises, and local government.

You may already have in mind who you wish to engage with, or you may be starting from scratch. For example, you may know that you want to engage with local authorities, but not know who to contact or how to discuss your research with a business. There is rich experience of engagement with the public and different organisation types at Lancaster University, which can help and support you in making the right contacts. Visit the support section of the portal for more information.

Once those that you are going to engage with are identified it is important to deepen your understanding of them, this will help to inform the best way of engagement. For example:

  • If you are engaging with a particular group of individuals such as residents within a defined area then reading news reports/social media and meeting up with local counsellors and community leaders, for example, will enable you to gather background understanding of the issues that are being faced and public opinions prevalent in that area.
  • When engaging with businesses, third sector or local government information such as their strategic plan, company reports, corporate plans, company accounts can be all rich sources of information. These can help you understand an organisation and the problems it may be trying to solve or products it wants to create.

This will allow you to make initial contact on an informed footing.

Engagement activities

The next stage is to plan your engagement activities.

By defining your purpose and objectives and defining your audience it is likely that the type/s of engagement activities that you are going to use will become clear.

Here are some typical engagement activities:

  • Organising a Meeting with potential business partners
  • Hosting an Event
  • Giving a Lecture
  • Co-designing a research project with members of the public
  • Using social media
  • Writing a press article
  • Organising a Workshop
  • Giving a Performance
  • Patient and Public Involvement (PPI) in research
  • Putting on or contributing to an exhibition
  • Contributing to established networks/policy groups or committees
  • Consulting with people and organisations e.g. through interviews and surveys
  • Taking part in a radio broadcast

The list is not exhaustive, and you are encouraged to be creative and innovate!

To carry out these activities effectively, you will be drawing on a range of skills. Some of these and where to go in the portal for further support are highlighted below:

Evaluation

Evaluation is how you will know if your objectives have been met. In the objective section consideration was given to outputs, outcomes and impact. You may wish to review this section again before reading further.

Why evaluate?

Evaluation helps you answer important questions about your work, such as:

  • Were your initiatives successfully delivered?
  • What was the reach?
  • What impact did the project have?  

As well as knowing whether your objectives have been met and helping inform your practice, evaluation is often required by funders to demonstrate return on investment (ROI). Importantly, it can be used to evidence research impact – such as for the Research Excellence Framework exercise.

Tab Content: Planning your evaluation

If you have set out your objectives clearly and thought about these in terms of output, outcomes and impact, carrying out the evaluation should be more straightforward.

Within your engagement planning you should have already considered how you were going to measure the objectives.

Here are a few tips for improving the evaluation design:

  • Ensure the questions you ask are relevant and will help you demonstrate progress against your objectives; 
  • Wherever possible, integrate your evaluation into your delivery (can you get feedback as part of your activities, are you able to establish data monitoring processes as part of your support, can you make a survey/feedback form part of a reflective process?); 
  • Consider that evaluation is often not just a one-off activity - it may need to be embedded into different stages of your engagement project. This may be particularly the case when trying to measure impact which may only be measurable sometime after the actual activity;
  • Communicate openly and enthusiastically about your evaluation and make it part of your condition for engagement.

Tab Content: Types of evaluation

When designing and implementing evaluation it is important to consider what type of evidence you need.  

There are two broad types of evaluation that produce different kinds of evidence: 

Output evaluation – this evaluation generates evidence to explain and assess the effectiveness of your activity/initiative. It is broadly concerned with the process of doing and is often measured qualitatively through feedback forms and other indicators of effective delivery.

You may do this type of evaluation immediately after a workshop for example, by giving delegates a feedback form. This may ask various questions about the workshop:

  • Were the presentations interesting and informative?
  • Did the workshop meet their expectations?
  • Could any improvements be made if this was done again?

Outcome and Impact evaluation – this type of evidence focusses on the change arising from your engagement delivery. Outcome is more focused on the shorter-term change whereas impact is measuring the longer-term, cumulative change. Evidence of impact is often drawn from longitudinal evaluations and endeavours to demonstrate correlation/causality.

In most cases you will want to deploy a mixture of output, outcome and impact evaluation types and it is worth considering what the best approach might be to each. Can you acquire output evaluation through using Mentimeter or a Graffiti Board (a shared writing space e.g. a large sheet of paper or whiteboard to record comment and questions) activity and focus on outcome in the survey/feedback? What are the key measures that illustrate success in delivery versus longer-term impact? 

Tab Content: Evaluation methods

Some evaluation methods you could use: 

  • Participant survey (online using MS Forms, Qualtrics or printed hard copy) 
  • Feedback forms and questionnaires 
  • Email open rates and click-throughs 
  • Mentimeter (real-time digital engagement and voting tool) 
  • Focus groups (audience specific two-way discussion) 
  • Independent observer  
  • Interviews 
  • Word clouds 
  • Likert Scales 
  • Graffiti wall  
  • Feedback postcards 
  • Website statistics  
  • Testimonial letters 
  • Informal feedback (verbal and written) 

The Little Book of Creative Evaluation produced by academics and researchers at Lancaster University has ideas on evaluation approaches that promote engagement, participation, inclusivity and creativity.

IT support on using survey software such as MS Form and Qualtrics is available through Digital Skills training, offered by the ISS team.

Tab Content: Useful Links

  • The Little Book of Creative Evaluation produced by academics and researchers at Lancaster University has ideas on evaluation approaches that promote engagement, participation, inclusivity and creativity.
  • Research Impact - this is a course with five module, encouraging impact to be embedded into each stage of the research journey. By working through this course the relationship between impact and engagement will become clear. It includes a module in Engagement and Communication Strategies. The course has been purchased by LU for use by students and staff.
  • Evaluation Visualisation Design Tool (EViD) - a collaborative tool, produced by academics and researchers at Lancaster University for exploring and designing project evaluations. EViD is a LU spin-out company and is a free for non-profit organisations and for educational purposes.
  • Research Impact Team - they can be contacted for advice and guidance on all aspects of research impact.
  • Evaluation and Impact team within external relations can provide support on topics such as survey design and focus groups. They provide a series of in-person workshops. More details are provided on their Evaluation and Impact Training MS Team site.
  • Little Book of Evaluation - This presents some easy to use methods of evaluating public engagement with research.
  • Evaluating Public Engagement (NCCPE)  This webpage covers the things you need to think about when developing an evaluation plan. 
  • Events Toolkit 2023 Advice on evaluation for an event is on page 8-9 of the toolkit and the evaluation template is a useful resource to help plan your evaluation. 
  • Evaluating Your Public Engagement Activities  A comprehensive guide covering evaluation planning, techniques, analysing and interpretation the data and reporting findings. 
  • UKRI Public Engagement Guide   This goes into detail about tools and techniques for data collection and handling.  

Recording your engagement activities

It is important to record engagement activities for a number of reasons:

  • The information is important for the Research Excellence Framework (REF), HE Business and Community Interaction Survey (HE-BCIS) and Knowledge Exchange Framework (KEF) submissions;
  • Lancaster’s performance in HE-BCIS is used to inform the allocation of Higher Education Innovation Funding (HEIF) funding, which in turn enables the University to invest in support for engagement;
  • If you are an academic/researcher putting your engagement activity within PURE can contribute to raising your staff profile. The recorded information can be used as evidence for an academic promotion case.

There are two main systems for recording engagement activity - Pure and KEEP. Which one you use depends on your role. High quality and comprehensive information in these two systems relies on staff uploading/using the systems, as appropriate.

More information on Pure and KEEP

Risks, reputation and responsibility

There are significant benefits to carrying out engagement activities. The vast majority of these are very positive experiences for all those involved. However, there can be risks and some of these are highlighted.

It is best to identify the potential risks of your engagement project at the planning stage. You can then put checks and mitigations in place to manage the risks. If unexpected consequences do occur, e.g. adverse attention from media engagement, support is available from the University.

More information on risk, reputation and responsibility

Contact us

Suggestions for new content? Anything to update?

Email the stakeholder relations team