ACTIVITY 12.1: Analyse successes and failures

GLOSSARY TERMS

By Tom Wood / Updated: 28 Nov 2019

Rationaleinfo-icon

Not everything turns out exactly as planned - sometimes it is for the worse, sometimes for the better. It is important to look carefully to see what went well and what did not go well as there is something to learn from every experience. This evaluationinfo-icon includes both the impact of your efforts on urban mobilityinfo-icon and beyond (level of achievement of visioninfo-icon, objectives and targets) and the effectiveness of the planning process itself. It is possible that one went well and the other went wrong.

 

To identify and understand these successes and failures, you need to involve engaged and affected citizens and actively listen to what they say about the process and its outcomes. These aspects are essential in order to learn and improve your skills and knowledge, which, in turn, helps you to provide a solid basis for the next planning cycle.

 

Aims

  • Evaluate the planning process, the SUMP and its implementation with an eye to understanding what led to successes and failures.

  • Enhance your understanding of the Sustainable Urban Mobility Planning process and overall measureinfo-icon impact with the help of citizens and stakeholders.

  • Gather lessons for the preparation of the next SUMP generation.

 

Tasks

  • Evaluate the successes and failures of the SUMP through analysing the strengths and weaknesses of all phases and steps as well as their final outcomes.

    • Analyse the process looking back to the entire cycle. This can include, for example, participatory observation, focus groups or interviews. Use these to critically review the effectiveness of stakeholderinfo-icon and citizeninfo-icon involvement so as to enhance participationinfo-icon activities in later stages and in future plans.

    • Actively involve key stakeholders and citizens to identify accomplishments and improvable steps of the process from their perspective. After years of Sustainable Urban Mobility Planning, people standing outside the process can provide a quite different view and might have observed important aspects that you do not see.

    • For impact evaluation, you can begin to assess the broader impacts of the implemented measures once a sufficient number of results are available. Analyse what went well and what went wrong. List objectives and strategic targets that could not be achieved, but that are still on the agenda

  • Communicate the ‘lessons learned’ to the core team and key stakeholders (e.g. the ‘steering group’).

  • Reinforce success stories and ensure that you learn from mistakes in the next round of planning.

 

Timing and coordination

  • Review the effectiveness of the planning and citizen engagementinfo-icon process during the implementation phase.

  • Review the overall impact (i.e. did you get closer to the vision?) after a sufficient number of measures have been implemented.

 

Checklist

✔ Successes and failures of the Sustainable Urban Mobility Planinfo-icon process evaluated.
✔ Evaluation of measure implementation concluded.
✔ Key stakeholders and citizens involved and different perspectives gained.
✔ Lessons learnt shared and communicated.

More info: 

GOOD PRACTICE EXAMPLE: Nantes Métropole, France

Comprehensive evaluation of previous SUMP before starting plan development

 

The Métropole de Nantes has evaluated the main successes and failures of the previous plan (2010-2015) to improve the new SUMP. For this evaluation, the metropolitan region carried out qualitative and quantitative surveys (addressed respectively to 20,000 and 1,000 people) to understand how the mobility behaviour has changed and how the population experienced and observed the different mobility measures implemented since 2010. Additionally, an expert group conducted a qualitative analysis and drew conclusions and recommendations for the next SUMP development. In this process, the consultation of the population and the participation of experts and stakeholders were crucial for the good preparation of the new SUMP.

 

Author: Lamia Rouleau-Tiraoui, Métropole de Nantes, collected by Polis