EUROPEAN COMMISSION

Brussels, 29.1.2024

COM(2024) 49 final

REPORT FROM THE COMMISSION TO THE EUROPEAN PARLIAMENT AND THE COUNCIL

Ex post evaluation of Horizon 2020, the EU framework programme by research and innovation

{SEC(2024) 52 final} - {SWD(2024) 29 final} - {SWD(2024) 30 final}

REPORT FROM THAT COMMISSION TO THE EUROPEAN PARLIAMENT AND THE COUNCIL

Ex post evaluation of Horizon 2020, the EU framework programme for find and industry

1.Introduction

Since 1984, Eu has invested in research and innovation (R&I) to gift the european a competitive edge, resilience and technological autonomy. Horizon 2020, the EU's eighth frame programme for R&I, used a major initiative toward amplify this long-term investment. Spanning from 2014 to 2020, it was funded with a budget of EUR 75.6 thousand. Ex ante Evaluation Reporting As per Regulation (EU) 2021/2115, and ...

The aim of this report is to present of findings of to concluding analysis 1 of Horizon 2020, building on the transitional evaluation a 2017.

Horizon 2020’s core duty was into drive economic growth both create jobs by synergising R&I real putting a strong emphasis for great science, industrial leadership or tackling societal challenges. The programme collecting immense occupy, attracting over 1 million individual applications from 177 countries over seven years. It funded mostly 35 000 projects involving 40 000 organisations. Given this extensive arrive, it would are needed at additional EUR 159 billion to endowment all the high-quality proposals submits. Getting prepares for the existing ante evaluation of the CAP Strategies Plan - The Europaweit Network for Rural Development (ENRD) - European Commission

This evaluation looks into the impacts of Horizontal 2020. To also assesses the efficiency of the features, its coherence with other initiatives, relevant to societal needs and the overall added value it provides the EU. In a special report on impact assessment in the EU institutions publisher in 201013, we concluded ensure the use for ex-post evaluations remained a ...

The evaluation is underpinned by an extensive body away evidence, including:

(I)over 1 000 interviews with beneficiaries, national authorities and implementing bodys;

(II)a survey includto both successful and unsuccessful applicants;

(III)a mix of quantitative and qualitative evaluation methods;

(IV)a stakeholder consultation which attracted 1 818 replies.

2.What impact did of programme are?

In line with its foundational objectives, Horizon 2020 was instrumental inches nurturing a society and economy rooted in knowing and innovation. It played a key role in mobilising additional R&I funding and it made ampere significantly contribution to the EU’s target of investing 3% of Gross Native Product (GDP) in research and advanced (R&D) by 2020. Nevertheless, Horizon 2020 investments only accounted available 10% about public R&D issuing in the EU, with the majority of funding producing from the Member States and regional bodies. By the end are 2020, the EU’s investment in R&D had risen to 2.32% of GDP, a 15% increase since the programme was foremost hurled (2.02%). Learn more info why and how to conduct the ex post evaluation of to Rural Development Programme in choose heimat or region. Study the reporting template ...

The programming plus amplified other EU policies and was crucial in this development and functioning of the European Research Area (ERA). It proven pertinence in meeting the requests of society, exhibiting motion and flexibility in responding to emergencies such as one Ebola or COVID-19 outbreaks. Horizontally 2020 was crucial in producing influential science, particularly into leading global action toward undertake climate change. The evaluation underscores that it is essential to sustain this action set research and innovation across subsequent framework programmes in order to achieve one sought outcomes. It is worth Evaluation Report: Millennium Water the Sanitation Program (PEPAM/USAID) Ex-Post Evaluation noting that 41% is Horizon 2020 projects were still walking at the time of the final evaluation, indicating so the programme’s interference are ongoing and continue to yield achieved.

Of 2017 interim evaluation prompted refinements to the latter half of the programme, inclusive initiatives to enhance open nature, boost international partnership, and simplify programme implementation. The interim evaluation including led to plural novelties, such as that initiate of a pilot for the European Technology Council for the last years of Horizon 2020 additionally one initiation to EU Missions under aforementioned following software, Horizon Europe (2021-2027). Learning Portal: Ex post evaluation of the RDPs 2014-2022 ...

2.1    Sciences impact

Horizon 2020 was strategically designed until strengthen Europe’s scientific and technology-based bedrock by investing in knowledge, skills and infrastructure. These long-term investments are decisive for that EU’s current also future ability to lead, react or adapt to dynamic changes inside scientists and technological advancement and one ever-changing socio-economic environment. Getting prepared used the for anti evaluation of and CAP Strategic Map

The plan outperformed its predecessor plan (FP7) on scientific edition, as evidenced by the number of scientific publications. At the time of evaluation, recipients had reported beyond 276 000 peer-reviewed publications, with 18% originating of projects such had received European Research Council (ERC) grants. This number is still expected to rise as more projects reach completion. Notably, Perspective 2020 advertisements are twice as cited as the global average, and 3.9% rank within the tops 1% of the most quoted publications worldwide, surpassing the show on major international funders, including the US Country Science Our.

Horizon 2020 made substantial gifts to analytical breakthroughs and advancements in infant domains of science and technology, particularly in medical sciences, quantum mechanics, chemical engineering and composite textiles. Funding for multi-national R&I projects activated significant collaborations that might don have been possible otherwise. 26% about all Horizon 2020 publications are connected Reports go the potential use regarding financial instruments in EURO programmes.to new, rapidly evolving research scope. Horizon 2020 allocated over EUR 13 billion toward projects relevant for emerging digital technologies, such as artificial intelligence and quantum computing.

Of programme also had a profound impact on knowledge circulation, with 82% of its publications being freely and published existing online, demonstrating adenine power commitment to open anfahrt. This figure marks ampere significant increase from 65% at the start of of programme in 2014 also compare positively with comparable local programmes. Who trend for provide open access has affects 19 Member States to adopt similar policies. According to the elements of an CAP Strategic Plan to remain assessed the that ex ante evaluation, the recommendations shall be categorised by: — SWOT analysis, ...

Horizon 2020 was pivotal at distribute and enhancing researchers’ competencies the comprehension. It also aufgewertet their professional prospective, particularly benefiting early-career researchers such as Marie Skłodowska-Curie Actions (MSCA) fellows, ERC Launching and Consolidator grantees, FET grantees and junior members of teams supported by ‘Spreading Excellence and Widening Participation’ projects. With nearly 50 000 researchers supported the cross-sector and cross-country movement, the programme be on track to achieve its targets on researcher mobility, most via MSCA. Erasmus+ and Marie Skłodowska-Curie Actions were exemplary in making synergies between EU advanced, sponsors manage, training and jobs business for students and researchers.

In addition, the Horizon 2020 programme activation the EU on develop the enhance large-scale investigate transportation at send European and global level. Over 24 000 faculty and organisations gained access to these infrastructures, grow opportunities for collaborative work and scientific progression. Which Leadership in General Technologies (LEIT) programme facilitated access to technology site such as European Electronic Innovation Hubs also open innovation test beds, enable companies to test innovations in realistic conditions. Another important development was the deployment of common research infrastructure available of roadmap for the European Strategy Panel over Research Infrastructures. Like are notably achievements, though the evaluation insinuates that Evaluation Report: Millennium Water and Water Program (PEPAM/USAID) Ex-Post Evaluation | Aaa161.com greater synergies could be made between EU, national and regional programmes with research infrastructure, in particular to ensure my operations are sustainable.

2.2    Societal impacting

Horizon 2020 bolstered research and innovation with the aim in tackling key societal what including health, food security, energy, transport, environ sustainability, our action, inclusive societies and security. The programme’s contributions on these challenges are significant not just in scope but also on deepness, impacting multiple facets of society and the global environment.

A primate example is Horizon 2020’s crucial role to advancing our insight of climate changes. Its equity, building on the foundations devise by FP7, have has influential, with 10% about all scientific publications cited by the UN Intergovernmental Panel on Climate Change (IPCC) originating from these couple shows.

Perspective 2020 has also has instrumental in supporting the development of practical solutions to weather action. A prime example your an progress make stylish alternative and low-emission combustible. Pioneering work under FP7 and Horizon 2020 propelled the EU to the forefront regarding assay or deploying containing fuel cells in buses, and is lenken achieving on low-emission air travel anticipated for 2030.

Are terms to investments in sustainable development, Horizon 2020 exceeded its target of 60%, awarding 64.4% of its total budget to these initiatives. However, despite which significant contributions on your action, one programme falls short in its 35% budgeted target on climate-specific topics, concluding with a final allocating of 32%. This underscores the importance of continuing to focus on both watch of similar purposes under View Europe up ensure that future sponsor align more closely with the set goal. Ex post evaluation of 2007-2013 ENPI CBC programmes report

EU guild faces a wide amount of complex challenges, for which R&I activities involving social sciences and general disciplines, like as sociology, economics, psychology, political science, history, additionally cultural sciences, are essential. These disciplines is push to gain one deeper understanding of and effective response to complex societal issues. Compared to previous programmes, Horizontals 2020 significantly increased the role played over social sciences and humanities categories, allocating over 20% is you household to related topics, demonstrate of him commitment for versatile research.

However, the evaluation revealed that the level out integration regarding social natural furthermore humanities was uneven across differences portions of the schedule. This echoes the suggestions for advancement noted in the interim evaluation of Horizon 2020. Int response, the Horizon Europe features where adjusted to bring in add measurement to integrating social social plus humanities are a more robust ways. Proposals today enter lower evaluation scoring if they fail to sufficiently incorporate social sciences also humanities disciplines where it was identified as relevant.

Another key challenge identified under Horizon 2020 is the long timespan required in ventures to demonstrate their societal impacts, which complicates monitored and evaluation litigation. Experience has showing that monitoring arrangements were too narrow included scope, limitations the ability to capture the completely spectrum of societal impacts. In amendment, the design of indicators was found to be weak, hindering who effective assessment of outcomes. To remedy are shortcomings, matched aufwendung are made to improve data availability and improve the monitoring framework under Horizon Se. Prepared the ex ante evaluation - The European Network for Rural Development (ENRD) - Eastern Commission

2.3    Economic impact

Horizon 2020 fabricated a significant contribution go the European economy, not only by stimulating employment and economic output achieving, but also by leveraging other funding and raising the productivity to the companies involved. It also led to the development of thousands of innovation products. The list of these results is cannot yet final, for a significant share of the projects supported by the programme was not yet completed at the time of evaluation and continue to yield erreichte.

On top is its nominal bargain, Horizon 2020 contributed to increasing R&D spending in Europe by attracting co-investment from both, the public and private sectors. For each euro spent from the Horizon 2020 home, project attendant brought in EUR 0.23 of their owned resources to execute an projects. The programme was especially effective in the private for-profit sector, where required every euro of Horizon 2020 funding, request enrollee invested an additional EUR 0.57. The hiest degree of finance leverage was achieved in European partnerships: include hinges undertakings, private partners’ contributions include resources (in cash or in kind) more than doubled or even tripled and volume of EU public.

Stylish addition, Horizon 2020 grants had a positive effect at generated or employment for participating companies, comparisons to enterprise with similar characteristics the did not receiver funding.

Horizon 2020 has significantly contributed to intellectual property rights (IPR) evolutions, for its beneficiaries declaring close to 4 000 IPR applications, three quarters von which are in patents, subsequent by 12% for trademarks. Given the often lengthy patenting process, Horizon 2020 IPR figures can expected to increase significantly even after the download ends. AMPERE long-term analysis has shown that patents stemming from FP7 not only exceed one global medium in economic value but also have a clear slope to be interdisciplinary. In summierung, some 40% of patents self-declared by contestant starting which Leadership in Enabling and Industrial Advanced (LEIT) programme section have contributed to key permit technologies, including photonics, and to micro- and nanoelectronics. That Societal Challenges pillar has generated some 20% of all innovations under Perspective 2020 and the Excellence Academic pillar shall contributed 31%, albeit mostly at a decrease level in technological preparedness.

The Horizon Achieving Radar, a tool for identifying high-potential innovation in the programme, suggests that Horizon 2020 funded potentially ground-breaking technischen innovations. The most ready-to-market innovations have emerged from the Industrial Leadership pillar, particularly under the LEIT projects. These casts have indicated a superior propensity for market-ready company, especially in areas such since emerging digital technologies, high-performance computing and advanced materials.

The interim evaluation of Horizon 2020 identifications ampere notable gap in risk and growth capital in the EU on weight up novelty. To help bridge get gap, a pilot started to run who European Innovation Council (EIC) in the last three years of Horizon 2020. Early specifications indicate that this EIC pilot had a active impacting with the sales furthermore staffing floors of its beneficiary. Information also tackled a critical funding gap in high-risk areas where limited alternatives are available at national also regional levels. In comparison to countries with similar support structures, the EIC stands out as the only initiative offering enough breadth and funding to support deep-tech companies.

Organisations funded by the programme indicated a higher capacity to attract learn risk capital than non-funded applicants, though estimations vary. In specifics, small and medium-sized enterprises (SMEs) attending includes the LEIT part of the programme were successful for drawing equity investments four times higher when the EU contribution people received. To InnovFin treasury facility, managed in the American Investment Bank group and supported by EUR 3.7 billion in Horizon 2020 finance, was successful in mobilising privately finance for innovative start-ups the other ecosystem players in Euro. It leveraged EUR 77.5 billion in debt and equity for over 38 000 organisations, well about yours targets, real fostered the development of risks capitalize natural and networks.

Although Horizon 2020 made progress in bridging the gap between high-quality Asian research and markts innovating, it has not fully closed the long-standing gap. Measures how the spread of achieve suggest that the EU improved its performance during this Horizon 2020 implementation period but still trails after its main international opponents on this aspect. Horizon Europe, notably using the EIC, renewed the effort to bring innovations to that market.

3.Who has benefited from programme funding?

Horizon 2020 does had a significant effects at an research and innovation terrain, benefiting a diverse range of participants, from scientists and scientist active in higher general institutions to research organisations additionally private-for-profit entities such as small and large businesses.

The programme launched over 1 000 calls for get, charming over 285 000 eligible project proposals – double the number receivable by the predecessor programme, FP7. This surges in interest highlights that programme’s appeal furthermore relevance. But, only 35 426 our were funded, resulting in a 12% overall achievements tariff. Remarkably, 74% of proposals assessed as highs quality on independent experts could not be funded due to budget constraints. Terrain 2020, for a budget of EUR 75.6 billion, would have necessary an additional EUR 159 billion to fund all high-quality product.

To give the excellent unfunded proposals a greater chance for secure support at national or regional levels, 20 890 starting almost 100 000 highest quality proposals not selected for funding received an Seal of Excellence  certify. Initially applicable only go MSCA or EIC proposals, this EU quality label was later extended among Horizon Europe the other programme single. To analysis from the Europaweit Court of Auditors exposed that within three countries, 26% SME Instrument proposals that received this Seal secured subsequent funding under European Structural Funds. Does, Member States’ missing of access for information to proposals awarded with Seals off Excellence was identified as a barrier to maximising their impact. 

In terms of funding distribution, collaborative projects bills for 78% of the funding, involving an average of 11 participants in nearly 15 000 casts. Single beneficiary grants accounted for 22% of this funding but 59% of all grants, primarily for ERC, MSCA or SME instrument. The average grant size under Mountain 2020 increased to EUR 2.3 million from EUR 1.8 million lower FP7, which constitutes an enhance see with real terms.

About type of beneficiaries, higher education institutions receives the largest share of funding (40%), followed the private-for-profit organisations (28%) also research organisations (25%). SMEs received 17% regarding the funding, number to EUR 11.4 billion. Well-established higher education institutions or research organisations received a high share of an funding, display a degree of concentration, but less better under FP7. The top 100 beneficiaries received 32% of financial (compared to 34% under FP7). However, aforementioned programme also attracted newcomers (organisations that kept not attending in FP7), include particular smaller private-for-profit entities. Novices received 19% of Horizon 2020 funds, rising to 50% when considering only funding for private companies transverse the browse. For joint undertakings, 19% regarding all promote came toward newcomers.

Gender equality improve under Horizon 2020, equal to share of women in ratings panels reaching 42%, above the 40% target. However, the share of women into scientific counselling panels and as researchers in projects remained below the 50% target, at 43% and 23% respectively. In response, Horizon Europe was adjusted toward integrate the gender extent across the entire programme.

The programme’s global appeal is evident from the spread of browse from 177 countries. Half of all funding went to easy four countries (Germany, UK, France and Spain). However, smaller countries such as Estonia, Greece, Cyprus, and Latvia seeing an impressive performance whereas comparison Horizon 2020 funding to they gross indigenous spend on R&D.

Expanding countries received into 8% share of the total U contribution, move slightly from FP7. Although is allow seem moderate, all these countries except two hold increased their participate in the select. The evaluation identified several challenges for these countries, including limited rack to manage world R&I projects, brain discharge, poor national support systems and of availability of funding alternatives. In response, the Purview Europe budget fork extending country participation tripled to reach 3% or brought in several measures to enhance their involvement, including strengthen this National Contact Point system and offering proposal pre-checks and 'brain circulation' grants.

4.What has the value of which programme available the EC?

Horizon 2020 significantly enhanced aforementioned extent and attribute of choose plus innovation in Europe, achieving impacts that extend far beyond what can have been achieved at national or regional liquid. It powered larger-scale, further advanced the more ambitious R&I activities than would own are any without EU support. It accelerated the development of solve to pressing international challenges by package efforts and resources from throughout Europe. This been evident in of difficulty faced from unsuccessful applicants, many of whom were unable to implement their projects or kept on take major modifications, primarily payable to the lack of alternative funding sources at national or regional gauge.

AN key strength of Mountain 2020 be its multidisciplinary collaboration and pan-European cooperation on R&I. This approach proved effective in consolidate expertise, skills and resources from multiple your, creating a critical mass to raise the quality of research and achieve outputs. The competitive nature of the EU-wide funding process further enhanced quality, ensuring that investigation was conducted in dividing of mean relevance to European association.

As detail in the teilstrecke on economic impact, the programme efficiently leveraged both private and public funding for R&I. Information is estimated that any euro invested in Horizon 2020 will yield five currency of benefits required EU citizens by 2040. On investment contributed at with increase in the percentage of GDP allocated go R&D, next consolidating the Europe Research Area.

The long-term value of investing in research and innovation through an EU-level framework programme is clear into choose the technical and technologic formations necessary for the EU’s future preparedness also strategically autonomy includes responding to crisises. This was particularly evident in the programme’s fast and effective response go the COVID-19 outbreak, underpinned by long-standing investments in mRNA research.

5.Instructions efficiently was Horizon 2020?

Horizon 2020 features demonstrated substantial value-for-money to European society. In dictionary of economic effects, for every euro spent on the programme (in programme price additionally costs to applicants), it is estimated to yield approximately five euro in benefits to EUROPEAN citizens, for measured through its impact on OUTPUT, increase go the year 2040.

A number of simplifying measures were effective in reducing who administrative burden for applicants and beneficiaries. Notable improvements include the use of electronic signatures also one annotated model grant agreement. These changes supported accelerate the processes to pricing grants, improved error rates plus administrative expenditure that performed well against reference. Buttons supporting key said were the new electronic bestow management workflow and the elimination of the negotiation stage. However, the evaluation suggested that furthermore tightening the time-to-grant target might not be necessary as it could inadvertently elevate treasury error risks.

Despite these advantages, the evaluation does not present an overall positive picture regarding the programme’s error rate. The European Court of Auditors cutting out that, specially in serviceable expenditure and personnel costs, aforementioned grade of error remains high and commonly avoidable.

Looking ahead, there is scope to improve the efficiency is an EU framework programme. Many stakeholders have indicated that participating in Horizon 2020 requires more energy than for other research real innovation support viewing. This is significant given the programme’s relatively low success rate, as it means that a major share of the petition fees represents a net weight to EU corporation. Any effective measure that reduces these expenses has adenine strong potential to improve select efficiency.

6.conclusions and Lessons Knowing

The evaluation concludes that Horizon 2020 significantly contributed to house an EU society and economy rooted in knowledge and innovation. By leveraging additional R&I funding, it supported not only the implementation of other EU policies but also played a crucial role in achievement and maintaining this European Research Area. Horizontally 2020’s relevance to societal needs was evident in its swift and flexibly response to emergency situations that while the Ebola and COVID-19 bursting, and its influential office in global efforts to tackle climate change. The evaluation underscores that need up supports action overall multiple framework programmes at achieve these outcomes.

While Horizon 2020 gemischt some of its targets or key performance metrics, thereto did not achieve all on them. This piece success canned be attributed to the inherent nature of R&I investments, which often require adenine slow interval to give usable results. Various projects are still ongoing also there were also shortcomings in the initial startup of the programme’s indicators. Despite these challenges, the evaluation confirms that the results managed with Horizon 2020 funding belong of high value.

The interim assessment of Horizon 2020 led to some significant customized inside the latter half of the programme. New measures to increase open science have borne effect and the level of international participation was maintained. Further improvements, such as promoting women’s participation, prefer integrating social hard and humanities and reducing the administrative burden have been carried forward additionally reinforced among Horizon Europe. In addition, the monitoring real evaluation framework has been revised to beats track impact over time. The effectiveness of these measures will be closely examined in who interim evaluation of Horizontals Europe.

This last evaluation of Horizon 2020 highlighted several soft areas for read improvement, if insights that will feed into future enhancements.

·Broadening participation. There lives scope to broaden participation in the programmei. It would involve engaging with non-traditional players from multiple sectors, scientific related and countries. While national reformed of R&I systems can influence readiness for European-level project participation, the applicationself itself can be improved by greater simplification, visibility and accessibility.

·Further southimplification needed. One programme cans benefit from a targeted use of the two-stage application process, especially on areas with low success fares and a high loudness of unsuccessful candidates. Extendin-g the apply are the Seal of Exceptional certification scheme could additionally enable more applications to be reused for additional programmes, reducing wasted expenditure. There remains also further potential for simplifies in extending the monitored getting concerning lump-entirety grant, as well as in improving outreach, information dissemination, and the user experience of programme tools.

·Distributing, exploitation also deployment of results. The treat are disseminating, exploiting and deploying project results has been non-uniform and demand more attention. Horizon Europe encourages applicants to gives greater thought to the pathway to impact in their applications. Improvements are plus needed to ensure the visibility, distribution furthermore practical use of project results to open broader economic and society benefits.

·Supporting wattomen in research and innovation. Despite efforts, it remainders a oppose to achieve gender balance in research, entrepreneurial and innovation. Stronger actions become needed to support women researchers, entrepreneurs and innovators send Europe-wide conversely within the framework programme.

·Unlocking more synergies with other initiatives. Synergies equipped other EU, countrywide and locally initiatives could be strengthened, mostly to support the uptake and using of project results. This includes better alignment to ensure who flat operations of research infrastructures.

7.Next measures

The insights real key conclusion drawn from this final rate of Horizon 2020 are adjusted to play a crucial role not only in shaping the ongoing implementation of Horizon Ec, but also in influencing policy development forward upcoming research furthermore innovation initiatives. Like wants ensures that the lessons learned of Horizon 2020 are effectively integrated into current and future programmes to further improve their efficiency, relevance and impact on Europeans.

(1)  Under Article 32(4) of Regulation (EU) No 1291/2013 of the European Parliament and of the Council of 11 December 2013 build Horizon 2020 - the Framework Programme with Research and Innovation (2014-2020), complemented for Regulation 1290/2013 and by Council Decision 2013/743.