Australia’s trusted immunisation experts
21 September 2023 | NewsMultiple vaccinations for children – new NCIRS resourceRead the full article
Vaccination program evaluation is essential to understand the success and challenge associated with the implementation of a program and the impact of the program on disease burden.
Since 2006, NCIRS has been contracted by the Australian Government Department of Health to evaluate the introduction of vaccines on the National Immunisation Program (NIP). Although scope and timeline varies with each vaccination program, common components include:
Process evaluation is done to understand how a program was conducted. Evaluating the process of program planning, implementation and delivery provides contextual information to help interpret other components of the evaluation. NIP process evaluations use tools such as semi-structured interviews with key stakeholders, online surveys of immunisation providers, computer-assisted telephone interviews of consumers and review of key policy, operational and promotion/communication documents to:
describe how the program was planned and delivered, including communication strategies
identify the strengths and challenges of the implementation approaches taken.
develop ideas to enhance the implementation of future national vaccination programs.
Impact evaluation involves description and assessment of relevant data on disease burden, vaccine coverage, seroepidemiology and vaccine safety. This may include data from the National Notifiable Diseases Surveillance System, National Hospital Morbidity Database, the Adverse Events Management Database, Australian Immunisation Register, Australian Coordinating Registry (for deaths) and national serosurveillance data.
Impact evaluation of Australian national human papillomavirus vaccination program 2021
This involves estimation of the uptake of vaccine in targeted age groups.
This involves identification of changes in population seroepidemiology.
This involves description and assessment of adverse events following immunisation for a particular vaccine.
This involves evaluation of the impact of the vaccination program on disease. Core components include:
calculation of vaccine effectiveness and identification of vaccine failures
assessment of changes in disease notification, hospitalisation and mortality rates
identification of changes in the epidemiology of a disease over time, including overall incidence, age-specific and regional-specific incidence, as well as serotype/serogroup-specific and Indigenous-specific incidence, if appropriate.
Program evaluation cannot be conducted by NCIRS in isolation. It requires extensive collaboration and consultation with a broad range of stakeholders, including the Australian Government Department of Health, Communicable Diseases Network Australia, Services Australia, Australian Institute of Health and Welfare, Therapeutic Goods Administration, the National Aboriginal Community Controlled Health Organisation, Primary Health Networks, state/territory health departments and others.
Haemophilus influenzae type b
Human papillomavirus (HPV)
National Measles Control Campaign, 1998 – completed in 2000 [Report] [Related paper]
Young Adult Measles, Mumps and Rubella (MMR) Campaign, 2001 – completed in 2003 [Related paper]
Introduction of measles-mumps-rubella-varicella (MMRV) vaccine on the National Immunisation Program – completed in 2016
National Indigenous Pneumococcal and Influenza Immunisation (NIPII) Program – completed in 2004
National Older Australians Adult Pneumococcal Immunisation Program – [Final report]
National Childhood Pneumococcal Immunisation Program – completed in 2009
Introduction of 13vPCV on the National Immunisation Program – completed in 2015
Review of school-based vaccination in Australia – completed in 2011 [Related paper]
National Shingles Vaccination Program: process and early impact evaluation – completed in 2018 [Final report]
National Varicella Vaccination Program – completed in 2011 [Related paper] [Related paper]
Implementation of the 13-valent pneumococcal vaccine supplementary dose program on the New South Wales North Coast – completed in 2012 [Related paper]
Effectiveness of the New South Wales pertussis vaccine ‘cocooning’ strategy – completed in 2013 [Related paper]
New South Wales Aboriginal Immunisation Healthcare Worker Program – Stage 1 – completed in 2015 [Final report]
BCG vaccination programs in Australia – completed in 2016 [Final report]
New South Wales Aboriginal Immunisation Health Care Worker Program – Stage 2 – completed in 2017 [Final report]
NSW Meningococcal W Response Program– completed in 2018