14 October 2021 | EventsWebinar video now available: Weighing up the benefits and risks of COVID-19 vaccination: a focus on safetyRead the full article
Program evaluation is essential to understand the success and challenge associated with the implementation of a vaccination program and the impact of the program on disease burden.
Since 2006, NCIRS has been contracted by the Australian Government Department of Health to evaluate the introduction of vaccines on the National Immunisation Program (NIP). Although scope and timeline varies with each vaccination program, each evaluation includes the following main components:
Process evaluation is done to understand how a program was conducted. Evaluating the process of program planning, implementation and delivery provides contextual information to help interpret other components of the evaluation. NIP process evaluations use tools such as semi-structured interviews with key stakeholders, online surveys of immunisation providers, computer-assisted telephone interviews of consumers and review of key policy, operational and promotion/communication documents to:
describe how the program was planned and delivered, including communication strategies
identify the strengths and challenges of the implementation approaches taken.
develop ideas to enhance the implementation of future national vaccination programs.
Impact evaluation involves description and assessment of relevant data on disease burden, vaccine coverage, seroepidemiology and vaccine safety. This may include data from the National Notifiable Diseases Surveillance System, National Hospital Morbidity Database, the Adverse Events Management Database, Australian Immunisation Register, Australian Coordinating Registry (for deaths) and national serosurveillance data.
This involves estimation of the uptake of vaccine in targeted age groups.
This involves identification of changes in population seroepidemiology through the Australian national serosurvey program. Inclusion of seroepidemiology in NIP evaluations varies depending on the disease.
This involves description and assessment of adverse events following immunisation for a particular vaccine.
This involves evaluation of the impact of the vaccination program on disease. Core components include:
calculation of vaccine effectiveness and identification of vaccine failures
assessment of changes in disease notification, hospitalisation and mortality rates
identification of changes in the epidemiology of a disease over time, including overall incidence, age-specific and regional-specific incidence, as well as serotype/serogroup-specific and Indigenous-specific incidence, if appropriate.
Program evaluation cannot be conducted by NCIRS in isolation. It requires extensive collaboration and consultation with a broad range of stakeholders, including the Australian Government Department of Health, Communicable Diseases Network Australia, National Immunisation Committee, Australian Government Department of Human Services, Australian Institute of Health and Welfare, Therapeutic Goods Administration, the National Aboriginal Community Controlled Health Organisation, Primary Health Networks, state/territory health departments and others.
Haemophilus influenzae type b
Human papillomavirus (HPV)
National Measles Control Campaign, 1998 – completed in 2000 [Report] [Related paper]
Young Adult Measles, Mumps and Rubella (MMR) Campaign, 2001 – completed in 2003 [Related paper]
Introduction of measles-mumps-rubella-varicella (MMRV) vaccine on the National Immunisation Program – completed in 2016
National Indigenous Pneumococcal and Influenza Immunisation (NIPII) Program – completed in 2004
National Older Australians Adult Pneumococcal Immunisation Program – [Final report]
National Childhood Pneumococcal Immunisation Program – completed in 2009
Introduction of 13vPCV on the National Immunisation Program – completed in 2015
Review of school-based vaccination in Australia – completed in 2011 [Related paper]
National Shingles Vaccination Program: process and early impact evaluation – completed in 2018 [Final report]
National Varicella Vaccination Program – completed in 2011 [Related paper] [Related paper]
Implementation of the 13-valent pneumococcal vaccine supplementary dose program on the New South Wales North Coast – completed in 2012 [Related paper]
Effectiveness of the New South Wales pertussis vaccine ‘cocooning’ strategy – completed in 2013 [Related paper]
New South Wales Aboriginal Immunisation Healthcare Worker Program – Stage 1 – completed in 2015 [Final report]
BCG vaccination programs in Australia – completed in 2016 [Final report]
New South Wales Aboriginal Immunisation Health Care Worker Program – Stage 2 – completed in 2017 [Final report]
NSW Meningococcal W Response Program– completed in 2018
NCIRS, Kids Research, Sydney Children’s Hospitals Network, Cnr Hawkesbury Rd & Hainsworth St, Westmead Locked Bag 4001, Westmead NSW 2145 Tel (612) 9845 1433 | Fax (612) 9845 1418 | ABN 53 188 579 090
We acknowledge that the National Centre for Immunisation Research and Surveillance (NCIRS) is on the land of the traditional owners the Aboriginal and Torres Strait Islander peoples, the First Australians, and recognise their culture, history, diversity and their deep connection to the land. Together, through research and partnership, we aim to move to a place of equity for all. NCIRS also acknowledges and pays respect to other Aboriginal and Torres Strait Islander nations from which our research, staff and community are drawn.
Copyright © 2021 NCIRS. All rights reserved
Our website meets the criteria for credibility and content as defined by the Global Advisory Committee on Vaccine Safety.
Stay updated with the latest from NCIRS