Assessment of Registration Practices:
Progress and Problems in 2013–14
Office of the Fairness Commissioner
ISBN 978-1-4606-4960-2 (HTML)
ISBN 978-1-4606-4961-9 (PDF)
Message from the Commissioner
I am pleased to present the results of my office’s most recent assessment of licensing in Ontario’s regulatory bodies. The 2013–14 assessment was a rigorous and detail-oriented process that occupied my staff for well over a year.
As I have noted in the past, I do see progress. Regulators are removing unnecessary barriers and some applicants have faster, fairer and more efficient experiences getting their professional licences. Many regulators are implementing the recommendations we have made.
But improvement is slow – too slow. I am disappointed that this assessment unearthed serious problems.
The public debate about the fate of internationally educated professionals in Ontario is becoming more and more urgent. Taxi-driving engineers were heartbreaking a few years ago; now they are a cliché. Internationally educated nurses are frustrated with the licensing process here; American recruiters, knowing of obstacles in Ontario, are openly trying to attract them.
Informed observers are more and more impatient with the existing ways of doing things. Their frustration is understandable:
- The evidence about the unemployment and underemployment of internationally trained professionals is mounting.
- On the difficult issues, public policy seems to favour the status quo.
- Regulators for the professions are not fully grasping their legal obligations.
It is in the public interest that licensing in Ontario become fairer and faster.
I am convinced that our systematic assessments contribute to improvements that will enhance access to the professions. My staff and I are pursuing these findings with provincial ministers and the regulatory bodies themselves.
Hon. Jean Augustine, PC, CM
In 2013–14, the Office of the Fairness Commissioner (OFC) undertook its second cycle of assessments of the practices that Ontario’s regulatory bodies follow for licensing people to practise their professions in Ontario. These assessments are part of the OFC’s strategy for continuous improvement, designed to improve fair access to the professions for all qualified applicants.
These assessments consisted of targeted assessments, focusing on areas of weakness previously identified in the 2011–12 full assessments.
The OFC learned a great deal through the 2011–12 assessment process, and adjusted its strategy and its assessment methods. And regulators made many improvements, implementing hundreds of the OFC’s recommendations. Because of these changes, and because the 2013–14 assessments targeted specific areas, the OFC was positioned to probe more deeply, and to focus more strongly on the transparency of regulators’ practices and on their capacity to provide evidence.
The 2013–14 assessments showed progress in many areas. As demonstrated by the 167 commendable practices the OFC identified, regulators are working diligently to improve their practices.
However, the OFC also made 247 recommendations for improvement. Clearly, problems persist, especially in areas related to:
- fairness of registration requirements
- quality of assessments and registration decisions
- access to records
There may be some underlying reasons for the persistence of these problems, such as:
- inadequate understanding by regulators of their fair-access obligations
- inadequate strategies for getting and learning from feedback provided by applicants and the public
- lack of motivation to change
- differences in legislated oversight among the various regulators, and especially between health and non-health regulators
- lack of sustainable government funding for fair-access initiatives
The assessments confirmed the need for ongoing vigilance, continuing and rigorous assessment, and the OFC’s strategy for continuous improvement. The OFC will continue to advocate for necessary change, to help enable all qualified applicants to put their skills and knowledge into practice.
Purpose of this report
From May 2013 to September 2014, the Office of the Fairness Commissioner (OFC) assessed the registration practices (also called licensing practices) of 35 regulatory bodies that fall under its mandate. Of these 35, 34 were subject to a targeted assessment of certain practices.
This report shows trends in progress and problems that the OFC identified through the 34 targeted assessments. It does not describe all findings.
Overall, the assessments showed significant progress, but the OFC notes continuing problems, and a slow pace of improvement by some regulatory bodies.
Data in this report is current to September 30, 2014.
Organization of this report
The report is organized as follows:
Section 2 describes the background to this report, including the OFC’s strategy for continuous improvement, the assessments’ role in the strategy, the assessment process, and some results from the first assessment program.
Sections 3 to 6 discuss the trends in regulators’ improvements seen in the 2013–14 assessments:
Section 3 identifies reductions in recommendations and identifies commendable work.
Section 4 describes how regulators have made more information more accessible, and have provided greater transparency.
Section 5 discusses the development of more flexible registration pathways.
Section 6 describes improvements in training.
Sections 7 to 10 describe key areas where the 2013–14 assessments show that problems still exist:
Section 7 introduces the key areas and provides an overview of the assessment data in these areas.
Section 8 discusses problems related to the fairness of registration practices.
Section 9 discusses problems related to the quality of assessments and registration decisions.
Section 10 discusses problems related to applicants’ access to their records.
Section 11 explores five possible explanations for the persistence of the problems described in Sections 7–10.
Section 12 provides concluding remarks.
2. Background and methodology
The Office of the Fairness Commissioner (OFC) has a legislated
mandate to oversee the licensing practices of 42 regulatory bodies, to ensure that the practices comply with Ontario’s fair-access legislation:
- Fair Access to Regulated Professions and Compulsory Trades Act (FARPACTA)1
- associated amendments to the Regulated Health Professions Act (RHPA)2
Strategy for continuous improvement
To help fulfil this mandate, the OFC uses its
Strategy for Continuous Improvement of Registration Practices (April 2013).3
In accordance with the
Strategy, the OFC completes an assessment program it developed. The program includes, at fixed intervals (cycles), comprehensive assessments of regulatory bodies’ practices.
General and specific duties
The OFC’s assessments look objectively at the state of professional registration practices in Ontario at a point in time, measuring them against regulatory bodies’
general duty and
general duty is to have registration practices that are:
specific duties are to provide the following:
- information to applicants
- internal review or appeal processes
- information on appeal rights
- information about the documentation that applicants must submit to prove their qualifications
- transparent, objective, impartial and fair qualifications assessments
- training to their staff
- access for applicants to their own records
Regulatory bodies subject to FARPACTA also have a specific duty to provide timely decisions, responses and reasons.
The general-duty principles of transparency, objectivity, impartiality and fairness are not defined in the fair-access legislation. The OFC has published its interpretation of
The OFC translated the fair-access legislation into a series of about 70 clearly defined practices in the general-duty and specific-duty categories listed above that help to illustrate the practical application of the law. The OFC published them in two revised assessment guides in April 2013 – one for health regulators4 and one for non-health regulators.5 The OFC assesses regulatory bodies against the practices in these guides.
The assessment program is designed with the following goals in mind:
- to help regulatory bodies focus on continuously improving the way they register people who apply for licences for professions or trades in Ontario, by identifying areas for improvement and commendable practices
- to require regulatory bodies to commit to action aligned with meeting their obligations in the fair-access legislation
Revision and reporting
Following the completion of each assessment cycle, the OFC reviews its assessment program. During this review, the OFC identifies whether the assessment program is meetings its goals and reports to the public about its findings.
To date, there have been two assessment cycles:
- Cycle 1 began in September 2011 and was completed in August 2012.
- Cycle 2 began in May 2013 and was completed in September 2014.
Reporting of Cycle 1 results and revising the program
A Fair Way to Go
The OFC reported its findings about the 2011–12 assessment results in
A Fair Way to Go: Access to Ontario’s Regulated Professions and the Need to Embrace Newcomers in the Global Economy.6
Broadly speaking, the report found that regulators were working in good faith to follow their obligations under the fair-access law, but that they had a fair way to go.
The report noted 304 commendable practices among the various regulatory bodies and made 339 recommendations for improvement.
Revising the program
After the 2011–12 assessment, the OFC made various changes to the program, including recategorizing many of the positive practices in the April 2013 guides.
Achievements by regulatory bodies
In the cases where OFC made recommendations, regulatory bodies developed action plans to address the recommendations.
By the time of the 2013–14 assessments, the regulatory bodies had implemented 313 (92%) of the 339 recommendations that were made in 2011–12. The remaining 26 recommendations were carried over into the 2013–14 targeted-assessment results.
This achievement suggests that some of the areas for improvement identified in 2011–12 have been resolved. However, systemic change is slow and some issues persist.
The assessments also revealed:
- gaps in regulators' understanding of the law and fair-access principles
- underdeveloped ways of soliciting feedback from applicants
- a reluctant approach to transparency
Recognizing these weaknesses helped the OFC to position the 2013–14 assessments.
2013–14 Assessment program methodology
The OFC carried out its 2013–14 assessments from May 2013 to mid-September 2014. The assessment findings reflect the registration practices assessed at that point in time.
The OFC identified 35 regulatory bodies subject to participation. Of the 35, 34 were subject to a targeted assessment.7
The 2013–14 targeted assessments used a consistent process and the OFC’s assessment guides to assess regulatory bodies.
The OFC varied the scope of assessments for each two-year cycle, alternating full assessments with targeted assessments. The 2011–12 assessments were full assessments.
The 2013–14 assessments targeted each regulator’s problem areas. That is, a regulator's targeted assessment focused on categories of specific and general duties (in the appropriate April 2013 assessment guide) related to the OFC’s 2011–12 recommendations.
The process for each assessment was iterative. At various points during an assessment, the OFC motivated the regulatory body to provide current evidence that it was demonstrating the assessment-guide practices it was being assessed on.
If a regulatory body did not show enough evidence of demonstrating a practice in the 2013–14 assessment, the OFC made a recommendation to improve. If the body demonstrated a program, activity or strategy that went beyond the minimum set by the OFC assessment guides, the OFC noted this as a commendable practice.
With the information learned through the 2011–12 assessments and the regulatory bodies’ improvements, and because the 2013–14 assessments were
targeted assessments, the OFC was able to probe more precisely, more deeply, and more rigorously in the areas of weakness in the 2013–14 assessments, and with a stronger emphasis on transparency and the providing of clear evidence.
For similar reasons, and because of the revision of the assessment program and guides (including the recategorization of practices) after the 2011–12 assessment, the 2013–14 discussions are aligned differently from the discussions in A
Fair Way to Go.
3. Progress: Commendable practices and recommendations
Progress noted in the 2013–14 targeted assessments
The 2013–14 assessments reflect important progress. Regulatory bodies assessed show noticeable improvements in the areas where the OFC made recommendations in 2011–12:
- In total, 7 of the 348 (20%) regulatory bodies that were assessed in 2013–14 did not receive any recommendations at all:
- Royal College of Dental Surgeons of Ontario
- College of Early Childhood Educators
- Certified Management Accountants of Ontario
- College of Medical Laboratory Technologists of Ontario
- College of Midwives of Ontario
- College of Respiratory Therapists of Ontario
- Ontario College of Teachers
- In every practice category in the April 2013 assessment guides where recommendations were made in 2013–14, some regulators that were assessed in that category received no recommendations for improvement (see
Table 1). For example:
- Information for Applicants: 17 regulatory bodies were assessed in this category but only 5 received recommendations for improvement.
- Impartiality: 17 regulatory bodies were assessed but only 11 received recommendations.
- The OFC commended 31 regulatory bodies about 167 registration practices and added 44 of these practices to its
Database of Exemplary Practices, to share these examples with regulatory bodies that wish to improve their practices.
These statistics demonstrate significant progress during the past two years.
For more information about the overall breakdown of 2013–14 targeted assessment data, see
While 80% of regulators received recommendations for improvement, their progress is evident in the assessment findings.
Table 1: 2013–14 targeted assessment summary data
|Categories in the assessment guides
|Practices in the April 2013 assessment guidesa
|Regulators receiving recommendations
|Regulators recognized for commendable practices
|Practices in the OFC
Database of Exemplary Practices
|Information for Applicants
|Timely Decisions, Responses and Reasons
|Internal Review or Appeal
|Information on Appeal Rights
|Documentation of Qualifications
|Assessment of Qualifications
|Access to Records
a There are two assessment guides, with slight differences in their numbers of assessment practices and categories:
Registration Practices Assessment Guide — For Regulated Professions and Trades9 is for assessing the non-health professions and trades that are within the Fairness Commissioner's mandate.
Registration Practices Assessment Guide — For Health Regulatory Colleges10 is for assessing all health regulatory colleges.
The numbers in column 2 show the numbers of practices listed in the non-health guide, followed by the number of health-guide practices in parentheses. For example, column 2, row 1 (“Information for Applicants”) shows 4 practices for the non-health guide, and 3 for the health guide.
The health guide does not contain the category, “Timely Decisions, Responses and Reasons.”
b Some regulatory bodies were assessed in more than one category. Some of these bodies received recommendations for improvement and/or had commendable practices in more than one category.
Three positive trends
The following three sections discuss some positive trends in important areas, related to some of the issues raised in
A Fair Way to Go:
- more accessible information and greater transparency (Section 4)
- more flexible registration pathways (Section 5)
- better training (Section 6)
4. Progress: More accessible information and greater transparency
Many of the OFC’s 2011–12 recommendations addressed regulators’ incomplete or unclear information, and the transparency of their licensing processes. At that time, almost all regulators needed to improve their information for applicants about timelines, requirements, the licensing process, and the required documentation.
As a result, in 2013–14, 32 regulators were assessed on
transparency and 17 were assessed on
information for applicants (see
The improvement is evident.
Example: In 2013–14, the OFC made 101 recommendations to regulatory bodies to be more transparent and to provide better information to applicants,
half as many as in 2011–12, when it made 213 recommendations.
Types of improvement
Regulatory bodies are making more information available to applicants, and in a greater variety of ways. For example, many are:
- adding new information to their websites or reorganizing existing information to make it clearer and easier to find
- providing clearer information about how to request an appeal or review of a decision
- stating more clearly the rationales for their registration requirements
- improving the quality and quantity of information that they provide to all applicants, but especially those who are internationally educated
More regulatory bodies are also informing applicants about the steps in the registration process that can be completed outside Canada. Applicants from anywhere in the world are more likely to have access to clearer information about the registration process than they did in 2011–12.
Some regulators are using a variety of exemplary ways to provide information about:
- the registration process
- decisions, timelines, and documentation
- pre-arrival steps and other information specifically for internationally educated professionals
- resources designed to help applicants navigate the licensing steps
In the 2013–14 assessments, the OFC identified 27 exemplary ways of providing
information for applicants and applying
transparent registration practices (see
The OFC’s interpretation of
transparency requires a regulatory body to reveal its registration procedures so that others can see how the registration process operates.
Some regulators are being more open with applicants and the public about their registration practices.
One example of openness is in the practices of the College of Physiotherapists of Ontario (CPO). This regulator wants everyone to understand how certain processes work, and it does this by posting the following information on its website:
the materials that are reviewed and decided upon at council meetings – The website includes not only descriptive meeting updates and decision documents, but also all of the meeting materials that council members need. This allows applicants and the public to see the CPO’s approach to documenting, reviewing, updating and approving the policies that govern the CPO and affect registration.
A Day at the College of Physiotherapists – This video shows some sample cases from CPO committees, including the registration committee. The video discusses how the cases are reviewed, and their outcomes. It helps applicants and the public to understand the issues involved in the decision-making process.
Benefits of transparency
As regulators become more open about their processes, they are better able to manage the feedback they receive when they do not communicate effectively with applicants or give them enough information. A simple strategy for providing enough information can prevent time-consuming misunderstandings with applicants.
Being proactively open can also avoid any possibility of mistrust in a regulatory body’s ability to meet its obligations.
Also, as regulatory bodies become more open about their registration practices, they are more able to learn about the problems associated with weaknesses in their registration pathways, including:
- the rationales for registration requirements and assessment methods
- appeals processes
“The OFC’s recommendations aim at ensuring that all requirements are clearly aligned with the regulator’s public-protection mandate, that training from non-accredited institutions is appropriately accommodated, and that assessment methods do not set unnecessary barriers to licensing or disproportionately affect specific groups of applicants.”
A Fair Way to Go (OFC), page 39.
Ontario’s fair-access legislation has led to increasing openness to considering alternative pathways that individuals can use to demonstrate the competencies (the skills and knowledge) required for professional practice. Flexible registration pathways help to ensure fairness in licensing practices, by putting the focus on the competencies required to practise the profession.
The OFC’s 2011–12 recommendations showed that regulatory bodies needed to carefully review their licensing requirements and ensure that their assessment criteria were directly linked to these requirements.
The 2013–14 assessments show that some regulators have improved their information about requirements and have developed some alternatives and exemptions.
The Ontario Professional Foresters Association (OPFA) removed its requirement that 18 months of work experience must be gained in Ontario, recognizing that applicants may be able to show the required knowledge and skills through relevant work experience in other jurisdictions. To implement this change, the OPFA developed a policy document to identify for applicants and decision-makers the criteria for determining whether an applicant’s work experience can be applied towards the requirement.
Next steps will involve exploring alternative ways that applicants may address gaps in competencies.
The OPFA is clearly addressing the necessary connection between requirements and competencies, and the development of other methods of assessing qualifications.
Still, the OFC made recommendations for improvement to 14 of the 15 regulatory bodies that were assessed in 2013–14 on these
fairness practices (see
Table 1). Changes to licensing requirements are often slow-moving. In fact, the self-regulation model often leads to escalating requirements and protectionism.11
Qualifications assessment is another essential part of the licensing process, and one that frequently creates difficulties for internationally educated applicants. There are usually different ways to assess an applicant’s qualifications or competencies, and some alternatives provide greater flexibility than others.
In 2013–14, 26 regulatory bodies were assessed in their practices that relate specifically to
assessment of qualifications. While this area remains challenging for most regulatory bodies, 7 of the 26 regulatory bodies did not receive any recommendations in this area (see
Table 1). This means that these 7 regulators removed unnecessary barriers to applicants in the area of qualifications assessment.
However, issues remain. Having access to an
appeal of assessment decisions is an important part of fairness. While regulators may be providing clear information about how to appeal, applicants may still experience barriers, such as a lack of transparency about how to obtain records to prepare for their appeal. These problems are described further in
Besides the OPFA, many other regulatory bodies are doing commendable work to support flexible registration pathways.
In total, 61 of the 167 commendable practices identified in the 2013–14 assessments relate to flexible registration pathways.
Perhaps one of the reasons that these practices make up such a large number of the commendable practices is that these practices cover a wide range of topics – that is,
fairness in registration practices and the quality of
assessment of qualifications practices (see
More progress needed
Some regulators are improving registration pathways, but more can be done. In the 2013–14 assessments, the OFC made recommendations to 19 regulatory bodies that need to improve their
assessment of qualifications practices (see
Table 1). The OFC is still identifying persistent problems in areas related to flexible registration pathways. These problems will be discussed further in
Section 8 and
6. Progress: Better training
The fair-access law requires that those involved in the licensing of applicants be well-trained in their licensing roles.
“Training for decision-makers is critical to ensuring that they have a common understanding of licensing requirements and apply criteria consistently in their licensing decisions.”
A Fair Way to Go, page 41
Impartiality and objectivity
The OFC also assesses regulatory bodies on the training they provide to help decision-makers and assessors to be impartial and reduce bias.
Licensing involves high-stakes decisions that have a huge impact on an applicant’s career. Assessments and licensing decisions are often made by volunteer committees composed of members of the profession. As a result, there is a risk of real or perceived bias on the part of these decision-makers, who may not be trained as assessors and who may be acutely aware of their labour-market competition, particularly in challenging economic times.
In this context, it is important for regulatory bodies to offer rigorous training to assessors and decision-makers that reduces bias.
Improvements and commendable practices
The 2013–14 assessment findings show some continuous improvement in training.
Example: Almost half of the regulatory bodies that needed to improve their training related to reducing bias found ways to improve.
Also, the OFC noted commendable practices about the training that regulatory bodies provide for their registration staff, assessors and decision-makers.
The College of Respiratory Therapists of Ontario (CRTO) provides extensive training for council, committee and staff members on impartial and unbiased decision-making, with a strong emphasis on conflict of interest. The CRTO’s training includes:
- annual orientation on topics such as anti-discrimination, cultural competence, and ethical decision-making
- ongoing education in assessing qualifications, making and reviewing registration decisions, and dealing with special considerations
Its training efforts also include additional guidance, peer-training, and oversight on emerging issues in registration.
Need for further improvement
While some regulators are improving their training to reduce bias, there are still some persistent problems that relate to training to ensure the quality of assessment and registration decisions. These persistent problems are highlighted in
7. Problems persist
Although important progress has been made toward fair access to the professions, progress is often slow, and too many barriers remain.
The 2013–14 assessments revealed three key areas that are sources of persistent problems:
- fairness of registration requirements (see
- the quality of assessments and registration decisions (see
- access to records (see
Table 2 provides an overview of the data that relate to these problems most directly.
Table 2: Most persistent problems
|Three key areas of persistent problems
|Category in the April 2013 assessment guides
|Number of regulatory bodies assessed in 2013–14 because of problems identified in 2011–12
|Number of regulatory bodies receiving recommendations in 2013–14
|Percentage of regulatory bodies needing to improve
|Fairness of registration requirements
|Quality of assessment and registration decisions
|Assessment of Qualifications practices
|Enhancing access to records
Sections 8, 9 and 10 discuss the main persistent problems in these three areas.
8. Problem: Fairness of registration requirements
Of regulatory bodies that were assessed on the fairness of their registration requirements in 2013–14, 93% (14 of 15) need to improve (see
Fairness of registration requirements is a critical area of fair access, and it is one where the assessments show the need for significant improvement.
In particular, improvement is needed in:
Developing defensible rationales for registration requirements
The OFC has long identified the need for regulators to explain and justify the necessity and relevance of all registration requirements.
In 2011–12, the OFC recommended that regulatory bodies provide public rationales for registration requirements that can have a different impact on certain groups of applicants. When regulatory bodies provided their rationales, the OFC was largely unconvinced that these rationales were defensible. The rationales that were particularly weak were those that required Canadian work experience or practical training.
Canadian-experience requirement means that applicants must undergo a period of practical training or work experience in Canada (or Ontario) related to the profession or trade, in order to be deemed eligible to apply for a licence to practise in Ontario. This requirement is a particular focus for the OFC because it contributes to the systemic disadvantage of internationally educated applicants applying for a licence to practise a profession or trade in Ontario.
Fourteen regulators12 require applicants to undergo a period of practical experience in Ontario or Canada, usually ranging from 6 to 18 months. These requirements have changed very little between the 2011–12 and 2013–14 assessments:
- 13 of these regulators have an unchanged requirement for Canadian work experience or practical training.
- 1 (foresters) has developed an
Organizations such as the Ontario Human Rights Commission (OHRC) are also unconvinced about the rationale of requirements for Canadian work experience or practical training. In February 2013, the OHRC approved its
Policy on Removing the “Canadian Experience” Barrier, which called on regulators to justify or remove Canadian-experience requirements, or to develop alternative ways to evaluate internationally obtained experience.13
The position of the Ontario Human Rights Commission is that a strict requirement for “Canadian experience” is discrimination and can only be used in very limited circumstances. The onus is on regulatory bodies to show why a requirement for Canadian work experience is needed.
In its 2013–14 assessments, the OFC made 25 recommendations – more pointed than the 2011–12 recommendations – for regulators to identify the competencies associated with existing requirements for Canadian work experience or practical training.
For some regulators, altering a Canadian-experience requirement or developing flexible pathways for meeting it is tied to the agreement of multiple stakeholders.
In the engineering context, agreement across provinces is required. Provincial regulators have been working together at a national level to identify possible alternatives to their shared requirement for one year of work experience in Canada.
For physicians, collaboration between government, regulators, and assessors is necessary to offering viable alternatives to Canadian residency training.
To become licensed in Ontario, most immigrant physicians must complete residency training in Canada. About 2,000 applicants compete each year for the 200 Ontario residency positions reserved for international medical graduates. For these graduates, the OFC has urged the College of Physicians and Surgeons of Ontario (CPSO) to explore alternative routes to licensing, to ensure that qualified applicants have fair opportunity to fulfil licensing requirements. In particular, the OFC has called for practice-ready assessment and training positions.
Many other jurisdictions, from Australia to Alberta, have used provisional licensing and practice-ready assessment to facilitate licensing for internationally educated physicians, while ensuring that competency standards are met. The Canadian medical regulatory community has invested considerable time and resources in developing national standards for practice-ready assessment, with participation and leadership from CPSO. British Columbia recently announced the launch of 20 new practice-ready positions in family medicine,14 but Ontario has yet to make a commitment. Ministry of Health funding is required to open practice-ready positions in Ontario.
The OFC continues dialogue with CPSO and the Ministry of Health and Long-Term Care about creating practice-ready assessment opportunities in Ontario.
Supply and demand and employers’ preferences
From a fair-access perspective, supply and demand should not dictate licensing requirements, nor should employer preferences. In the 2013–14 assessments, it is troubling to note a tendency by regulators to align licensing requirements with employer preferences, without engaging in a deeper analysis of the relevance and necessity of those requirements to practising the profession.
Example: Engineering Technicians/Technologists and Engineers
In 2011, both the Ontario Association of Certified Engineering Technicians and Technologists (OACETT)15 and Professional Engineers Ontario (PEO)16 cited employer preferences in arguing that Canadian experience was necessary to maintain the value of their professional designation.
With the OHRC policy challenging both employers and regulators to revisit their position on Canadian experience, OACETT and PEO are reviewing their requirement, identifying the associated competencies, and exploring alternative ways that internationally educated applicants might develop or demonstrate those required competencies.
The role of regulatory bodies is to protect the public interest, not the interest of their profession or members. Nevertheless, professional self-interest (protectionism) is commonly identified as an inherent weakness in self-regulation. The examples above attest to the risk of protectionism by regulatory bodies. The examples also reflect the deep-rooted shift in perspective that is needed, from
raising the stature of the profession to
protecting the public.
The OFC expects all regulatory bodies to have rationales that will explain the necessity and relevance of each registration requirement for public protection. Even if a regulatory body has a rationale for its requirements, it may be weak. The OFC tests the quality of the regulatory bodies’ rationales, by requiring the regulatory bodies to identify the strength of the connection of their registration requirements to the competencies needed for safe and competent practice.
In addition to assuring applicants that regulators’ requirements are necessary and relevant to ensuring that safe and competent practitioners are licensed, the OFC assesses whether a regulator’s requirements for licensing will unnecessarily exclude certain groups of applicants.
It is crucial that every regulatory body critically review the necessity and relevance of all registration requirements. Defensible requirements make a logical connection to specific competencies needed to practise the profession safely. By examining the connection, a regulatory body can also identify whether these requirements are still necessary or relevant.
Regular review can open up the possibility of developing other ways of demonstrating competencies. It is only when the regulatory body demonstrates the connection between the competencies and the registration requirement that it can identify acceptable alternatives to meeting the registration requirement.
In the 2013–14 assessments, the OFC was more vigilant about requirements than in the 2011–12 assessments. OFC assessors asked for rationales for requirements and for evidence where they assessed for fairness.
Recognizing acceptable alternatives
The 2013–14 assessments reinforced the 2011–12 findings about the need for acceptable alternatives.
It is important for regulatory bodies to establish and maintain flexible pathways for meeting their registration requirements. These pathways help to ensure that all people, regardless of where they were educated, have equal opportunity to demonstrate their qualifications and competencies. Where gaps exist in an applicant’s competencies, these alternative pathways may allow the applicant to more effectively achieve competencies without repeating a full program of academic training.
For example, some regulatory bodies offer pathways that enable applicants to take a series of assessments or certain exams as an alternative way to meet an education requirement.
Sustainability and accessibility
But these opportunities may disappear when a regulatory body cannot sustain them or offer them often enough, or if they become too costly for applicants.
For example, some pathways are too resource-intensive for a regulatory body to maintain.
Example: Massage Therapists and Respiratory Therapists
The College of Massage Therapists of Ontario and the College of Respiratory Therapists of Ontario have expressed the difficulties they face in sustaining alternative pathways for internationally educated applicants.17
Certain pathways may be difficult for some individuals to access because the pathway may be offered only once a year, or in only one location, or it may accept only a certain number of individuals.
Also, the pathway may be expensive for the applicant: Certain equivalency exams or bridging programs can cost applicants several thousand dollars, and may help them to meet only one requirement.
York University’s bridging program for internationally educated nurses, “Bachelor of Science in Nursing for Internationally Educated Nurses,”
18 is an acceptable alternative to meeting the education requirement set by the College of Nurses of Ontario (CNO).
However, the bridging program requires the applicant to spend a significant amount of time and money. For example, the program:
- is not flexible and requires individuals to take all of the courses listed, even if the CNO has identified only a few competency gaps
- takes 20 months (fulltime) to complete and costs the applicant approximately $12,000
- is available only to applicants who have been evaluated for a Registered Nurse licence by the CNO. This means that applicants must apply to the CNO and undergo an assessment of their education and spend additional time and money to understand whether they will need to complete this bridging program or are even eligible.
- helps individuals to complete just one of several requirements for a Registered Nurse licence in Ontario
Compared to domestic graduates, internationally educated nurses face extra costs for qualifications assessment, and have limited access to alternative pathways to meet the gaps identified in their education and other related competencies.
The OFC made various recommendations in the
2013–14 CNO assessment report to help applicants understand this bridging-program pathway more thoroughly.
The OFC continues to influence regulatory bodies to develop accessible, affordable and sustainable alternative pathways for applicants to meet requirements for licensing. It also continues to advocate that the Ontario government provide guidance and oversight for regulatory bodies where there is a lack of financial resources to implement or sustain alternative pathways to licensing.
Bridging programs depend highly on project funding from the Ministry of Citizenship, Immigration and International Trade (MCIIT) and the Ministry of Training, Colleges and Universities (MTCU). The OFC continues to encourage these ministries to provide sustainable funding for bridging programs.
Applicants also depend highly on financial aid through the Ontario Bridging Participant Assistance Program (funded by the MCIIT). This program offers some support to applicants and does not address the costs of any prior learning assessments or exams. The OFC encourages the broadening of this program.
9. Problem: Quality of assessments and decisions
Of regulatory bodies that were assessed on their assessment of qualifications practices in 2013–14, 73% (19 of 26) need to improve (see
Regulatory bodies are accountable for all the decisions they make about an applicant’s qualifications for licensing. The quality of a regulatory body’s assessment and decision-making processes has a tremendous impact on whether an applicant will be licensed to practise or not.
Ensuring high-quality assessments and decisions involves:
Developing assessment criteria linked to competencies
Regulatory bodies must connect their registration requirements to the competencies necessary to enter their professions (see
Section 8). But regulatory bodies must also ensure that the methodology they use to evaluate competencies allows applicants to demonstrate those competencies. The methods must be appropriate.
Developing these various connections may require a regulatory body to map its assessments to its competencies or standards for entering the profession. Making these connections helps the body to determine whether applicants are demonstrating the same competencies over and over in different assessments, or whether each particular way of assessing is actually assessing a different competency.
Lack of connections
Based on the OFC’s 2013–14 assessments, the lack of clear connections between how regulatory bodies assess and the competencies necessary to practise remains an area of weakness.
Of the regulatory bodies assessed on their assessment of qualifications, 38% could not explain how their assessment criteria were linked to the competencies required to practise the profession or to explain the connection to applicants.
Even though many regulatory bodies have developed their profession’s competency frameworks, not all of them are doing a good job of connecting competencies to the assessment methods and criteria.
If a connection is not evident or established:
- The assessment method may not provide accurate evidence of an applicant’s competencies.
- The assessment itself may be unnecessary.
The 2013–14 assessment report noted that the College of Nurses of Ontario (CNO) may determine that an applicant’s nursing education is inadequate. When this happens, the CNO helps applicants identify the competency gaps in their nursing education.19 It assesses an applicant according to the type of nurse the applicant is applying to become and whether the applicant has provided evidence of nursing practice with his or her application. For Registered Nurse (RN) applicants, the evidence of nursing practice can be determined through one of the following pathways:
- completing an approved program within the last three years
- demonstrating practice experience
- undergoing an evaluation approved by the CNO and successfully completing any additional training, experience, exams or assessments identified by that evaluation
Most internationally educated nurses (IENs) take the third pathway and undergo an evaluation called the IEN Competency Assessment Program (IENCAP), administered by the Centre for the Evaluation of Health Professionals Educated Abroad (CEHPEA). The IENCAP is a standardized exam that tests the knowledge, skills and communication abilities of an internationally educated RN.20
What is not clear to the OFC is how the CNO uses the results of IENCAP to understand an applicant’s competency gaps. It is not clear whether the CNO accepts results at face value, as submitted by CEHPEA, or whether the CNO conducts its own further assessment of the results.
The CNO has not yet established a clear connection between this assessment method, the CNO’s registration requirements, and the necessary competencies. Where a connection is not obvious or not established, it is difficult to defend the quality of the CNO’s assessment decisions as a valid and reliable measure of testing competencies necessary to practise the profession, or even whether certain elements of the assessment are necessary.
For example, it is unclear why the IENCAP includes an assessment of self-regulation and ethics, when all applicants are required to complete a separate jurisprudence exam.
This lack of clarity may also lead applicants undergoing the IENCAP or members of the public to believe that the assessment process is unnecessarily repetitive for certain groups of applicants.
The OFC continues to challenge regulatory bodies to ensure clearly established connections between the competencies necessary for licensing and the assessment methods used to measure these competencies.
The OFC also always encourages the streamlining of qualifications assessment processes. Regulatory bodies should determine which competencies are being assessed in multiple ways, and justify this.
For example, communication competencies may be tested through a standardized language test, or informally during a written or practical exam, an interview, or a prior learning assessment.
How many times and in what ways must all applicants’ communication competencies be assessed to ensure public protection? Reviewing assessment methods with this question in mind may help to streamline qualifications assessment processes.
Ensuring the validity and reliability of assessment methods
The OFC’s understanding of the fair-access principle of “objectivity” involves
This means that objective decision-making requires that not only the criteria but also the tools, training and procedures used enable a regulatory body to measure what it intends to measure, and to do so consistently.
Regulatory bodies need to have, and be able to demonstrate to the public and applicants, methods for assessing applicants that are valid and reliable.
In 2013–14, 27% of regulatory bodies that were assessed by the OFC on their assessment of qualifications
could not provide enough evidence that they had reviewed their methods for validity and reliability.
Assessing an applicant’s competencies by using a method that has not been reviewed for validity or reliability is a huge risk to the public interest. The risk is that regulatory bodies are making decisions based on assessment outcomes that may not be:
- reliably reflecting an applicant’s competencies
- validly measuring the competencies that the regulatory body is actually hoping to measure
If the assessments are not reliable or valid:
- The public may be at risk. Assessment methods are mechanisms to protect the public, by requiring applicants to demonstrate their competencies to practise the professions safely.
- Qualified applicants may not get the recognition they deserve or may undergo assessments that are not needed.
Valid and reliable ways of assessing applicants’ qualifications protect the public from incompetent practitioners
and ensure fair access.
Barriers to improvement
Changing assessment methods and procedures is a very demanding exercise that may require substantial resources and stakeholder engagement. As a result, making changes may prove challenging for regulatory bodies with limited resources. Further, regulatory bodies may prefer the comfort of the status quo and may feel discomfort when external agencies, such as the OFC or psychometric experts, suggest changes to their assessment criteria or procedures.
But despite a lack of resources or organizational discomfort, it is crucial for all regulatory bodies to continuously assess the validity and reliability of the assessment methods they use to determine licensing.
Ensuring the impartiality of decision-making
Impartial decision-making requires that decision-makers be adequately trained and that strategies be in place to address any potential for bias.
In 2013–14, the OFC made recommendations for improvement to 65% of the regulatory bodies that were assessed for impartiality (see
During the 2013–14 assessments, many regulatory bodies found it difficult to explain the steps they took to ensure that they were implementing impartial practices.
Certain assessment methods are more vulnerable to allowing bias than others. For example, the OFC is concerned about the heightened risk of bias and discrimination associated with oral assessment methods, especially unstructured interviews.
In its assessment of the Association of Ontario Land Surveyors (AOLS), the OFC recommended developing a more structured approach to the competency interview that is part of the academic evaluation process for internationally educated applicants, in order to ensure consistent and objective and impartial decision-making. This reduces the potential for bias to creep into the decision-making process.
Where interviews are used to arrive at an assessment or registration decision, regulators should consult with an assessment expert, who can:
- review whether the interview method is appropriate
- advise on ways of structuring the interview to ensure that the questions, process, and scoring are transparent, objective, impartial and fair
In the 2013–14 assessments, deeper probing revealed that training for impartiality is critical. To minimize the risk of bias, assessors, staff, and decision-makers should be trained to:
- be aware of sources of bias
- identify their own potential for bias, and take appropriate action if they identify themselves as biased
- understand the criteria, tools, processes and procedures that are used in their roles
While most regulators have training procedures for addressing potential bias resulting from conflict of interest, that is only one source of bias. This is why the OFC continues to challenge regulatory bodies to identify sources of bias and develop strategies to reduce bias in assessment and decision-making processes.
Ensuring the accountability of qualifications assessment agencies
Most regulatory bodies outsource various licensing steps to external organizations (third parties), such as World Education Services or a national body for the profession. These organizations:
- assess academic credentials
- administer exams
- assess competency or prior learning
These third parties operate outside of the OFC’s direct oversight. However, the fair-access law holds regulatory bodies accountable for their decision to use third-party processes.21 Regulators bear legal responsibility for licensing decisions, and must ensure that any third parties they rely on comply with fair-access principles. The OFC requires all regulatory bodies to ensure that the third parties they use have transparent, objective, impartial and fair assessment practices.
In 2013–14, 31% of regulatory bodies assessed regarding third-party assessments did not demonstrate adequate measures to hold their third parties accountable for having transparent, objective, impartial and fair practices. The number of regulatory bodies receiving recommendations in this area is
higher than in 2011–12.
Many internationally trained law applicants have been unable to meet the requirements set by the National Committee on Accreditation (NCA), the body that assesses the qualifications of internationally trained lawyers. In its 2013–14 assessment, the OFC identified that the Law Society of Upper Canada has a responsibility, as the provincial licensing body, to ensure that the NCA has transparent, objective, impartial and fair registration practices.
Using third parties can be very beneficial. It can:
- facilitate labour mobility
- improve the quality of assessments
- streamline licensing costs
However, without effective strategies in place to ensure that third parties are complying with province-specific laws, Ontario regulators may subject applicants to unnecessary hurdles in parts of the licensing process.
This is why the OFC continues to challenge regulatory bodies to develop effective measures to ensure that third parties’ practices comply with fair-access principles.
The fair-access law requires qualifications assessments that are transparent, objective, impartial and fair
Regulators must ensure that any third-party assessments are transparent, objective, impartial and fair
The OFC assesses regulators on whether they have effective measures in place to do this
10. Problem: Access to records
Providing access to records should be a fairly easy practice for regulators to demonstrate to the OFC. However, the OFC is still making a substantial number of recommendations in this transparency-related area. In 2013–14, the OFC made recommendations for improvement to 12 regulatory bodies that needed to enhance transparency regarding document retention and applicants’ access to their records.
This may suggest either that these regulatory bodies do not see this practice as a priority or that they may not have procedures in place to enable access to records. Without a structure or procedures in place, it may be difficult for a regulatory body to provide information about how applicants may access their records. A regulatory body’s reluctance to provide this type of information may indicate other gaps in its procedures.
When an applicant has difficulty gaining access to the information needed to understand procedures or reasons for limiting access to their records, he or she may think a regulatory body is trying to hide unfair practices.
The Institute of Chartered Accountants of Ontario (ICAO), also known as CPA Ontario, provides information about access to records, but the information is scattered among different resources.
In addition, it is not stated clearly that applicants cannot access all of their records or why this is so.
For example, ICAO does not tell applicants that they may not access their exam responses, once submitted, or tell them why. Without this information, applicants may perceive that the ICAO has practices it wishes to hide from them or the public.
Transparency about these practices would also help maintain confidence in the objectivity of the exam process. Further, if the ICAO’s information included alternative solutions for access, applicants would be better able to access that information.
It is an important part of transparent and fair registration practices that applicants can access their records, including their application and supporting documents. Access to these records can help an applicant to understand a decision, build an appeal case, and maintain access to documents that are difficult or costly to obtain (for example, official translations, credential or education documents, prior learning assessments, competency-gap reports, or portfolio submissions).
For these reasons, the OFC continues to make recommendations about enhancing access to records.
11. Explanations for persistent problems
Following are five possible explanations for the persistence of the problems outlined in Sections 7–10.
1. Inadequate understanding
If regulators do not understand the OFC’s interpretation of the law and its expectations for regulatory bodies, they may not see a need to change.
Others may be clear about the expectations but may not know what actions they could take to improve their processes. For example, some regulatory bodies may understand that they are accountable for ensuring that their third parties are transparent, objective, impartial and fair, but may not be sure how to monitor this or how to go about developing a good accountability mechanism.
Currently, training opportunities about the fair-access law are limited. For this reason, the OFC is developing online learning modules to ensure that regulatory bodies have greater access to the required training. The OFC expects that if regulatory bodies have greater access to training in the objectives of the fair-access law, more of them will be able to demonstrate fair practices.
The OFC will continue to educate regulators, through resources or activities, to help them understand the OFC’s expectations.
2. Inadequate public-participation strategies
Some regulators may not solicit feedback about their processes from their applicants or the broader public.
By limiting the opportunities for applicants to provide feedback on their experience, regulators may be limiting their own understanding of the problems in their registration processes.
Participation by the broader public is also valuable, enabling a regulator to understand public perspectives. Consultation can also enable public trust. In addition, if members of the public are more involved, they will be more alert to regulatory actions that are not in the public interest.22
The OFC will continue to challenge regulatory bodies to collect feedback from applicants about their experience in the licensing process.
3. Lack of motivation to change
A small number of regulatory bodies are not motivated to change their registration practices, even though their practices may create unnecessary hurdles for applicants. Some regulatory bodies challenge some of the OFC’s fair-access recommendations, or even its right to suggest or demand changes.
Motivating change in organizational behaviour and enforcing compliance presents challenges, given the current licensing system.
4. Differences in legislated oversight
The OFC does not have the authority to enforce compliance evenly among the regulatory bodies it oversees. There are differences in external appeals mechanisms, public reporting, timeliness expectations, and records and transparency requirements between the health and non-health regulators. Although the government has committed to addressing some of these differences, the changes are not yet in place.
The fair-access law requires that all regulatory bodies ensure that their registration practices adhere to the same four principles of transparency, objectivity, impartiality and fairness. The regulatory bodies must work in the public’s interest.
However, there are differences in the checks and balances in place to ensure that each regulatory body is acting in the public interest. For example, some regulatory bodies have very few public representatives on their councils. Also, different regulatory bodies have different levels of oversight by the ministries they are responsible to. These differences may increase the risk of self-interested behaviours in the regulatory bodies.
An important role for government lies in strengthening checks on self-interested action that may occur in self-regulating professions.23 The fair-access law serves as an important check on self-interested action, but this does not mean that challenges related to government oversight will fade away.
Some regulatory bodies are ambivalent about the fair-access law. Some may still hold an organizational belief that a regulatory body is completely autonomous. In fact, a self-regulated profession is only autonomous within the limits of its legislated role to act in the public interest.
The OFC will continue to express its concerns and propose recommendations that the Ontario government:
- ensure that each regulator subject to the fair-access law faces equivalent consequences for inaction and non-compliance
- resolve differences in external appeals mechanisms, public reporting, timeliness expectations, and records and transparency requirements between the health and non-health regulators
- require a larger representation of members of the public in the regulatory bodies’ decision-making processes
5. Lack of sustainable government funding for fair-access initiatives
Some regulators may not have enough resources to address fair-access problems on their own. Implementing changes to address persistent problems may be expensive, time-consuming and complicated.
Alternative pathways often bring needed flexibility to the licensing process, but only if these pathways are sustainable over a long term for regulators, and affordable and accessible for applicants.
Despite access to a range of acceptable alternatives for meeting experience or academic requirements, internationally educated professionals still experience delays and costs as they work to demonstrate equivalency of qualifications. Delays may occur because of a change in the sustainability of a pathway. For example, bridging programs designed to reduce hurdles are often subject to inconsistent or unreliable funding.
The OFC will continue to advocate that the government fund more alternative pathways to licensing, such as bridging programs.
Continuing improvement and persistent problems
The 2013–14 assessment findings show that regulatory bodies continue to improve their practices. They provide clearer information about registration requirements, alternative pathways, timelines, documents required, and qualifications’ assessment practices. Some have developed new alternative pathways and have publicly documented their rationales for registration requirements.
Overall, regulatory bodies were better positioned to be assessed with greater scrutiny in 2013–14, because they had improved their practices since 2011–12.
As a consequence, the OFC had a higher expectation for transparency and for the evidence it required.
A higher expectation for transparency in registration practices uncovered more complex and persistent problems (see Sections 7 to 10).
Wide range of licensing approaches
To date, there are no established standards or preferred approaches for licensing that all regulatory bodies adhere to. As a result, there is great variety among the various regulators in areas such as:
- the initial application process
- requirements for the format and content of educational documents that applicants need to submit
- the scope of an appeal
- the approach to orienting decision-makers
As a result of this variety, there are also many ways in which duplication and barriers to licensing can arise. Some of these barriers are complex, and addressing them may require time, resources and multi-stakeholder partnerships.
Learning from commendable practices
Regulatory bodies look to each other to learn different approaches to licensing practices and strategies for their work. The OFC continues to provide information about commendable or
exemplary work that regulatory bodies are doing, to help other regulators that want to improve their own practices.
Using multi-stakeholder strategies
Strategies that include multi-stakeholder partnerships may have the most potential for streamlining and reducing unnecessary burdens for applicants. Many of the persistent problems – from mapping competencies to implementing alternative pathways – require regulators, government and other partners to help implement change successfully.
What the OFC has learned from the 2013–14 assessments will help inform its approach to the next cycle of assessments.
The 2013–14 assessment of registration practices confirmed the importance to the OFC of ongoing vigilance, rigorous assessment, and the value of its strategy for continuous improvement.
The OFC maintains its resolve to work with all stakeholders – regulators, government, third-party agencies, applicants, and the public – toward registration practices that are transparent, objective, impartial and fair for all applicants in Ontario.
Notes and references