Under the Royal Military College of Canada (RMC) Institutional Quality Assurance Process (IQAP), this Final Assessment Report (FAR) provides a synthesis of the external evaluation and internal response and assessments of the graduate programs offered by the Faculty of Science in M.Sc. Physics and PhD Physics. This report identifies the significant strengths of the programs, along with opportunities for improvement and enhancement, and sets out and prioritizes the recommendations selected for implementation.
This report includes an Implementation Plan that identifies who will be responsible for approving the recommendations set out in the Final Assessment Report; who will be responsible for providing any resources entailed by those recommendations; any changes in organization, policy or governance that will be necessary to meet the recommendations and who will be responsible for acting on those recommendations; and timelines for acting on and monitoring the implementation of those recommendations.
Overview of Program Review Process
The Program Self-Study Report was completed in July 2022. For the programs under review M.Sc. Physics and PhD. Physics, the report contained the degree level expectations for these programs, an analytical assessment of the programs, course outlines, program-related data, survey data from the Office of Quality Assurance and appendices with sample examinations and CVs of faculty members. Two arm's-length external reviewers (Jean-François Bisson, PhD, Département de physique et d’astronomie, Université de Moncton and Marek Stastna, PhD Department of Applied Mathematics, University of Waterloo) were selected from a list of possible reviewers and approved by the Deans of Science. An internal reviewer, Dr Francis Okou from the Faculty of Engineering, was also selected for participation in the ERC. They reviewed the self-study documentation and conducted an on-site visit to RMC from 18 to 19 October 2022. During the site visit, the ERC met with the VP (Academic), the Director of Quality
Assurance, the Dean of Science, the Dean of Graduate Studies, the Head of the physics department and program chair, both the military and civil faculty members as groups, laboratory technicians, alums, students registered in the programs under study, the librarian-in-chief, the Head of the Writing Centre, the acting VP (Research), and the VP (Indigenous Learning and Knowledge).
The reviewers submitted their report on 30 November 2022. In their report, the ERC implies that the graduate programs in Physics at RMC are on par with similar programs offered in comparable Canadian institutions.
Significant Strengths and Weaknesses of the Program:
The ERC identified several strengths of the graduate programs in Physics:
- Availability of lab equipment (both in the amount of material and its research uniqueness, e.g., satellite ground station S-Band antenna, optical material manufacturing facilities);
- Research active groups;
- Access to military data, military-themed problems and military funding streams; and
- Many well-developed, unique niches in the applied research landscape include Acoustics and Oceanography, Space Surveillance Research and Analysis Laboratory, Satellite missions, and Optical Material manufacturing.
The ERC identified some areas of concern for the graduate programs in Physics:
- Poor connectivity and poor access to computing resources;
- Significant research effort expended away from RMC (e.g., at Queen’s);
- Under-utilization of lab facilities by students coupled with the small number of graduate students: the number of M.Sc. graduates from 2017-2018 to 2021-2022 is 6,2,3,4,2; the number of PhD graduates is 0,0,1,1,0);
- No clear strategy for attaining graduate-level skills in computing and computational physics;
- Limited examples of internal collaborations among faculty members. (However, there is an interdepartmental and international initiative for a project to design a Cubesat for space weather prediction for the protection of CAF and allied space assets (cf. self-study, p.22)); and
- Lack of industrial partners and a system for finding partners for R&D projects.
The Program Chair, after consultation with Faculty and staff in the programs, submitted a response to the ERC Report in March 2023. The Dean of Graduate Studies prepared this Final Assessment Report on 9 August 2023. We present the specific recommendations, the follow-up actions and associated timelines.
Summary of the Reviewers’ Recommendations with the Program’s and Dean’s Responses
The ERC identified several areas of concern or issues that require attention. The areas of concern are presented in the order they appear in the ERC Report:
Recommendations 1
Significantly improve connectivity and access to computing resources. This is an URGENT recommendation. (The creation of the Research Defence Institute as a separate entity not constrained by the same security rules as the other parts of the institution, introduced to us by Mr Jolicoeur, could be a promising tool to improve both the connectivity and access to computer resources, eliminate administrative hurdles in hiring international graduate students, foster collaborations with the industry, and increase knowledge mobilization and research visibility.)
Departmental Response
The Department agrees that improving connectivity and access to computing resources is critical. Although aspects of the problem are beyond departmental control, the Department Graduate Studies Committee (DGSC) will explore solutions to the issue in consultation with the Vice Principal (Research) in the context of Research Defence Institute policies and practices.
Dean’s Response:
The latest update received by the Deans in April 2023 indicated that the Statement of Work (SOW) for the implementation contract for the Research Instrument Operating Zone (RIOZ) between Shared Services Canada (SSC) and the approved CISCO vendor has yet to be signed. We expect the signed contract at the end of April 2023. SSC’s best estimate is to begin the implementation of RIOZ at the beginning of May 2023, with the backend and pilot systems completed over six (6) weeks. Full-scale implementation of the RIOZ is expected by mid-June 2023.
Regarding hiring international graduate students, RMC is a unit within the Department of National Defence that must abide by the security requirements established by the Government of Canada. Ergo, all non-DND employees or CAF members must have a security clearance to access the College's computer networks and establishment. Students from non-listed countries gain access to the network and site by completing a non-compliance request. The Commandant grants access as the risk acceptance authority.
VPR’s Response:
Our office is eagerly awaiting the implementation of RIOZ, which should resolve connectivity issues for College researchers. After several delays, we are informed that an implementation is imminent. We do everything possible to facilitate the implementation phase of this new system. That said, its entry into service does not depend on our administration.
For the hiring of international graduate students, we are in discussions with the College security team to facilitate the security clearance process. A new process was launched at the College in the spring of 2023. We are seeking to perfect this new process with the aim of accelerating the arrival and handling of foreign students while respecting the rules of the Canadian Department of National Defense.
Recommendation 2
Decrease the number of required courses from four (4) to three (3) in the M.Sc. (thesis track) and PhD programs. The freed-up space in the students' schedule could be used for short courses by visiting scholars at RMC, to send graduate students for visits at other institutions to broaden their academic background or to require attendance for the regular Physics and Space Science colloquium series organized by RMC.
Departmental Response
The Department will take several steps to determine whether to implement this recommendation based on the standard in the field and programmatic needs. The DGSC will survey the course requirements for comparable Canadian programs, discuss the potential reduction of courses based on these findings and the perceived needs of our programs and present a recommendation to faculty members for their discussion and approval. While a decrease may be possible for some M.Sc. and PhD candidates, the number of courses may vary depending on student background, supervisor recommendations and the requirements of the sponsoring agency in the case of military students. Attendance at the weekly colloquium during the academic year is highly recommended for graduate students, and turnout is generally reasonable. A graduate course on the topic of non-destructive testing is currently under development. This course will feature experts in the subject area from outside RMC giving a series of lectures. The Department will explore sending students to other institutions for visits to broaden their academic background.
Dean’s Response:
The Dean supports this response. Given that graduate students' academic backgrounds may vary significantly, some students may require more courses to achieve the appropriate level of proficiency in the field of research. The departmental graduate studies committee (DGSC) and the supervisors are in the best position to determine whether reducing the number of courses required in individual programmes is appropriate.
Recommendation 3
Continue to refine course material to reflect the fast-changing defence environment (e.g., using material suggested by military students returning from postings to centres with an international research footprint).
Departmental Response
This is an important recommendation that will be implemented. The Department is dedicated to providing relevant education to Canadian Armed Forces (CAF) officers posted to RMC for graduate studies. We diligently liaise with operational units while listening to incoming students and alums to refine course material.
Dean’s Response:
The College's Strategic Plan 2023 (Plan) states that RMC is recognized as a World-Class Military University that is a “Leader in Defence Research”. It is easy to see that Recommendation 3 is consistent with the “Plan”. The Department will continue to provide world-class research that supports the CAF.
Recommendation 4
Connect the oceanography courses and a subset of the research problems in this field to climate change, possibly through the lens of DND/CAF interests.
Departmental Response
This recommendation gives Department oceanography professors further impetus to pursue this important topic. Climate change is an existential problem that has particular implications for CAF operations; our graduate programs are uniquely suited to providing students with this vital perspective. Research is already carried out on climate change, specifically regarding Arctic warming, and taught in graduate-level Remote Sensing and Oceanography courses; the Department will explore concrete ways to connect climate change through a CAF lens to these courses as a first step.
Dean’s Response:
Although the Dean agrees with some of the Department's responses that research related to climate change is essential.It is also important to note that Faculty have academic freedom and are free to explore lines of research that may include climate change.
Even with the above, many of the Faculty in the Department are already researching climate change, and we will continue to encourage those lines of inquiry.
Recommendation 5
Systematically increase the integration of graduate students in the national and international research community. Concrete examples include participation in the student chapters of scientific societies (e.g. APS, AGU, CAP, CMOS), short courses in the summer taught by outside experts, and sponsored visits to laboratories at other research-active Ontario universities.
Departmental Response
The DGSC will formulate a proposal to systematically increase the integration of graduate students into the global research community. Supervisors are generally responsible for organizing and supporting student activities concerning conferences, tutorials, short courses and research-related tours. For example, Physics and Space Science students participate in scientific meetings, such as ArcticNet, Geospace Environment Modeling (GEM), and Coupling, Energetics and Dynamics of Atmospheric Regions (CEDAR), which typically include student townhall events and tutorial sessions aimed at graduate students. A systematic increase in this type of activity, particularly for military-sponsored students, could be realized with RMC funding to help defray attendance costs, as is typical at many other institutions.
Dean’s Response:
The Dean agrees with the departmental response. Graduate students must attend international conferences and other related professional development and networking activities, and a stable funding source is required to assist in defraying the cost of participation. As noted by the Department, many supervisors already support their students attending conferences.
Recommendation 6
Improve and systematize access to declassified military data and problems.This is an area of uniqueness for RMC and has considerable promise.
Departmental Response
Unclassified material is incorporated into the course material per Recommendation 3. Research projects are solicited from CAF research institutions and operational units for potential thesis topics. CAF units that sponsor military students may recommend avenues of research since the student will come under their employment after graduation. The current system can be improved by liaising with the relevant CAF organizations for potential research collaborations involving graduate students. The list of topics will be promulgated to Physics and Space Science Faculty and the broader RMC community. Ultimately, the selection of graduate research combines faculty expertise and interest and student interests.
Dean’s Response:
The Canadian Defence Academy Research Programme annually releases topics of interest that the CAF is promoting for research topics.In addition, ongoing partnerships with Defence Research and Development Canada (DRDC) and other research-related groups in DND are instrumental in obtaining data, collaborations and potential research topics.
VPR’s Response:
Our office is very active in increasing partnerships between RMC and DRDC. Two recent initiatives demonstrate the seriousness of this approach. Until now, the numerous research partnerships with DRDC had been the result of personal initiatives by RMC researchers who have DRDC members in their contact networks. In the spring of 2023, our office organized a strategic planning meeting with the Assistant Deputy Minister (DRDC), on May 12, with the aim of increasing partnerships between our respective institutions and make systematic use of RMC researchers to meet DRDC's research needs. From this initial meeting, a decision was made to enhance partnerships and exchanges, with meetings between the two groups occurring on a regular biannual basis. As a result, we coordinated a visit of a delegation of DRDC project managers and research scientists to the College on May 30 to visit our laboratories and explore our capabilities in the areas of applied research that can serve the interests of the Canadian Department of National Defense. This coordination resulted in twelve parallel meetings, including two meetings with the physics and space science researchers.
These new initiatives have yet to come to fruition, but promises to potentially lead to new collaborative research projects.
In the meantime, the creation of a defense institute is progressing well. We will establish this institute with the goal of increasing the visibility of the research that is conducted at RMC and creating additional research opportunities for our community of scientists. This institute should see the light of day during the year 2024.
Recommendation 7
Ensure course material, starting with course syllabi but building out, is consistent with Ontario’s AODA legislation.
Departmental Response
The Department will ensure that course syllabi and delivery is consistent with Ontario's AODA.Since this issue is not restricted to the Department, this may be most effectively implemented college-wide through consultations with, for example, the Syllabus Committee or through Quality Assurance.
Dean’s Response:
The department will work with EDI Officers as well as instructional designers at RMC to determine the best approach to ensure AODA compliance. In concert with this, senior management will review if a college-wide approach is more appropriate.
Recommendation 8
Establish a system to reward Faculty for working to strengthen aspects of the graduate program at RMC (not at partner institutions) by offering teaching relief or other incentives.Examples of relevant activities include supervising more students based at RMC, organizing short courses from outside experts, securing significant research funding or organizing reading courses or reading groups.
Departmental Response
While the Department fully supports this recommendation, we are bound by the Collective Bargaining Agreement rules for University Teachers (UTs).The Department Head can only offer rewards such as course relief with a justification, and, currently, having a large research group or supervising multiple graduate students is not an acceptable reason for a reduction in UT faculty workload.The RMC Workload Committee is currently examining this issue with recommendations to the Principal. The significantly higher researcher costs associated with paying competitive student salaries at RMC and the complexities associated with accessing the RMC campus and its resources due to security requirements are prime motivations for Faculty to take on students at other institutions. The Department will continue to advocate for College-wide improvements through college-wide channels such as the Graduate Studies Committee and the Research Advisory Committee.
Dean’s Response:
As the departmental response alludes to, the Collective Agreement (CBA) establishes the entitlements for university professors at RMC.The CBA does not allow "rewards" such as teaching relief or other incentives for supervising more students at RMC.
As the department response alludes, there are higher costs associated with providing graduate students competitive salaries at RMC compared to other universities for Faculty.The College mitigates this issue by providing financial support through Teaching Assistantships; unfortunately, it is insufficient to offset the costs.
Implementation Plan
| Recommendation | Proposed follow-up and Resourse Implications | Responsibility for Leading Follow-up | Timeline for Addressing Recommendation |
|---|---|---|---|
| 1. Significantly improve connectivity and access to computing resources. |
|
|
|
| 2. Decrease the required courses from 4 to 3 in the M.Sc. (thesis track) and PhD programs. | Survey comparable Canadian programmes and implement best practices | Departmental graduate studies committee (DGSC) & Faculty. | January 2024 |
| 3. Continue to refine course material to reflect the fast-changing defence environment. | Faculty | Head of Department | Updated during annual monitoring June 15, 2024 |
| 4. Connect the oceanography courses and a subset of the research problems in this field to climate change. | Oceanography professors | Head of Department | Complete |
| 5. Systematically increase the integration of graduate students in the national and international research community. | Faculty | Head of Department | Updated during annual monitoring June 15, 2024 |
| 6. Improve and systematize the access to declassified military data and problems. | Provide access to declassified military data & research topics. | VP (Research) | Updated during annual monitoring June 15, 2024 |
| 7. Ensure course material, starting with course syllabi but building out, is consistent with Ontario’s AODA legislation. | Working group comprised of SMEs at RMC to review compliance of PSS course material with Ontario’s AODA legislation. |
|
Updated during annual monitoring June 15, 2024 |
| 8. Establish a system to reward Faculty for working to strengthen aspects of the graduate program at RMC (not at partner institutions) by offering teaching relief or other incentives. | Not accepted | Not accepted | Not accepted |
Conclusion:
The ERC Report provided positive feedback on the outcomes of the graduate programs in Physics. It confirmed that the RMC is delivering programs consistent with other comparable institutions in Ontario. However, the ERC identified areas with room for improvement, and RMC has taken steps to address the issues raised. RMC will continue to work toward program enhancement and improve student success in the graduate programs in Physics.
The Dean of Graduate Studies, in consultation with the Dean of Science, the Program Chair, and the Head of Physics and Space Science, is responsible for monitoring the Implementation Plan.