Measuring Concordance Among The Panel Members At The Assessment Of Professional Competence
Volume 3 - Issue 7, July 2019 Edition
[Download Full Paper]
Author(s)
Chandana Jayalath
Keywords
Assessment of professional competence, Kendall’s coefficient of concordance, Viva voce
Abstract
Assessment of Professional Competence (APC) is a prerequisite for offering chartered qualification of many professions. APC is to test the candidate’s overall competency against a set criterion. However, a common perception is that the panel members hold different views leading to judgments unfair by the candidates. A research related to a recently completed APC was carried out to objectively test this perception using Kendall’s coefficient of concordance. The underlying principles of assessment approaches used to determine competence were discussed in the literature survey. A panel of 5 assessors had been appointed to interview 18 candidates. Results indicate that a high consensus exists among the panel members in arriving at decisions on the candidates and had no significant deviation in their judgments.
References
[1] Lee c Hoog K (2003) Early Career Development of Quantity Surveying Professionals, Proceedings
of
the 18th
CIB
World
Building
Congress, pg 153-164
[2] Ronal M, Edward M (2002) Defining and Assessing Professional Competence, JAMA, Jan 9, 2002, - Vol 287 No 2
[3] John W (2001) The APC; Your Practical Guide to Success, 2nd edition, RICS Books, pg 61
[4] Pierre L (2005) Species Associations: The Kendall Coefficient of Concordance Revisited, Journal of Agricultural, Biological, and Environmental Statistics, Volume 10, Number 2, Pages 226–245
[5] Amanda Gearhart , D. Terrance Booth, Kevin Sedivec & Christopher Schauer (2013) Use of Kendall's coefficient of concordance to assess agreement among observers of very high resolution imagery, Geocarto International, 28:6, 517-526,
[6] McLagan, P. (1996) Great ideas revisited: Creating the future of HRD. Training and Development, 50 (1), pp. 60-65
[7] Anntoinette D. Lucia and Richard Lepsinger (1999) The Art and Science of Competency Models: Pinpointing Critical Success Factors in Organizations, San Francisco: Jossey-Bass/Pfeiffer
[8] Emiliani, M. L (2003) Linking leaders' beliefs to their behaviors and competencies, Management Decision 41/9 [2003] 893-910
[9] Otala, L. (1994) Industry-University Partnership: Implementing Lifelong Learning. Journal of European Industrial Training, Vol. 18 No. 8, 1994
[10] Burgoyne, J. (1989) Creating the managerial portfolio: building on competency approaches to management development
[11] Boyatzis, R. (1982) The Competent Manager – A Model For Effective Performance, NewYork
[12] Parry, S (1996). The Quest for Competence, Training Magazine
[13] Male, S (1990) Professional Authority, Power and Emerging Forms of ‘Profession’ in Quantity Surveying, Construction Management and Economics, 8, p.191-204.
[14] Leveson, R (1996) Can Professionals be Multi-skilled? People Management, Vol. 2 No. 17, August
[15] Hassall, T. and Lewis, S., “Curriculum development using case studiesâ€, paper for the Curriculum Development and Accounting Education Conference of the British Accounting Association Special Interest Group in Accounting Education, Loughborough University of Technology, 1995
[16] Willis, C J, Ashworth, A & Willis, J A (1994) Practice and Procedure for the Quantity Surveyor, 10th Ed Oxford: Blackwell Science
[17] Dreyfus, S. E., & Dreyfus, H., L. (1980). A Five-Stage Model of the Mental Activities Involved in Direct Skill Acquisition: Operations Research Center, university of California
[18] Eraut, M. (1994) Developing Professional Knowledge and Competence, London: Falmer press
[19] Michale T K (1992) The Assessment of Professional Competence, Evaluation & the Health Professions Volume: 15 issue: 2, page(s): 163-182
[20] Cynthia ChinTian Lee, Srinath Perera & Keith Hogg (2013) An analysis of early career training requirements for quantity surveying professionals, International Journal of Strategic Property Management, 17:2, 161-173
[21] Paul Derek Martin, John Pope (2008) Competencyâ€based interviewing – has it gone too far? Industrial and Commercial Training, Vol. 40 Issue: 2, pp.81-86
[22] Marlene (2002) The Panel Interview: A Review of Empirical Research and Guidelines for Practice, Public personnel management, 31(3):397-428
[23] Legendre, P., (2005) Species associations: the Kendall coefficient of concordance revisited. Journal of Agricultural, Biological and Environmental Statistics, 10, 226–245.