實現分中帶群的試題計分 -情境式判斷測驗模糊計分法的發展與應用

以作者查詢圖書館館藏

、以作者查詢臺灣博碩士

、以作者查詢全國書目

、勘誤回報

、線上人數：22

、訪客IP：3.135.190.135

姓名

歐宗霖(Tsung-Lin Ou) 查詢紙本館藏

畢業系所

企業管理學系

論文名稱

實現分中帶群的試題計分 -情境式判斷測驗模糊計分法的發展與應用
(Implementing“Clustering with scale” in Item Scoring:The Development and Application of Fuzzy Scoring on Situational Judgment Tests)

相關論文

★ 個人績效評估與時序變動之動態資料包絡分析: 人力資本效率模型的模式發展與實證分析	★ 工作特性對工作績效之影響-工作負荷認知與自我效能感調節效果之探討
★ 真誠領導、工作社會特性與工作結果之關聯性和調節效果分析	★ 社會賦閒、主管關係、工作社會特徵對工作結果之影響
★ 心理契約對工作結果之影響-組織氣候中介效果與他人回饋調節效果分析	★ 情緒勞動對工作產出之影響- 自我監控與社會支持調節效果之探討

檔案

[Endnote RIS 格式]

[Bibtex 格式]

[相關文章]

[文章引用]

[完整記錄]

[館藏目錄]

[檢視]

[下載]

本電子論文使用權限為同意立即開放。
已達開放權限電子全文僅授權使用者為學術研究之目的，進行個人非營利性質之檢索、閱讀、列印。
請遵守中華民國著作權法之相關規定，切勿任意重製、散佈、改作、轉貼、播送，以免觸法。

摘要(中)

本研究目的在於利用模糊理論處理情境判斷測驗計分議題上被忽略的判斷模糊性。本文透過文獻釐清情境判斷測驗的設計要求與探討相關之議題並發展情境式判斷測驗之模糊計分，並以情境判斷測驗中常見的單選題型進行SJT的試題計分的模擬與實證研究。本研究除了模擬不同語意模糊程度的受試反應資料進行探究外，並蒐集受試實際作答反應比較分析，比較模糊取向與明確計分差異。經結果分析與討論可得知：第一，情境式判斷測驗模糊計分能整合受試強迫式與非強迫式作答的資訊，有效反映情境判斷測驗在計分上的判斷模糊性。第二，綜合模擬與實證研究的結果發現，情境式判斷測驗模糊計分能同時兼顧群體分類與個體區辨的特色，提升企業在人員甄選時的效能。最後進行研究討論並歸納總結，提供研究與實務上的建議。

摘要(英)

Based on the viewpoints of Fuzzy theory, the aim of this research is to deal with judgment uncertainty which was ignored on the issue of scoring situational judgment test. By the literature inference, the research developed the approach of Situational Judgment Test Fuzzy Scoring and take the pick-best scale of situational judgment test as a demonstration, adapting simulated and empirical research to compare the differences between the fuzzy scoring and the crisp scoring. Analysis of results concludes that: (1) Situational Judgment Test Fuzzy Scoring can integrate the information of forced and unforced response of a subject to deal with uncertainty on judgment process. (2) Situational Judgment Test Fuzzy Scoring can consider the class of grouping and the individual disparity together to strengthen the efficacy of employee selection. Finally, practical and academic viewpoints about fuzzy scoring on Situational Judgment Test were discussed for the future study.

關鍵字(中)

★ 情境式判斷測驗
★ 試題計分
★ 模糊理論
★ 模糊語意變數
★ 模糊推論

關鍵字(英)

★ situational judgment test
★ item scoring
★ fuzzy theory
★ fuzzy linguistic variables
★ fuzzy inference

論文目次

目錄

中文摘要 Ⅰ
英文摘要 Ⅱ
致謝 Ⅲ
表目錄 Ⅶ
圖目錄 Ⅷ
第一章緒論 1
第一節背景 1
第二節研究目的 3
第三節名詞釋義 4
第三節章節安排 6
第二章文獻探討 7
第一節情境式判斷測驗的發展脈絡 7
第二節自陳式測驗與情境式判斷測驗的基本差異 9
第三節情境式判斷測驗的編制範例 12
一、評量構面的擬定與試題發展 13
二、試題、選項編製原則 14
三、內容適切性評估 15
四、選項定義的共識評量 15
五、情境式判斷測驗試題範例 15
第四節情境式判斷測驗的題型與計分 17
一、單選計分法 18
二、部分計分法 18
三、排序計分法 19
四、李克特式量尺法 20
五、項目反應理論取向的情境式判斷測驗計分 21
第五節模糊理論在測驗上的應用 24
一、模糊理論的發展 24
二、模糊理論在測驗上的應用 25
三、模糊理論與測驗相關的概念 27
第三章情境式判斷測驗的模糊計分設計 33
第一節情境式判斷測驗的模糊計分取向觀點 33
第二節情境式判斷測驗之模糊計分 36
一、第一階段：模糊化（fuzzification） 36
二、第二階段：推論（inference） 39
三、第三階段：解模糊化（defuzzificaion） 41
第四章模擬研究 42
第一節研究設計 42
第二節研究方法 42
一、資料模擬 42
二、試題計分 44
三、資料分析 47
第三節分析結果 48
一、描述性分析 48
二、平均開方均方誤 51
第四節小結 52
第五章實證研究 54
第一節研究設計 54
第二節研究方法 55
一、資料蒐集 55
二、試題計分 56
三、資料分析 56
第三節分析結果 57
一、作答一致性分析 57
二、描述性指標比較 57
三、甄選效能比較 62
第六章討論與結論 64
第一節討論 64
一、方法學意涵 64
二、管理意涵 67
第二節結論 69
第三節限制與建議 70
參考文獻 72

參考文獻

參考文獻

中文部分

參考書籍

王文俊（1997）。認識fuzzy。台北市：全華科技圖書股份有限公司。

吳柏林（2015）。模糊統計導論：方法與應用（二版）。台北市：五南。

吳柏林、楊文山（1997）。社會科學計量方法發展與應用─模糊統計在社會調查分析的應用。台北市：中央研究院中山人文社會科學研究所。

期刊論文

王鵬華、吳昭彥（1996）。模糊多準則決策應用在高等教育之選擇。高雄工學院學報，3，295-304。

余民寧（1993d）。試題反應理論的介紹（十一）題庫的建立。研習資訊，10（4），9-13。

朱智洺（2007）。李克特式量表與模糊語意量表計分的差異比較-以正態模糊數模擬為例。統計與決策，22，160-162。

李新民、陳密桃、張玉蓮（2004）。職前幼兒教師成功智能評量編製報告。測驗學刊，51（2），291-316。

林一真、杜淑芬（1986）。他們真不誠實嗎？說謊量表初探。中國測驗學會測驗年刊33，95-108。

林原宏（2001）。模糊語意變數量表計分之信度模擬分析。測驗統計年刊，9，193-219。

林原宏（2002）。模糊語意量表的語意模糊數建構演算與實證分析。調查研究，11，31-71。

林原宏（2003）。量表語意模糊數演算及其計分比較分析。臺中師院學報，17（2），279-304。

林原宏、鄭舜仁、吳柏林（2003）。模糊眾數及其在教育與心理評量分析之應用。中國統計學報，41（1），39-66。

邱皓政、歐宗霖（2013）。從心境邁向情境：情境式判斷測驗在人事甄選與心理特質評量上的發展與應用。國家菁英，9（2），109-127。

徐村和、朱國明、詹惠君（1999）。廣告業服務接觸與顧客行為意圖關係之研究—模糊語意尺度之應用。東吳經濟商學學報，26，1-25。

胡悅倫、吳柏林（2002）。模糊統計在分析樂觀量表之應用。國立政治大學教育與心理研究，25，457-484。

胡悅倫、陳皎眉、吳柏林（2006）。應用模糊統計於A型量表分類之研究。教育與心理研究，29（1），151-181。

連經宇、陳彥仲（1999）。模糊語意變數法應用於住宅消費決策行為之初探研究。住宅學報，8，69-90。

陳昭宏（1998）。以Fuzzy演算法分析評量用詞對問卷調查之影響。東方工商學報，21，76-82。

陳亭羽、曾國雄（2000）。模糊測度應用於多屬性決策時之資訊需求量簡化研究。管理學報，17（3），483-514。

陳彰儀、李明霓、顏志龍（2004）。網路應徵者填寫測驗的作假行為：情境因素與測驗類型的影響。中華心理學刊，46（4），349-359。

黃一峰、鄭怡君（2004）。情境式判斷測驗：訓練考核的可行途徑。Training & Development （T&D），20，1-9。

張菀珍、葉榮木（2014）。應用多媒體行動學習系統輔助大學生情緒管理學習成效與評量之探究。教育科學研究期刊，59（4），99-136。

歐宗霖、邱皓政、孫國勛（2013）。當測驗碰上情境：情境式判斷測驗與自陳式量表在量表發展上之比較。測驗學刊，60（2），239-262。

鄭景俗、楊國隆（1998）。模糊集合論在教育評分等級系統之應用。模糊系統學刊，4（2），81-89。
羅豪章（2002）。發展多元評量模糊複合分數之初探。科學教育學刊，10（4），407-421。

會議論文

邱皓政、歐宗霖（2010,9）。要身歷其境還是自吐心境？情境判斷與自陳式測驗在職能評估的應用與計量特徵的比較—以空服員職能測量為例。2010全球變局下之管理創新國際研討會，國立臺灣師範大學管理學院，台灣台北。

學位論文

劉天賜（1992）。應用模糊語意於心智性工作負荷評估。國立清華大學工業工程研究所博士論文，未出版，新竹。

網路資料

歐宗霖（2012）。職能導向評鑑之驚喜與隱憂—情境式判斷測驗，經濟部人才快訊電子報。民國101年8月29日，取自http://itriexpress.blogspot.tw/2012/08/blog-post_8679.html。

英文部分

Books

Bojadziev, G., & Bojadziev, M.（1995）. Fuzzy sets, Fuzzy logic, applications. Advances in Fuzzy Systems— Applications and Theory, 5. Singapore, World Scientific.

Brooks, M. E., & Highhouse, E. S.（2006）. Can good judgment be measured?. In J. A.Weekley and R. E. Ployhart（Eds.）, Situational judgment tests. Mahwah, NJ: Lawrence Erlbaum Associates.

Chen, S. J., & Hwang, C. L.（1992）. Fuzzy Multiple Attribute Decision Making Methods and Applications. Berlin :Springer-Verlag.

Chiou, H., & Ou, T.-L.（2012）. Application of Fuzzy composite score for scoring situational judgment tests: A integrated operation viewpoint. In Luiz Moutinho and Kun-Huang Huarng （Eds.）, Quantitative Modelling in Marketing and Management （pp. 333-355）. NJ: World Scientific Publishing.

Damarin, F., & Messick, S.（1965）. Response styles as personality variables: A theoretical integration of multivariate research. ETS technical bulletin RB-65-10. Princeton, NJ: Educational Testing Service.

File, Q. W., & Remmers, H. H.（1971）. How supervise? Manual 1971 revision. Cleveland, OH: Psychological Corporation.

Hambleton, R. K.（1989）. Principles and selected applications of item response theory. In R. L. Linn （Ed.）, Educational measurement （3rd ed., pp. 147-200）. New York: Macmillan.

Hambleton, R. K., & Swaminathan, H.（1985）. Item response theory: Principles and applications. Boston, MA: Kluwer-Nijhoff.

Hambleton, R. K., Swaminathan, H., & Rogers, H. J.（1991）. Fundamentals of item response theory. Newburry Park, CA: SAGE.

Hogarth, R. M.（2001）. Educating intuition. Chicago, IL: The University of Chicago Press.

Klir, G. J., & Folger, T. A.（1988）. Fuzzy Sets, Uncertainty, and information. Prentice-Hall, Englewood Cliffs, New Jersey.

Klir, G. J., & Yuan, B.（1995）. Fuzzy Sets and Fuzzy logic: Theory and Applications. Prentice-Hall, Upper Saddle River, New Jersey.

Lin, C. T., & Lee, C. S.（1996）. Neural Fuzzy system - A Neuro - Fuzzy synergism to intelligent systems. New York : Prentice-Hall International, Inc.

Lord, F. M.（1980）. Applications of item response theory to practional testing problems. Hillsdale, NJ: Lawrence Erlbawn Associates.

Nonaka, I., & Hirotaka, T.（1995）. The Knowledge Creating Company, N.Y.: Oxford University Press.

Paulhus, D. L.（1991）. Measurement and control of response bias. In J. P. Robinson, P.R. Shaver, & L. S. Wrightsman （Eds.）. Measures of personality and social psychological attitudes（pp. 17-60）. San Diego: Academic Press.

Schmitt, N., & Chan, D.（2006）. Situational judgment tests: Method or Construct?. In J. A. Weekley & R. E. Ployhart （Eds.）, Situational judgment tests, Mahwah, NJ: Lawrence Erlbaum Associates.

Stemler, S.E., & Sternberg, R.J.（2006）. Using situational judgment tests to measure practical intelligence. In J. A. Weekley and R.E. Ployhart（Eds.）, Situational Judgment Tests（pp. 107-131）. Mahwah, NJ: Lawrence Erlbaum Associates, Inc.

Sternberg, R. J.（1997）. Successful intelligence: How practical and creative intelligence determine success in life. New York: Plume.

Von Altrock, C.（1996）. Fuzzy logic and Neuro Fuzzy Applications In Business and Finance. Prentice Hall PTR, Upper Saddle River, New Jersey.

Weekley, J. A., & Ployhart, R. E.（2006）. Situational judgment tests: Theory, measurement, and application（Eds.）. Mahwah, NJ: Erlbaum.

Weekley, J. A., Ployhart, R. E., & Holtz, B. C.（2006）. On the development of situational judgment tests: Issues in item development, scaling, and scoring. In J. A. Weekley and R. E. Ployhart（Eds.）, Situational judgment tests: Theory, measurement, and application（pp. 157-182）, San Francisco: Jossey-Bass.

Wright, B. D., & Stone, M. H.（1979）. Best test design. Chicago: MESA.

Zimmermann, H. J., Zadeh, L. A., & Gaines, B. R.（1984）. Fuzzy Sets and Decision Analysis, Netherland: Eiaevier Science Publishers.

Journals and essays

Allen, V. D., Rahman, N., Weissman, A., Hellwig, S., MacCann, C., Lewin, C., &Roberts, R. D.（2014）.The Situational Test of Emotional Management – Brief （STEM-B）: Development and validation using item response theory and latent class analysis. Personality and Individual Differences, 81, 195-200.

Allen, V. D., Weissman, A., Hellwig, S., MacCann, C., & Roberts, R. D.（2014）. Development of the Situational Test of Emotional Understanding–Brief（STEU-B） using item response theory. Personality and Individual Differences, 65, 3-7.

Arthur Jr, W., Glaze, R.M., Jarrett, S.M., White, C.D., Schurig, I., & Taylor, J.E. （2014）. Comparative evaluation of three situational judgment test response formats in terms of construct-related validity, subgroup differences, and susceptibility to response distortion. Journal of Applied Psychology, 99, 335-345.

Berenji, H. R.（1992）. Fuzzy Logic Controllers. In An Introduction to Fuzzy Logic Applications in Intelligent systems, 69-96.

Bergman, M. E., Drasgows, F., Donovan, M. A., & Henning, J. B.（2006）. Scoring situational judgment tests: Once you get the data, your troubles begin. International Journal of Selection and Assessment, 14, 223-235.

Brown, A.,& Maydeu-Olivares, A.（2011）. Item response modeling of forced-choice questionnaires. Educational and Psychological Measurement, 71, 460-502.

Brown, A., & Maydeu-Olivares, A.（2013）. How IRT can solve problems of ipsative data in forced-choice questionnaires. Psychological Methods, 18, 36-52.

Cattell, R. B.（1944）. Psychological measurement: ipsative, normative, and interactive. Psychological Review, 51（5）, 293–303.

Chan, D., & Schmitt, N.（2002）. Situational judgment and job performance. Human Performance, 15, 233-254.

Chater, N.（1999）. The search for simplicity: A fundamental cognitive principle? The Quarterly Journal of Experimental Psychology: Section A 52（2）, 273–302.

Christian, M. S., Edwards, B. D., & Bradley, J. C.（2010）. Situational judgment tests: Constructs assessed and a meta-analysis of their criterion-related validity. Personnel Psychology, 63, 83–117.

Clevenger J, Pereira, G. M., Wiechmann, D., Schmitt, N., & Schmidt, H. V.（2001）. Incremental validity of situational judgment tests. Journal of Applied Psychology, 86, 410–417.

Costas, C. S. L, Maranon, P. P., & Cabrera, J. A. H.（1994）. Application of diffuse measurement to the evaluation of psychological structures, Quality and Quanty, 28, 305-313.

File, Q. W.（1945）. The measurement of supervisory quality in industry. Journal of Applied Psychology, 29, 381–387.

Guion, R. M., & Ironson, G. H.（1983）. Latent trait theory for organizational research. Organizational Behavior and Human Performance, 31, 54-87.

Hambleton, R. K., & Cook, L. L.（1977）. Latent trait models and their use in the analysis of educational test data. Journal of Educational Measurement, 14, 75-96.

Hammond, K. R.（1955）. Probabilistic functioning and the clinical method, Psychological Review, 62, 255-262.

Hesketh, B., Pryor, R., Gleitzman, M., & Hesketh, T.（1988）. Practical applications and psychometric evaluation of a computerised Fuzzy graphic rating scale. Fuzzy sets in psychology , 425–454.

Hicks, L. E.（1970）. Some properties of ipsative, normative, and forced-choice normative measures. Psychological Bulletin, 74, 167-18.
Hontangas, P. M., Torre, J. d. l., Ponsoda, V., Iwin Leenen, I., DanielMorillo, & Abad, F. J.（2015）. Comparing Traditional and IRT Scoring of Forced-Choice Tests. Applied Psychological Measurement, 39（8）, 598-612.

Hunter, D. R.（2003）. Measuring general aviation pilot judgment using a situational judgment technique. International Journal of Aviation Psychology, 13（4）, 373-386.

Kanning, U.P., Grewe, K., Hollenberg, S., & Hadouch, M.（2006）. From the subjects′ point of view: Reactions to different types of situational judgment items. European Journal of Psychological Assessment, 22, 168-176.

Mamdani, E. H.（1974）. Application of Fuzzy algorithms for control of a simple dynamic plain. IEEE Control Sci, 121, 1585-1588.

McCloy, R. A., Heggestad, E. D., & Reeve, C. L.（2005）. A silk purse from the sow’s ear: Retrieving normative information from multidimensional forced-choice items. Organizational Research Methods, 8, 222–248.

McDaniel, M. A., & Nguyen, N. T.（2001）. Situational judgment tests: a review of practice and constructs assessed. International Journal of Selection and Assessment, 9, 103–113.

McDaniel, M. A., & Whetzel, D. L.（2005）. Situational judgment test research: Informing the debate on practical intelligence theory. Intelligence, 33, 515–525.

McFarland, L. A., & Ryan, A. M.（2000）. Variance in faking across noncognitive measures. Journal of Applied Psychology, 85, 812–821.

McFarland, L. A., & Ryan, A. M.（2006）. Toward an integrated model of applicant faking behavior. Journal of Applied Social Psychology, 36（4）, 979–1016.

Motowidlo, S. J., Dunnette, M. D., & Carter, G. W.（1990）. An alternative selection procedure: the low-fidelity simulation. Journal of Applied Psychology, 75, 640–647.

O’Connell, M. S., Doverspike, D., Norris-Watts, C., & Hattrup, K.（2001）. Predictors of organizational citizenship behavior among Mexican retail salespeople. International Journal of Organizational Analysis, 9, 272-280.

Paulhus, D. L.（1984）. Two-component models of socially desirable responding. Journal of Personality and Social Psychology, 46（3）, 598-609.

Sackett, P. R., & Lievens, F.（2008）. Personnel selection. Annual Review of Psychology, 59, 419-500.

Stark, S., Chernyshenko, O. S., & Drasgow, F.（2005）. An IRT Approach to Constructing and Scoring Pairwise Preference Items Involving Stimuli on Different Dimensions: The Multi-Unidimensional Pairwise-Preference Model. Applied Psychological Measurement, 29（3）, 184–203.

St-Sauveur, C., Girouard, S., & Goyette, V.（2014）. Use of Situational Judgment Tests in Personnel Selection: Are the different methods for scoring the response options equivalent?. International Journal of Selection and Assessment, 22（3）, 225–239.

Vale, C. D.（1986）. Linking item parameters onto a common scale. Applied Psychological Measurement, 10, 333-344.

Voxman, W.（2001）. Canonical representation of discrete fuzzy numbers. Fuzzy Sets and Systems, 118, 457-466.

Wagner, R.K., & Sternberg, R. J.（1985）. Practical intelligence in real world pursuits: The role of tacit knowledge, Journal of Personality and Social Psychology,48, 436–458.

Weekley, J.A., & Jones, C.（1997）. Video-based situational testing. Personnel Psychology, 50, 25-49.

Weekley, J. A., & Jones, C.（1999）. Further studies of situational tests. Personnel Psychology, 52, 679-700.

Weekley, J. A. , & Ployhart, R. E.（2005）. Situational judgment: Antecedents and relationships with performance. Human Performance, 18, 81-104.

Whetzel, D.L., & McDaniel, M. A.（2009）. Situational judgment tests: An overview of current research. Human Resource Management Review, 1, 188-202.

Yeh, Z. M., & Li, K. H.（2004）. A systematic approach for designing multistage Fuzzy control systems. Fuzzy Sets and Systems, 143（2）, 251-273.

Zadeh, L. A.（1965）. Fuzzy set. Information and Control, 8, 338-353.

Zadeh, L. A.（1975）. The concept of a linguistic variable and its application to approximate reasoning. Information Science, 8, 199-249.

Zopounidis, C., & Documpos, M.（1998）. Developing a multicriteria decision support system for financial classification problems: The finclas system. Optimization Methods and Software, 8, 277-304.

Seminar/conference symposium

Cucina, J. M., Vasilopoulos, N. L., & Leaman, J. A.（2003）. The bandwidth-fidelity dilemma and situational judgment test validity. Paper presented at the 18th Annual Conference of the Society for Industrial and Organizational Psychology, Orlando, FL.

Dounias, G., Havellas, S., & Tselentis, G.（1998）. A Fuzzy rule based approach for decision making in commercial food chains. EUPIT’98 Aachen, Germany, September 7-10.

McElreath, J., & Vasilopoulos, N.L.（2002）. situational judgment: Are most and least likely response the same?. Paper presented at the 17th annual conference of the Society for Industrial and Organizational Psychology, Toronto, Canada.

Reckase, M. D.（1981）. Tailored testing, measurement problems and latent trait theory. Paper presented at the annual meeting of the National Council for Measurement in Education, Los Angeles.

Sacco, J.M., Scheu, C.R., Ryan, A.M., Schmitt, N., Schmidt, D.B., & Rogg, K.L.（2000）. Reading level and verbal test scores as predictors of subgroup differences and validities of Situational Judgment Tests. Paper presented at the 15th Annual Meeting of the Society for Industrial and Organizational Psychology. New Orleans, LA.

Sinar, E. F., Paquet, S. L., & Scott D. R.（2002）. Internet versus paper selection tests: Exploring comparability issues. Paper presented at the 17th annual conference of the Society for Industrial and Organizational Psychology, Toronto, Canada.

Such, M. J., & Schmidt, D. B.（2004）. Examining the effectiveness of empirical keying: A cross-cultural perspective. Paper presented at the 19th annual conference for the Society of Industrial and Organizational Psychology, Chicago, IL.

Weekley, J. A., Harding, R., Creglow, A., & Ployhart, R. E.（2004）. Scoring situational judgment tests: Does the middle matter? Paper presented at the annual conference of the Society for Industrial and Organizational Psychology, Chicago, IL.

Theses

Muros, P.（2008）. Know the score: An exploration of keying and scoring approaches for situational judgment tests. Dissertation, University of Minnesota, Minneapolis, MN.

On line resources

Weekley, J.（2009）. Scoring situational judgment test: Does the middle matter. Thought Leadership, Kenexa Publications. Available at http://events.kenexa.com/newsletter/oldver/ 03042.asp?uid=1&tbl=test.

指導教授

邱皓政(Haw-Jeng Chiou)

審核日期

2016-12-12

推文