With the advancements of the Human Computer Interaction (HCI) field, nowadays it is possible for the users to use their body motions, such as swiping, pushing and moving, to interact with the content of computers or smart phones without traditional input devices like mouse and keyboard. With the introduction of gesture-based interface Kinect from Microsoft it creates promising opportunities for educators to offer students easier and more intuitive ways to interact with the system. The integration of Kinect based applications into classroom make students’ learning experience more active and joyful. In this context, this master thesis proposes a system for assessment in Smart Classroom. We design an interactive framework using Microsoft Kinect Sensor for Virtual Learning Environment (VLE) with new gesture-based questions in supporting QTI-based assessment, and introduce a rich set of gesture commands for practical usage in the classroom. Proposed system was experimented with teachers and students then collected users’ feedback using a usability questionnaire. The results show that participants are satisfied with the system and indicate that the system is simple to use and provides better functionality and motivate student learning by assessment. 隨著人機互動領域的進步,現今使用者可以透過各種手勢、身體語言、肢體動作來操作與偵測,不需要真實接觸到電腦鍵盤與滑鼠等智慧型3C產品,例如:智慧型手機等等,來操控投影螢幕有別於以往傳統的控制與展現方式。由於微軟Kinect的推出,透過手勢界面來操控傳統硬體方式與呈現的改變,它創造新穎的教學方式與使用,為學生提供更方便,更直觀的方式與系統作更有效率的互動。 整合基於Kinect應用於課堂中,此碩士論文中提出了一個評估式智慧型的教學應用,可以愉快且更多具經驗式的學習方法。我們使用微軟Kinect感測器的虛擬學習環境(VLE)支援和基於QTI評估與新的手勢的操控指令,我們設計了一個互動式的學習框架,並引進了一套豐富且新穎的手勢命令,實際使用在課堂上。我們提出的系統整合教師和學生的使用經驗,並收集他們的反饋和使用者提供的可用性的問卷。最後,結論展現出使用者與系統的評估達到高滿意度,並指出該系統是簡單易用,並提供了更好的功能和激勵學生的學習效果評估。