摘要: | 由於嬰兒尚未發展完全,常常處在危險環境中卻不自覺,因此近年來有關嬰兒監控的產品與研究有蓬勃的發展。另一方面,年輕父母重視嬰兒成長過程,他們會藉由音樂學習、聽覺刺激等方式來陪伴嬰兒成長。本論文的目標是開發一套為嬰兒設計的安全監控與音樂互動系統,提供嬰兒更安全的生活環境,並且成為嬰兒最好的玩伴。起初,系統會先偵測嬰兒的臉部資訊,然後以其臉部大小為基底,建立其肢體的感興趣區域模型(region of interest model, ROI model)。我們藉由動態背景相減法,得到各肢體ROI model的動態資訊,並且為這些動態資訊加入時間資訊,作為類神經網路的輸入特徵。本論文的類神經網路架構為:8顆輸入神經元、單隱藏層、10顆隱藏層神經元以及11顆輸出神經元。類神經網路會分類出11種類型的狀態,其中包含6種安全類狀態以及5種危險類狀態。當嬰兒處於危險狀態時,系統會立即發出警示給照護者。另一方面,嬰兒在揮動肢體的時候,系統會辨識出其揮動的肢體,利用MIDI改變音樂,與嬰兒互動。系統平台是使用Cubieboard 4嵌入式系統開發板為基底進行開發,目的在於體積小、成本低,容易應用在一般家庭環境。本論文之危險監控可以幫助照護者在進行其他工作(如:煮飯、泡奶等)時,有效地偵測危險,避免遺憾發生;音樂互動功能則是提供嬰兒探索環境的樂趣,以及刺激其聽覺能力與肢體發展。 實驗的設計上分成九種情境,每種情境都會有特定狀態種類輸出,其中五種情境為危險狀況發生的情境;四種為安全或音樂互動的情境。本論文使用混淆矩陣統計每種狀態的辨識結果,辨識之指標我們採用精確度(Precision)、召回率(Recall),其中,精確率為86.6%、召回率85.7%。 ;The research of baby monitor systems has been greatly growing in these years because of newborn infants are usually in hazardous environments are not conscious; On the other hand, young parents concern about the periods of babies growing up. They apply to be learning music, auditory stimulation, etc. to accompany growth of the babies. This thesis aims to develop a system to baby monitoring and musical interaction, system provide a safer living environment, and to be the best playmate for infants. The system starts from the detection of the face information of infant, then establishes limbs ROI model based on the face information. We use dynamic background subtraction algorithm to obtain dynamic information about each limb ROI model, and add some time information to this dynamic information, then the information will be the input of neural network input. Neural network architecture of this thesis is as follows: 8 input neurons, single hidden layer, 10 neurons in the hidden layer and eleven output neurons. The neural network can classify 11 types of state, which includes 6 security status, and five kinds of dangerous status. When the baby is in danger, the system will alarm the guardians immediately. On the other hand, when baby waving limbs, the system will recognize baby’s waving limb, then interact with the baby by changing music via MIDI. System develops with the basement of embedded development board-Cubieboard 4, it has the advantage of small size, low cost and easy to apply in general living environment. In this thesis, the function of danger monitoring detects dangerous events effectively, therefore, guardians can perform other tasks (such as: cooking, hot milk, and so on.) easily; The function of musical interaction can provide the babies can environment to explore for fun, stimulate their hearing ability and physical development. The performance of the proposed system was verified by nine experimental scenarios, each scenario had specific types of output state, five of which scenario will occur dangerous events, the others are secure scenarios which include musical interaction events. This thesis computes results for each state of confusion matrix, and the results of the indicators we use Precision and Recall, the precision ratio and the recall ratio were 86.6% and 85.7%, respectively. |