Multimodal research for human robot interactions