This paper presents a body-centered model of human environment interaction based on proximal and perceptional relationships between the human actor and objects of interest (physical objects, virtual objects, and mediators). The model is applied to a real world scenario and also discussed as a tool for designing a distributed multimodal interaction infrastructure.