This paper presents our vision of large-scale, dynamic social network analysis in real environments, which we expect to be enabled by the introduction of large-scale heterogeneous sensors in the ambient environment. We address challenges in realizing large-scale dynamic social network analysis in real environments, and discuss several promising applications. Moreover, we present our design and implementation of a prototype system for quasi-realtime social network construction. We finally present preliminary experimental results of dynamic social network analysis for six-person social gatherings in a real environment, and discuss the feasibility of dynamic social network analysis and its effectiveness.