Sound-Environment Monitoring Method Based on Computational Auditory Scene Analysis

• 作者: Mitsuru Kawamoto
• 来源期刊: 信号与信息处理(英文)
• 学科: 医学
• 关键词: Sound-Environment VISUALIZATION Environmental SOUNDS Monitoring Painted SOUND PATTERNS SYNESTHESIA
• 年，卷（期）: 2017,（2）
• 页码范围: 65-77
• 页数: 13页
• 分类号: R73

摘要

Monitoring techniques are a key technology for examining the conditions in various scenarios, e.g., structural conditions, weather conditions, and disasters. In order to understand such scenarios, the appropriate extraction of their features from observation data is important. This paper proposes a monitoring method that allows sound environments to be expressed as a sound pattern. To this end, the concept of synesthesia is exploited. That is, the keys, tones, and pitches of the monitored sound are expressed using the three elements of color, that is, the hue, saturation, and brightness, respectively. In this paper, it is assumed that the hue, saturation, and brightness can be detected from the chromagram, sonogram, and sound spectrogram, respectively, based on a previous synesthesia experiment. Then, the sound pattern can be drawn using color, yielding a “painted sound map.” The usefulness of the proposed monitoring technique is verified using environmental sound data observed at a galleria.