Japan energy saving activities of refineries in 1970s and 1980s were reviewed. The activities led by task teams were strongly supported by the corporate management. The teams consisted of well-trained and experienced persons from technical, maintenance, operation and manufacturing planning, and focused on cost cut, preventing energy losses, uncovering a lot of energy losses and preventing losses with no or small investment. For instance, loss measurement, less stripping steam, less reflux ratios, less treat gas, lower pressure and lower temperature, etc. In 1990s, environmental discussions suggested to introduce ultra low sulfur fuels and less CO2 emission fuels. In addition to the above, oil prices hike and supply shortage drive these activities. Energy saving should be evaluated by the overall optimization (saving and value generation). Energy utilization can be managed.