The concept of edge network caching has been proposed to alleviate the excessive pres-sure on the core networks. Furthermore, video seg-ment caching technology, a method to cut the whole video into segments and cache them separately, has brought a novel idea to solve the caching problem in the smaller space for massive data. The adop-tion of segment caching in edge networks will divide the simple video transmission process into two cou-pling stages because of separate data caching, which leads to more complicated resource allocation. In this paper, this problem is discussed, and its mathe-matical model is established to minimize the energy consumption of video transmissions. By introducing an efficient prediction window of channel fading, an optimal dynamic scheduling algorithm based on Q-learning is proposed to minimize power consumption while ensuring smooth video streaming. The pro-posed Q-learning algorithm is simulated and the im-pacts of channel state, target video bit rate and large-scale channel parameter are evaluated. Simulation re-sults show that the proposed method can effectively reduce the total power consumption while ensuring the smooth playback of video service, thanks to the fact that the proposed method is intelligent which can effectively utilize idle resources in favorable channel states.