Abstract: In recent years, ith the rapid development of digital multimedia technology, lots of image and video editing software have been widely used which make video become easier to be tampered, so the video tamper detection technology has become a hot research topic in information security field. There are many and varied way of video tampering, and this paper is intended for removing athletic goal from fixed background in the video. A digital video forgery detection method is proposed based on energy suspicious degree calculation, which can track the moving objects by calculating suspicious moving point image, and can locate the temporal and spatial juggled position. Videos are made of “frames”, and the continuity is readily apparent. Therefore, we could transfer video into a series of image in the video tamper detection. The energy suspicious degree is a good representative character which reflects the proportion of the low energy and high energy in each frame. When a moving target is removed from a section of the video image sequence, the grey value, low frequency energy and high frequency energy are bound to change which can affect the energy suspicious degree in the removed area corresponding to the image frame, destroy the continuity and consistency between two adjacent frames, and such change can be used to locate the tamper frame sequences on the time domain. When a goal is deleted, the frame tampering-repair technology mainly uses some patching algorithms to fill the deleted region. The moving objects can be tracked by calculating the suspicious moving point image because of the gray changes in repair area. Measurement procedures are as follow: firstly, extract the juggled frame sequence on the time domain by calculating energy suspicious degree of each frame. Secondly, use the frame differential method to calculate the suspicious moving point image, after that, a statistical method was preferred to extract the spatial suspicious motion image blocks. Finally, set the spatial target removal block as a removing athletic goal and eliminate the spatial interference suspicious blocks by calculating the average of energy suspicious degree in each spatial suspicious block while the spatial tamper location is positioned. The results show that this method can effectively detect whether the moving target was removed from the fixed background and orient the temporal and spatial tamper location accurately.