Although heartbeat segmentation can be done very well in ECG signals for arrhythmia detecting, there’re short of techniques for detecting heartbeat part from ECG images. We apply the powerful Faster R-CNN detector here, and achieves accurate detecting results. Along with the improved patch sampling mechanism in training, detection results are more precise. The high evaluation metric on validation data and demo of real scenes demonstrate the effectiveness of our method.