Deep convolutional neural networks (CNNs) have shown outstanding performance in object recognition from natural images. In contrast, object recognition from remote sensing images is more challenging, due to the complex background and inadequate data for training a deep network with a huge number of parameters. In this paper,

we propose a unified deep CNN, called DeepPlane, to simultaneously detect the position and classify the category of aircraft in remote sensing images. This model consists of two correlative deep networks: the first one is designed to generate object proposals as well as feature maps and the second one is cascaded upon the first one to perform classification and box regression in one shot. The “Inception Module” is introduced to tackle the insufficient training data problem that is one of the most challenging obstacles of the detection in remote sensing images. Extensive experiments demonstrate the efficiency of the proposed DeepPlane model. Specifically, DeepPlane could model detection and classification jointly and achieves 91.9% mAP in six categories of aircraft which advances the state-of-the-art,

sometimes considerably, for both tasks.