Open set domain adaptation focuses on transferring the information from a richly labeled domain called source domain to a scarcely labeled domain called target domain, while classifying the unseen target samples as one unknown class in an unsupervised way. Compared with the close set domain adaptation, where the source domain and the target domain share the same class space, the classification of the unknown class makes it easy to adapt to the real environment. Particularly, after the recognition of the unknown samples, the model can either ask for manually labeling or further develop the classification ability of the unknown classes based on pre-stored knowledge. Inspired by this idea, we propose a model for open set domain adaptation with zero-shot learning on the unknown classes in this paper. We utilize adversarial learning to align the two domains while rejecting the unknown classes. Then the knowledge graph is introduced to generate the classifiers for the unknown classes with the employment of the graph convolution network (GCN). Thus the classification ability of the source domain is transferred to the target domain, and the model can distinguish the unknown classes in detail with prior knowledge. We evaluate our model on digits datasets and the result shows superior performance.