Visual cognitive development is vital for intelligent robots to handle various types of visual tasks rather than predefined ones. It can transfer the classification ability from an original model to a novel task. However, the high reliance on large amounts of data hinders its development. The energy it costs to adjust to the novel tasks is also a tough problem. Thus we propose a model called knowledge-experience graph (KEG) to imitate the mechanisms of human brains. With the help of social knowledge stored in the knowledge graph, the novel classes can be easily added. The combination of the experience via denoising autoencoder (DAE) also takes the relationship in the visual space into account. With the propagation of information among the graph by graph convolutional network (GCN), KEG generates the classifier of the novel tasks effectively. Experiments show that KEG improves the classification accuracy of novel categories on zero-shot learning and accomplishes visual cognitive development to a certain extent.