Sex-specific markers are powerful tools for identifying sex-determination system in various animals. Bighead carp (Hypophthalmichthys nobilis) and silver carp (Hypophthalmichthys molitrix) are two of the most important edible fish in Asia, which have a long juvenility period that can lasts for 4-5 years. In this study, we found one sex-specific marker by next-generation sequencing together with bioinformatics analysis in bighead carp. The male-specific markers were used to perform molecular sexing in the progenies of artificial gynogenetic diploids and found all progenies (n = 160) were females. Meanwhile, around 1 : 1 sex ratio was observed in a total of 579 juvenile offspring from three other families. To further extend the male-specific region, we performed genome walking and got a male-specific sequence of 8,661 bp. Five pairs of primers were designed and could be used to efficiently distinguish males from females in bighead carp and silver carp. The development of these male-specific markers and results of their molecular sexing in different populations provide strong evidence for a sex determination system of female homogametry or male heterogametry (XX/XY) in bighead carp and silver carp. To the best of our knowledge, this is the first report of effective sex-specific markers in these two large carp species.