Spermatogenesis is precisely controlled by complex gene expression programs and involves epigenetic reprogramming, including histone modification and DNA methylation. SET domain-containing 2 (SETD2) is the predominant histone methyltransferase catalyzing the trimethylation of histone H3 lysine 36 (H3K36me3) and plays key roles in embryonic stem cell differentiation and somatic cell development. However, its role in male germ cell development remains elusive. Here, we demonstrate an essential role of Setd2 for spermiogenesis, the final stage of spermatogenesis. Using RNA-seq, we found that, in postnatal mouse testes, Setd2 mRNA levels dramatically increase in 14-day-old mice. Using a germ cell-specific Setd2 knockout mouse model, we also found that targeted Setd2 knockout in germ cells causes aberrant spermiogenesis with acrosomal malformation before step 8 of the round-spermatid stage, resulting in complete infertility. Furthermore, we noted that the Setd2 deficiency results in complete loss of H3K36me3 and significantly decreases expression of thousands of genes, including those encoding acrosin-binding protein 1 (Acrbp1) and protamines, required for spermatogenesis. Our findings thus reveal a previously unappreciated role of the SETD2-dependent H3K36me3 modification in spermiogenesis and provide clues to the molecular mechanisms in epigenetic disorders underlying male infertility.