During early embryonic development, bone morphogenetic protein (BMP) signaling is essential for neural/non-neural cell fate decisions. BMP signaling inhibits precocious neural differentiation and allows for proper differentiation of mesoderm, endoderm, and epidermis. However, the mechanisms underlying the BMP pathway-mediated cell fate decision remain largely unknown. Here, we show that the expression of Ovol2, which encodes an evolutionarily conserved zinc finger transcription factor, is down-regulated during neural differentiation of mouse embryonic stem cells. Knockdown of Ovol2 in embryonic stem cells facilitates neural conversion and inhibits mesendodermal differentiation, whereas Ovol2 overexpression gives rise to the opposite phenotype. Moreover, Ovol2 knockdown partially rescues the neural inhibition and mesendodermal induction by BMP4. Mechanistic studies further show that BMP4 directly regulates Ovol2 expression through the binding of Smad1/5/8 to the second intron of the Ovol2 gene. In the chick embryo, cOvol2 expression is specifically excluded from neural territory and is up-regulated by BMP4. In addition, ectopic expression of cOvol2 in the prospective neural plate represses the expression of the definitive neural plate marker cSox2. Taken together, these results indicate that Ovol2 acts downstream of the BMP pathway in the cell fate decision between neuroectoderm and mesendoderm to ensure proper germ layer development.