Gender is a social construction. Sex dimorphism on the other hand is a real phenomenon that allows humans (as well as other mammals) to reproduce and evolve over time. The essay "Doing Gender" by Zimmerman and West is a good place to start.

Everyone agrees on this except for the dubious Queer Theory camp, and maybe a few surgeons making money off of sex transition surgery.