SPOILERS
At first all dwarves wore male clothes.
Then Cheery started wearing female clothes and other female dwarves followed suit.
The next logical step to make the circle complete, is for male dwarves to start wearing female dwarves' clothes too.
Therefore I believe Madame (and Pepe) is male! 8)