Leather dresses have a reputation for doing a lot of talking before you've said anything yourself, and most of the time I think that's earned. A good one looks expensive even when it wasn't, and it holds its shape in a way that cotton and viscose never quite manage. I've come round to them properly, though it took one appalling purchase in my twenties to get there.
Where it goes wrong is obvious once you've lived it. Sit down for a long meal or a train journey and a stiff, cheap leather dress will crease into shapes that don't drop out, and in hot weather it clings in a way that's more clammy than flattering. It's also the wrong choice for anything that needs you to move quickly or bend a lot, a wedding where you'll be on your feet dancing, a day that involves getting in and out of cars repeatedly. Treat it as an evening piece or a short occasion piece rather than something you'll wear from nine to five.
Fit is where most of the disappointment happens, because leather, real or faux, doesn't forgive the way knit fabrics do. There's no give to speak of, so sizing up a little is usually the safer bet, especially across the hips and under the arms where a tight cut will dig in rather than smooth out. Check the length sitting down as well as standing, since stiffer leather rides up more than you'd expect, and look closely at the zip, a dress that's a struggle to get into is a dress you'll stop reaching for.
The difference between a good one and a poor one shows up fast under your hands. Cheap faux leather tends to be shiny in a plasticky way, stiff at the seams, and it cracks along fold lines within a season. A better version, leather or a decent faux, has a slight matte softness, seams that lie flat rather than puckering, and a lining inside so it doesn't stick to tights or bare skin. Zips and poppers should feel solid, not like something that'll snap the second time you use it.
It clashes with anything else trying to make the same statement, so leave the statement boots, the heavy chain jewellery and the biker jacket in the wardrobe and let the dress do that job alone. Too much black leather head to toe can read costume rather than considered, so I'd break it up with a fabric that has some softness to it, a knit layer or a silky scarf, rather than doubling down on shine.
Reach for it when you want one piece to carry the whole outfit with no real effort from anything else, an evening out, a party where you'd rather not think too hard about accessories.