The mistake is treating a kitten heel like a safe, grown up version of a flat, something you can wear to absolutely everything because it's "only a small heel". It isn't a neutral choice. The low heel and often pointed or almond toe change how a leg reads and how a trouser or hem needs to sit, and ignoring that is how you end up looking like you're wearing your mother's work shoes to the wrong event.
A kitten heel wants a trouser that breaks just above the shoe, or a hem that skims the ankle, because anything longer or wider swamps that thin little heel and makes the whole leg look stumpy rather than neat. It struggles badly with anything chunky above it, a heavy coat, a big bag, thick tights in cold weather, since the shoe is delicate and needs the rest of the outfit to stay fairly light so it doesn't disappear under everything else. Where it genuinely isn't the right choice is distance and speed, a long walk on uneven pavement, a day that involves stairs at a station and then more stairs, because the narrow heel doesn't give you the stability a block or a wedge would, and your ankle has to do more work than it wants to. It's also not forgiving on cobbles or gravel, where the heel can catch, so save it for pavements and indoor floors rather than a wedding in a field. In the shop, check the height of the vamp at the front, because a low cut front on a narrow foot will gape and show more toe cleavage than you meant, and look at where the heel sits under the shoe, a heel set slightly forward gives more stability than one set right at the back edge. Check the insole too, some kitten heels have almost no cushioning at all, and by hour three that shows up as a bruised feeling under the ball of the foot.
If you've none in your collection, start with a plain pointed court in a mid neutral, navy or a soft tan rather than black, in a leather or leather look rather than a shiny patent, because the slight sheen reads cheaper and scuffs faster. That one shoe will go under a straight trouser for work, under a midi skirt for something slightly dressed up, and it won't fight with a patterned top or a bold coat the way a strappier style might.
Where it never quite stops being a limit is on your feet after a long day standing, because however comfortable the shop floor felt, a thin heel with little padding will always ask more of you than a flat ever would.
Have a scroll through heels outfit ideas if you want more ideas.