The single most useful thing to know before buying a small bag is what you're actually willing to leave at home. Phone, card, keys, maybe a lipstick, that's the honest capacity of most of them, and if you need more than that most days, no amount of wanting the look will make it practical. Work that out first and the rest sorts itself.
Fit matters more than it seems like it should on something this size. Check the strap drop before you buy, not after, because a chain strap that sits too long swings into your hip with every step and one that sits too short digs under the arm within an hour. Crossbody is the easiest to live with for walking around all day, a handheld or top handle version looks sharper but means you're using a hand you might want free, and clutch sized ones only really work if you know you'll be mostly sitting down or standing still. Watch the structure too. A stiff shaped bag holds up on a shelf but can look lumpy once you've forced a phone and a folded tote into it, so buy to the shape it'll actually be once it's full, not empty. If it's a flap style, open and close it a few times in the shop, because fiddly magnetic clasps that look neat get irritating fast when you're trying to pay for something with a queue behind you. It should sit against you without pulling at the shoulder seam of whatever you're wearing, so try it on over the coat you'll actually wear it with, not just a jumper.
Where it comes unstuck is bulk. Pair it with anything already busy, a big collar, statement sleeves, a coat with a lot going on, and it just gets lost or adds clutter rather than finishing the look. It works best against something plainer, a simple coat, straight trousers, a dress with no fuss at the neckline, so the bag is the one detail doing anything interesting. It's also the wrong choice the moment you need both hands properly free, or you're carrying anything more than essentials, a change of shoes, paperwork, lunch, a water bottle, any of that and you'll end up either cramming it in or carrying a second bag anyway, which defeats the point.
It suits anyone who's accepted that some days really do only need a phone and a card, and wants the bag to look like a decision rather than an afterthought.
Before you go, have a quick look at laptop bags.