The point where a scarf becomes non negotiable for me is that bit in autumn when the coat's not warm enough on its own but it's not quite hat and gloves weather either, and you need something that fills the gap at your throat without making you look like you're dressed for a different season entirely. It's also the thing I grab when an outfit's not quite working and I can't work out why, half the time a scarf at the neck is just solving a problem a jumper started.
The difference between a good one and a bad one shows up fast. A cheap scarf in a synthetic blend goes thin and slippy in your hands, it won't sit, it slides off one shoulder all day and the ends fray within a few washes. A proper one, whether that's a heavier cotton, a wool blend or a decent viscose, has some actual substance to it, enough weight that it hangs rather than floats, and the edges are finished properly rather than just cut and left. Fringing should be even, not patchy, and if there's a print, it should be sharp at the edges rather than blurred like it's been run through a printer on the wrong setting. Rub it between your fingers before you buy it. If it feels scratchy there, it'll feel scratchy against your neck for the entire time you own it, no amount of washing fixes that.
For pairing, a scarf is doing a lot of quiet negotiating between your coat and whatever's underneath it, so I tend to keep mine a shade that either matches the coat or picks out something in the jumper, rather than fighting both. A plain coat with a patterned scarf looks considered, a patterned coat with a patterned scarf looks like you got dressed in the dark. Lighter weaves work over blazers and trenches where you want drape rather than bulk, and chunkier knits belong with wool coats where they can do a proper job rather than just sit there for decoration. Colour wise, the ones that get worn on repeat are never the exciting ones in the shop, they're the muted neutrals, a soft camel, a grey, a deep burgundy, something that goes with three coats instead of one. I bought a mustard scarf in a fit of confidence once and it's worn exactly twice, both times under duress.
If you're starting from nothing, go for a mid weight rectangular scarf in a neutral that matches your main coat, something with enough length to wrap twice without strangling you. Everything more interesting can come after that.