I avoided brown for years. To me it read as the colour you reach for when you've stopped trying, somewhere between a school blazer and a cardboard box. Then I tried a chocolate brown top on under proper daylight, not shop lighting, and saw it was warm rather than flat, and that was the end of my boycott.
The easiest browns to live with are the ones with a bit of red or gold in them rather than the ones leaning grey or orange, so think chestnut, toffee, a good rich chocolate, rather than anything that reminds you of tea gone cold. Matte finishes do more for you than shiny ones, a satin brown top can tip into costume territory very fast, while a soft jersey or a ribbed knit in the same shade just looks like clothes. Hold the fabric up to a window if you can, the true colour of brown shows itself in daylight far more than it does under shop bulbs, and a lot of "brown" tops are actually a sad dishwater grey in disguise. Once you've got the shade right it does an enormous amount of quiet work with things you already own, white jeans, cream trousers, washed out denim, even black if the brown is dark enough to hold its own, and it sits beautifully next to olive or rust without anyone having to think too hard about it. Gold jewellery wakes it up, silver can make it look a bit municipal, that's the one rule I'd actually stand behind.
If you've none in your wardrobe at all, start plain. A simple crew neck or a round neck long sleeve top in a mid brown, not espresso dark, not biscuit pale, something that reads as brown from across a room rather than a colour you have to explain. Skip the prints and the buttons and the detail to begin with, you want one honest piece to test the water, and a plain shape means you can wear it under things as the weather turns without it fighting your coat. Check the seams and the neckline the way you would on anything, but also give the fabric a gentle stretch in the shop, cheap brown knits can go thin and shiny at the seat and elbows faster than other colours seem to, I've no idea why, I just know it happens.
Worn in, a good brown top softens rather than fades, the colour settling into something closer to a warm taupe, and honestly it starts pairing with more of your wardrobe the older it gets, not less.