A silver dress is not a safe choice, it is a loud one, and that is the whole point of buying it. The colour catches light in a way that plain black or navy never will, so it reads as an occasion dress the second you put it on, even if the cut underneath is quite simple. If you want something that quietly blends in at a party, this is the wrong direction entirely, because silver does the opposite of blend. It announces you walked in.
The honest limit is daylight and anything casual. Silver can look slightly costumey under office lighting or at a lunch, and it loses its shine fast outdoors on an overcast afternoon, turning flat and a bit grey instead of metallic. It also shows every mark differently to a dark dress, a smudge of foundation or a splash from a drink sits there obviously, so it is not the dress for anything with a buffet or a lot of standing around with a full glass. Sequinned or foiled versions in particular need babying, they do not love being screwed up at the bottom of a bag for a journey, the finish can crack or shed if you fold them tight, so if you are travelling to wherever you are wearing it, hang it rather than pack it flat.
Fit matters more with silver than with most colours, because the fabric tends to be less forgiving and more clingy, especially satin and metallic jersey versions. Go up a size if you are between two, since a silver dress that is too snug will pull across the stomach and show every seam of your underwear, and seamless or nude shapewear underneath is doing a lot of the work most people assume the dress is doing on its own. Check the length sitting down as well as standing, metallic fabric often rides up more than you expect, and check the straps, cheap ones stretch out of shape after a couple of wears and start slipping.
Where it earns its slot is evening events with proper lighting, weddings as a guest, parties, anything after dark where you want to photograph well under flash or fairy lights rather than under a strip light. Winter suits it better than summer, it reads as festive and cold weather appropriate in a way it does not in July. It holds up reasonably well over a season if you hand wash or dry clean rather than machine wash, a hot wash is the fastest way to dull the shine and warp a cheaper fabric.
Keep jewellery and bags simple, gold accessories usually clash rather than complement, and too much glitter elsewhere, on shoes or a clutch, turns the whole look costumey instead of polished. One strong metallic element is plenty, everything else should be plain.