Have you looked at non-puffy vests? Or is the puffy look you like?
Yeah I'm more of a fan of the puffy look, although I'm not a stranger to wearing waistcoats or vests with light padding. It might sound weird but I prefer having less on my arms.
I like this vest for non-work. Warm, light and useful.
For casual my defaults are a shirt with a collar, dark blue jeans and brogues or oxfords.
Add that vest and you have a light warm layer and a place for your phone.
I work in IT so I can ware it to work also. I just don't wear it under a blazer and expect it to look good.
Ah cool, nice one. What style shirt do you go for? I wanna try out wearing a shirt with a vest casually but not sure what shirt to get.
Fitted Polos work fine. I also like some Patagonia shirts. The shirts should always be tucked in. Except when they should not. Which only really applies to shirts with a square bottom and only when they are not buttoned up. But that is my view.
Best thing to do is go to the mall grab some catalogs from stores with vests and cut out the photos. Be sure to cut off the heads also. Then you will see the styles and ideas.