I think grey would be more cohesive, considering the sweater is grey. You could do something like this or this with that look. Tucking it in is also a great idea. You could do a belt and create a sense of separation.

What about something that adds a pop of color to the whole mix? Maybe a thick red bracelet?