I think you could wear the blue pants without being matchy matchy, as long as you don't wear blue shoes and jewelry. If you wear the blue pants, you could accessorize with a different color....maybe red or yellow.
I really like that shirt and I think it would look cute with cropped denim and red heels. Light khaki would look good and yellow might work, too. Really, I think it's pretty versatile.