If you let the mud remain visible, you imply that invisibility can be nullified by nonmagical means (e.g., flinging sacks of flour into the air). That's how we play it IMC, but some DMs think that makes invisibility too weak.
[Edited because I said "i.e." when I meant "e.g."]