For me it's mnemonic*; I think of the Meet (Join) symbol as pointing up (down) to the elements in the subset (and the up-arrow occurs twice in M, while the down-arrow is vaguely J-shaped).

*I hope this doesn't cancel w/ the anti-mnemonic; you should probably try to forget at least one of these:-)