Math sounds incomplete, it's just... not right. The 's' just finishes it off. But then Americans are incredibly fond of butchering up our poor words, anyway, cutting out 'u's, and the like....
@ your edit: We're debating math vs. maths. I don't think anyone is going to be taking it too seriously.