It's fully possible for a computer to do symbolic math without reducing the symbols to a decimal.

Of course! I meant my comment to be tongue in cheek, but saying that some numbers are uncomputable is not incompatible with symbolic math on a computer. Note that for example Pi is computable, despite having an infinite decimal expansion.