Mill Computing, Inc. Forums The Mill Markets Stochastic rounding for machine learning Reply To: Stochastic rounding for machine learning

Ivan Godard
Post count: 629

We once had a stochastic rounding mode defined; the idea was to explore the rounding sensitivity of an algorithm. The other members of the IEEE 754 (FP) committee dumped all over the idea, for reasons too technical for here even if I remember them correctly (I am not a math analysis guy),

However, your note is the first I have heard of stochastic being of use in neural networks. Could you post a few links for (elementary, tutorial) material on the subject?