See https://github.com/tensorflow/agents/commit/164f62032696e06f616268a51d32ca6b84dcbf15#diff-82bda908f176861c20aadc1d017c2527
See https://github.com/tensorflow/agents/commit/164f62032696e06f616268a51d32ca6b84dcbf15#diff-82bda908f176861c20aadc1d017c2527