PyTorch implementation of deep reinforcement learning algorithms for investigating critic loss functions, tail exponents, multi-step returns, and multiplicative dynamics.