I experimented with creating an OpenAI gym environment for the Rocket League Bot project.
gym
I forked the RLBot repo here, the gym environment can be found here and the DDPG implementation of a bot is on here.