Are there OpenAI Gym continuing environments (other than inverted pendulum) and baselines?

I would like to use OpenAI Gym to solve a continuing environment, that is, a problem with a single, never-ending episode (please note I don’t mean a continuous environment with continuous state and actions). The only continuing environment I found in their repository was the classic inverted pendulum problem, and I found no baseline methods…

What topics lie at the cutting edge in the following areas?

I am trying to get an idea of the topics and challenges that lie on the cutting edge of any of the following areas: (1) machine learning and probabilistic inference – such as graphical models, kernel methods, nonparametric Bayesian methods, reinforcement learning, problem solving, decisions, and games. (2) knowledge representation and reasoning – such as…