Reinforcement Learning Example Project

1 min
Patrycja Jenkner
21st April, 2022

Here’s a public example project to give you a taste of’s API and the app.

It’s a Reinforcement Learning project that shows how to use Neptune in the training, evaluation, and deployment phases of an RL project.

You can just open the project and play with the app, no registration is needed. And if you want to see the code behind it, go to the example’s GitHub repo

What’s in this Reinforcement Learning example project? 

Here are a few most important things you can see in the project: 

  • You can easily change the columns that are visible in the runs table or filter the runs. You can also save custom views for later. In this project, we have saved several custom views, e.g., “evaluated”, “in prod”, “top”, etc. To switch between views, open the dropdown menu above the runs table.
  • To compare multiple runs, go to the Compare runs tab. You can switch from Charts comparison to Parallel coordinates, Images comparison, or Side-by-side comparison. If you’ve logged artifacts, you can also compare datasets between runs. 
See in the app
Metrics comparison in the Neptune app

By the way, you can choose which runs you want to compare by clicking the eye icon in the runs table. 

  • You can also inspect a single run. Click the Runs details tab at the top of your screen, and you’ll land in the single run’s view. Just below the name of the run, you can see different dashboards.

    The first one is the All metadata dashboard with everything that was logged to Neptune (organized in a folder-like structure). Then, there are Charts, Images, Monitoring, Source code, and more. 
See in the app
Custom dashboard in the Neptune app

Other useful resources

Explore other example projects, e.g. text classification example project or time series forecasting example project

Contact us if you’d like to get a live customized demo specific to your use case. 

Couldn’t find the use case you were looking for?

Just get in touch, and our ML team will create a custom demo for you.