The project is to evolve bots that plays three (Breakout, Centipede, and Ms. Pacman) Atari 2600 games. You will use OpenAI's Gym.

Intermediate Deliverable One

Due Thursday, 24 October 2019 at the beginning of class.

• Follow the general homework directions. Make sure you cite all your references and contacts.
• Hand code a bot that plays Breakout.
  • Follow the Getting Started with Gym instructions to install and test the Gym system.
  • You may use either the RAM model or the screen model.
• Turn in
• Your working code.
• A short (2 pages, single spaced) write-up explaining how you designed your bot, how well it performed, and lessons learned.

Intermediate Deliverable Two

Due Thursday, 14 November 2017 at the beginning of class.

• Develop a complete system for evolving and testing your bot on Breakout.
• Turn in
• Your working code.
• A short (2 pages, single spaced) write-up explaining how you designed your bot , lessons learned, and high score.

Final Deliverable

Due: Thursday, 5 December 2019 at the beginning of class

• Evolve bots that play Breakout, Centipede, and Ms. Pacman. Your bots should have tuned evolutionary parameters and been thoroughly evaluted on the OpenAI's Gym system.
• Turn in
• Your working code.
• A write-up (up t0 10 pages, single spaced) of the project explaining your design choices, the evolution and effectiveness of your bots, and lessons learned.
• Be prepared to give a presentation on Thursday, 5 December 2019.
• Rubric