Project 1: Desperately Seeking Sutton

The repo contains code to run experiments required for CS 7642 Summer 2018 Project 1.

• Required packages: Python 2.7.13, Numpy 1.12.1, Scipy 0.19.0, Matplotlib 2.0.2.
• The repo contains:
  • README.md: this file, description of this repo
  • data: folder containing all simulated random walk data
  • problem: a chart that illustrates the random walk problem
  • report: report in PDF and LaTex format, and accessory files
  • results: generated results and plots from experiments
  • p1.py: python scritpt containing classes used for this project
  • run_p1.py: experiments for this project
• Perform experiments by running python run_p1.py from terminal.