DeepLearning

____________________________________________________

CS5001

Lectures for the weeks of:

2018-10-15

Probability, Markov chains

• Reading:
  • Chapter 8, ArtInt: https://artint.info/2e/html/ArtInt2e.Ch8.html
• Slides:
  • ./08_lect1.pdf
  • ./08_lect2.pdf

2018-10-22

Rationality, utility, decisions

• Reading:
  • Chapter 9, ArtInt: https://artint.info/2e/html/ArtInt2e.Ch9.html
• Sildes:
  • ./09_lect1.pdf
  • ./09_lect2.pdf
• Code: https://artint.info/AIPython/aipython.pdf (explained here)
  • https://artint.info/AIPython/aipython/mdpProblem.py
  • https://artint.info/AIPython/aipython/mdpExamples.py
• Visualizations:
  • http://artint.info/demos/mdp/vi.html
  • ./Applets_local.tar.gz

2018-10-29

Reinforcement learning (RL)

• Slides:
  • ./12_lect3.pdf
  • ./12_lect4.pdf
• Reading:
  • Chapter 12 (skip 10, 11): https://artint.info/2e/html/ArtInt2e.Ch12.html
  • ./RL_survey_Kaelbling1996.pdf
  • http://www.scholarpedia.org/article/Reinforcement_learning
  • http://www.scholarpedia.org/article/Temporal_difference_learning
  • https://en.wikipedia.org/wiki/Reinforcement_learning
  • https://en.wikipedia.org/wiki/Q-learning
  • https://en.wikipedia.org/wiki/State%E2%80%93action%E2%80%93reward%E2%80%93state%E2%80%93action
• Visualizations:
  • ./Applets_local.tar.gz
• Code: https://artint.info/AIPython/aipython.pdf (explained here)
  • https://artint.info/AIPython/aipython/rlProblem.py
  • https://artint.info/AIPython/aipython/rlSimpleEnv.py
  • https://artint.info/AIPython/aipython/rlQLearner.py
  • https://artint.info/AIPython/aipython/rlModelLearner.py
  • https://artint.info/AIPython/aipython/rlFeatures.py
  • https://artint.info/AIPython/aipython/rlSimpleGameFeatures.py
  • https://artint.info/AIPython/aipython/rlPlot.py
• Assignment:
  • ./RL_assignment.tar.gz

Extras

Neural nets (NN)

• Code: https://artint.info/AIPython/aipython.pdf (explained here)
  • https://artint.info/AIPython/aipython/learnNN.py (not simple enough...)
  • More coming soon!
• Slides:
  • ./07_lect3.pdf
• Reading:
  • Chapter 7 ArtInt
  • ./NN_reading_extras.tar.gz (read rougly in order of numbering)

---

Backlinks: index:Classes