Long-Term Planning

Marcus Hutter discusses the importance of removing the Markov assumption and the value of storing all interaction history for long-term planning. He suggests compressing and being selective with the data, but occasionally revisiting old data to reanalyze it based on new experiences.