In this talk I will review the basics of the relevant Deep Learning and RL algorithms and present some new ways of learning and representing dependencies across space and time using recent advances in these areas. One way we’ve approached this already in ECEUWML lab is in the forest fire domain were we use RL to learn a model of fire spread from satellite images. The algorithm then learns a policy for a wildfire spreading across a landscape based on the local conditions as if the wildfire were an agent making decisions about where to move next. One exciting possibility for this kind of work is the promise of learning interpretable models and aiding domain experts in creating rich, agent-based models based on data by automatically generating agent-based components from raw data such as satellite imagery. This approach is still new but could provide a much needed connection between parallel research already going on in the agent-based modelling and AI/ML research communities.
Mark Crowley is an Assistant Professor in the Department of Electrical and Computer Engineering at the University of Waterloo. He received his Ph.D. in Computer Science from the University of British Columbia in 2011.
He is a core member of the Waterloo Institute for Complexity and Innovation. His research seeks to find dependable and transparent ways to augment human decision making in complex and safety-critical domains.
His research program investigates the theoretical and practical challenges that arise from this goal for domains where the complexity arises from the presence of spatial structure, large scale streaming data, or uncertainty.
These types of domains offer unique challenges for traditional artificial intelligence and machine learning (AI/ML) algorithms for decision making, prediction and anomaly detection. Most of his work focusses on developing new algorithms within the fields of Reinforcement Learning, Deep Learning and Random Forests. Dr. Crowley often works in collaboration with researchers in other fields such as sustainable forest management, ecology, automotive technology and medical imaging. He is an active part of building the interdisciplinary Computational Sustainability research community with a focus on forest wildfire prediction and control, invasive species management and flood prediction.