Page Not Found
Page not found. Your pixels are in another canvas.
Sitemap
A list of all the posts and pages found on the site. For you robots out there is an XML version available for digesting as well.
Pages
Susobhan Ghosh
Applied Scientist II at Amazon; PhD in Computer Science from Harvard
Page not in menu
This is a page not in th emain menu
Posts
Future Blog Post
Published:
This post will show up by default. To disable scheduling of future posts, edit config.yml and set future: false.
Blog Post number 4
Published:
This is a sample blog post. Lorem ipsum I can’t remember the rest of lorem ipsum and don’t have an internet connection right now. Testing testing testing this blog post. Blog posts are cool.
Blog Post number 3
Published:
This is a sample blog post. Lorem ipsum I can’t remember the rest of lorem ipsum and don’t have an internet connection right now. Testing testing testing this blog post. Blog posts are cool.
Blog Post number 2
Published:
This is a sample blog post. Lorem ipsum I can’t remember the rest of lorem ipsum and don’t have an internet connection right now. Testing testing testing this blog post. Blog posts are cool.
Blog Post number 1
Published:
This is a sample blog post. Lorem ipsum I can’t remember the rest of lorem ipsum and don’t have an internet connection right now. Testing testing testing this blog post. Blog posts are cool.
portfolio
Portfolio item number 1
Short description of portfolio item number 1
Portfolio item number 2
Short description of portfolio item number 2
publications
VidyutVanika: A Reinforcement Learning Based Broker Agent for a Power Trading Competition
Published in In the proceedings of The Thirty-Third AAAI Conference on Artificial Intelligence, AAAI 2019, The Thirty-First Innovative Applications of Artificial Intelligence Conference, IAAI 2019, The Ninth AAAI Symposium on Educational Advances in Artificial Intelligence, EAAI 2019, Honolulu, Hawaii, USA, January 27 - February 1, 2019, 2019
Recommended citation: Susobhan Ghosh, Easwar Subramanian, Sanjay Bhat, Sujit Gujar, Praveen Paruchuri, "VidyutVanika: A Reinforcement Learning Based Broker Agent for a Power Trading Competition." In the proceedings of The Thirty-Third AAAI Conference on Artificial Intelligence, AAAI 2019, The Thirty-First Innovative Applications of Artificial Intelligence Conference, IAAI 2019, The Ninth AAAI Symposium on Educational Advances in Artificial Intelligence, EAAI 2019, Honolulu, Hawaii, USA, January 27 - February 1, 2019, 2019. https://doi.org/10.1609/aaai.v33i01.3301914
Bidding in Smart Grid PDAs: Theory, Analysis and Strategy
Published in In the proceedings of The Thirty-Fourth AAAI Conference on Artificial Intelligence, AAAI 2020, The Thirty-Second Innovative Applications of Artificial Intelligence Conference, IAAI 2020, The Tenth AAAI Symposium on Educational Advances in Artificial Intelligence, EAAI 2020, New York, NY, USA, February 7-12, 2020, 2020
Recommended citation: Susobhan Ghosh, Sujit Gujar, Praveen Paruchuri, Easwar Subramanian, Sanjay Bhat, "Bidding in Smart Grid PDAs: Theory, Analysis and Strategy." In the proceedings of The Thirty-Fourth AAAI Conference on Artificial Intelligence, AAAI 2020, The Thirty-Second Innovative Applications of Artificial Intelligence Conference, IAAI 2020, The Tenth AAAI Symposium on Educational Advances in Artificial Intelligence, EAAI 2020, New York, NY, USA, February 7-12, 2020, 2020. https://ojs.aaai.org/index.php/AAAI/article/view/5568
Efficient Algorithms for Finite Horizon and Streaming Restless Multi-Armed Bandit Problems
Published in In the proceedings of 21st International Conference on Autonomous Agents and Multiagent Systems, AAMAS 2022, Auckland, New Zealand, May 9-13, 2022, 2022
Recommended citation: Aditya Mate, Arpita Biswas, Christoph Siebenbrunner, Susobhan Ghosh, Milind Tambe, "Efficient Algorithms for Finite Horizon and Streaming Restless Multi-Armed Bandit Problems." In the proceedings of 21st International Conference on Autonomous Agents and Multiagent Systems, AAMAS 2022, Auckland, New Zealand, May 9-13, 2022, 2022. https://www.ifaamas.org/Proceedings/aamas2022/pdfs/p880.pdf
Facilitating Human-Wildlife Cohabitation through Conflict Prediction
Published in In the proceedings of Thirty-Sixth AAAI Conference on Artificial Intelligence, AAAI 2022, Thirty-Fourth Conference on Innovative Applications of Artificial Intelligence, IAAI 2022, The Twelveth Symposium on Educational Advances in Artificial Intelligence, EAAI 2022 Virtual Event, February 22 - March 1, 2022, 2022
Recommended citation: Susobhan Ghosh, Pradeep Varakantham, Aniket Bhatkhande, Tamanna Ahmad, Anish Andheria, Wenjun Li, Aparna Taneja, Divy Thakkar, Milind Tambe, "Facilitating Human-Wildlife Cohabitation through Conflict Prediction." In the proceedings of Thirty-Sixth AAAI Conference on Artificial Intelligence, AAAI 2022, Thirty-Fourth Conference on Innovative Applications of Artificial Intelligence, IAAI 2022, The Twelveth Symposium on Educational Advances in Artificial Intelligence, EAAI 2022 Virtual Event, February 22 - March 1, 2022, 2022. https://ojs.aaai.org/index.php/AAAI/article/view/21518
Using Public Data to Predict Demand for Mobile Health Clinics
Published in In the proceedings of Thirty-Sixth AAAI Conference on Artificial Intelligence, AAAI 2022, Thirty-Fourth Conference on Innovative Applications of Artificial Intelligence, IAAI 2022, The Twelveth Symposium on Educational Advances in Artificial Intelligence, EAAI 2022 Virtual Event, February 22 - March 1, 2022, 2022
Recommended citation: Haipeng Chen, Susobhan Ghosh, Gregory Fan, Nikhil Behari, Arpita Biswas, Mollie Williams, Nancy Oriol, Milind Tambe, "Using Public Data to Predict Demand for Mobile Health Clinics." In the proceedings of Thirty-Sixth AAAI Conference on Artificial Intelligence, AAAI 2022, Thirty-Fourth Conference on Innovative Applications of Artificial Intelligence, IAAI 2022, The Twelveth Symposium on Educational Advances in Artificial Intelligence, EAAI 2022 Virtual Event, February 22 - March 1, 2022, 2022. https://ojs.aaai.org/index.php/AAAI/article/view/21513
ArchGym: An Open-Source Gymnasium for Machine Learning Assisted Architecture Design
Published in In the proceedings of Proceedings of the 50th Annual International Symposium on Computer Architecture, 2023
Use Google Scholar for full citation
Recommended citation: Srivatsan Krishnan, Amir Yazdanbakhsh, Shvetank Prakash, Jason Jabbour, Ikechukwu Uchendu, Susobhan Ghosh, Behzad Boroujerdian, Daniel Richins, Devashree Tripathy, Aleksandra Faust, Vijay Reddi, "ArchGym: An Open-Source Gymnasium for Machine Learning Assisted Architecture Design." In the proceedings of Proceedings of the 50th Annual International Symposium on Computer Architecture, 2023.
Did we personalize? Assessing personalization by an online reinforcement learning algorithm using resampling
Published in arXiv preprint arXiv:2304.05365, 2023
Use Google Scholar for full citation
Recommended citation: Susobhan Ghosh, Raphael Kim, Prasidh Chhabria, Raaz Dwivedi, Predrag Klasjna, Peng Liao, Kelly Zhang, Susan Murphy, "Did we personalize? Assessing personalization by an online reinforcement learning algorithm using resampling." arXiv preprint arXiv:2304.05365, 2023.
Fairness for Workers Who Pull the Arms: An Index Based Policy for Allocation of Restless Bandit Tasks
Published in In the proceedings of 22nd International Conference on Autonomous Agents and Multiagent Systems, AAMAS 2023, London, United Kingdom, May 29 - June 2, 2023, 2023
Recommended citation: Arpita Biswas, Jackson Killian, Paula Diaz, Susobhan Ghosh, Milind Tambe, "Fairness for Workers Who Pull the Arms: An Index Based Policy for Allocation of Restless Bandit Tasks." In the proceedings of 22nd International Conference on Autonomous Agents and Multiagent Systems, AAMAS 2023, London, United Kingdom, May 29 - June 2, 2023, 2023. https://doi.org/10.48550/arXiv.2303.00799
VidyutVanika: AI-Based Autonomous Broker for Smart Grids: From Theory to Practice
Published in In the proceedings of Energy Sustainability through Retail Electricity Markets: The Power Trading Agent Competition (Power TAC) Experience, 2023
Use Google Scholar for full citation
Recommended citation: Sanjay Chandlekar, Bala Pedasingu, Susobhan Ghosh, Easwar Subramanian, Sanjay Bhat, Praveen Paruchuri, Sujit Gujar, "VidyutVanika: AI-Based Autonomous Broker for Smart Grids: From Theory to Practice." In the proceedings of Energy Sustainability through Retail Electricity Markets: The Power Trading Agent Competition (Power TAC) Experience, 2023.
A mobile health intervention for emerging adults with regular cannabis use: A micro-randomized pilot trial design protocol
Published in Contemporary Clinical Trials, 2024
Use Google Scholar for full citation
Recommended citation: Lara Coughlin, Maya Campbell, Tiffany Wheeler, Chavez Rodriguez, Autumn Florimbio, Susobhan Ghosh, Yongyi Guo, Pei-Yao Hung, Mark Newman, Huijie Pan, Kelly Zhang, Lauren Zimmermann, Erin Bonar, Maureen Walton, Susan Murphy, Inbal Nahum-Shani, "A mobile health intervention for emerging adults with regular cannabis use: A micro-randomized pilot trial design protocol." Contemporary Clinical Trials, 2024.
Did we personalize? assessing personalization by an online reinforcement learning algorithm using resampling
Published in Machine Learning, 2024
Use Google Scholar for full citation
Recommended citation: Susobhan Ghosh, Raphael Kim, Prasidh Chhabria, Raaz Dwivedi, Predrag Klasnja, Peng Liao, Kelly Zhang, Susan Murphy, "Did we personalize? assessing personalization by an online reinforcement learning algorithm using resampling." Machine Learning, 2024.
ReBandit: Random Effects Based Online RL Algorithm for Reducing Cannabis Use
Published in In the proceedings of Thirty-Third International Joint Conference on Artificial Intelligence (IJCAI-24), 2024
Use Google Scholar for full citation
Recommended citation: Susobhan Ghosh, Yongyi Guo, Pei-Yao Hung, Lara Coughlin, Erin Bonar, Inbal Nahum-Shani, Maureen Walton, Susan Murphy, "ReBandit: Random Effects Based Online RL Algorithm for Reducing Cannabis Use." In the proceedings of Thirty-Third International Joint Conference on Artificial Intelligence (IJCAI-24), 2024.
“It felt more real”: Investigating the User Experience of the MiWaves Personalizing JITAI Pilot Study
Published in EAI International Conference on Pervasive Computing Technologies for Healthcare, 2025
Recommended citation: Susobhan Ghosh, Pei-Yao Hung, Lara N. Coughlin, Erin E. Bonar, Yongyi Guo, Inbal Nahum-Shani, Maureen Walton, Mark W. Newman, Susan A. Murphy. ""It felt more real": Investigating the User Experience of the MiWaves Personalizing JITAI Pilot Study." EAI International Conference on Pervasive Computing Technologies for Healthcare, 2025. https://arxiv.org/pdf/2502.17645
Deployable Online Reinforcement Learning Algorithms for Use-inspired Research in Digital Health
Published in PhD Thesis, Harvard University, 2026
PhD thesis, Harvard University, 2026.
Recommended citation: Susobhan Ghosh. "Deployable Online Reinforcement Learning Algorithms for Use-inspired Research in Digital Health." PhD Thesis, Harvard University, 2026.
Digital Twins for Just-in-Time Adaptive Interventions (JITAI-Twins): A Framework for Optimizing and Continually Improving JITAIs
Published in Journal of Medical Internet Research, 2026
Recommended citation: Asim H. Gazi, Daiqi Gao, Susobhan Ghosh, Ziping Xu, Anna Trella, Predrag Klasnja, Susan A. Murphy. "Digital Twins for Just-in-Time Adaptive Interventions (JITAI-Twins): A Framework for Optimizing and Continually Improving JITAIs." Journal of Medical Internet Research, 2026. https://doi.org/10.2196/72830
Effective monitoring of online AI decision-making algorithms in just-in-time adaptive interventions
Published in npj Digital Medicine, 2026
Recommended citation: Susobhan Ghosh*, Anna Trella*, Erin Bonar, Lara Coughlin, Finale Doshi-Velez, Yongyi Guo, Pei-Yao Hung, Inbal Nahum-Shani, Vivek Shetty, Maureen Walton, Iris Yan, Kelly Zhang, Susan Murphy. "Effective monitoring of online AI decision-making algorithms in just-in-time adaptive interventions." npj Digital Medicine, 2026. https://doi.org/10.1038/s41746-026-02669-4
Key Concepts in Online Learning and Decision Making for Personalizing Just-in-Time Adaptive Interventions (pJITAIs)
Under Review, 2026
Recommended citation: Asim Gazi, Susobhan Ghosh, Yongyi Guo, Daiqi Gao, Ziping Xu, Inbal Nahum-Shani, Susan A. Murphy. "Key Concepts in Online Learning and Decision Making for Personalizing Just-in-Time Adaptive Interventions (pJITAIs)." Under Review, 2026. https://doi.org/10.31234/osf.io/47w3e_v2
Mobile intervention for emerging adults with regular cannabis use: a micro-randomized trial
Published in The Lancet Regional Health - Americas, 61, 2026
Recommended citation: Maureen Walton, Inbal Nahum-Shani, Maya Campbell, Devin C. Tomlinson, Autumn Rae Florimbio, Susobhan Ghosh, Yongyi Guo, Pei-Yao Hung, Mark W. Newman, Jeremy J. Lin, Tianchen Qian, John Dziak, Huijie Pan, Kelly W. Zhang, Lauren Zimmermann, Erin E. Bonar, Susan A. Murphy, Lara N. Coughlin. "Mobile intervention for emerging adults with regular cannabis use: a micro-randomized trial." The Lancet Regional Health - Americas, 61, 2026. https://doi.org/10.1016/j.lana.2026.101524
Reproducible workflow for online AI in digital health
Published in Philosophical Transactions of The Royal Society A, 2026
Recommended citation: Susobhan Ghosh*, Bhanu T. Gulapalli*, Daiqi Gao, Asim Gazi, Anna Trella, Ziping Xu, Kelly Zhang, Susan A. Murphy. "Reproducible workflow for online AI in digital health." Philosophical Transactions of The Royal Society A, 2026. https://arxiv.org/abs/2509.13499
talks
Review of Sidebar and it’s functionality
Published:
Summary of my entire work on 'Review of Sidebar and it's functionality' for LibreOffice during Google Summer of Code 2016
VidyutVanika: A Reinforcement Learning Based Broker Agent for a Power Trading Competition
Published:
MiWaves
Published:
Invited upcoming talk
Published:
Invited upcoming talk
Published:
teaching
Teaching experience 1
Undergraduate course, University 1, Department, 2014
This is a description of a teaching experience. You can use markdown like any other post.
Teaching experience 2
Workshop, University 1, Department, 2015
This is a description of a teaching experience. You can use markdown like any other post.