<?xml version="1.0" encoding="utf-8" standalone="yes"?><rss version="2.0" xmlns:atom="http://www.w3.org/2005/Atom"><channel><title>Multi-Agent Reinforcement Learning | Manuela Chacon-Chamorro</title><link>https://mavivi95.github.io/tags/multi-agent-reinforcement-learning/</link><atom:link href="https://mavivi95.github.io/tags/multi-agent-reinforcement-learning/index.xml" rel="self" type="application/rss+xml"/><description>Multi-Agent Reinforcement Learning</description><generator>Hugo Blox Builder (https://hugoblox.com)</generator><language>en-us</language><lastBuildDate>Fri, 18 Sep 2026 00:00:00 +0000</lastBuildDate><image><url>https://mavivi95.github.io/media/icon_hu_cd51c91342a84ed6.png</url><title>Multi-Agent Reinforcement Learning</title><link>https://mavivi95.github.io/tags/multi-agent-reinforcement-learning/</link></image><item><title>🏔️ My Research Stay in Utah: Science, Language, and Life Abroad</title><link>https://mavivi95.github.io/post/utah/</link><pubDate>Fri, 18 Sep 2026 00:00:00 +0000</pubDate><guid>https://mavivi95.github.io/post/utah/</guid><description>&lt;h4 id="-a-research-experience-abroad"&gt;🌎 A research experience abroad&lt;/h4&gt;
&lt;p&gt;During my doctoral studies, I had the opportunity to complete a research stay at the University of Utah, in the United States. This experience allowed me to work with Professor Daniel S. Brown, learn in a different academic environment, and spend time with people from many different countries.&lt;/p&gt;
&lt;p&gt;From a research perspective, the stay was an important opportunity to step outside my usual environment and examine my work from new perspectives. At a personal level, it was also a meaningful challenge: I had to communicate in English every day, adapt to a different culture, and learn how to navigate academic and everyday life in another country.&lt;/p&gt;
&lt;p&gt;Looking back, I remember this experience not only because of the research, but also because of the people, the campus, the mountains surrounding Salt Lake City, and the snow. As a Latin American researcher experiencing this landscape for the first time, it felt truly special.&lt;/p&gt;
&lt;div class="triple-grid"&gt;
&lt;img src="big_u.jpg" class="vertical-photo" alt="University of Utah campus"&gt;
&lt;img src="montanas.jpg" class="vertical-photo" alt="Mountains surrounding Salt Lake City"&gt;
&lt;img src="snow_days.jpg" class="vertical-photo" alt="Snow in Utah"&gt;
&lt;/div&gt;
&lt;h4 id="-working-on-preference-learning-in-multi-agent-reinforcement-learning"&gt;🧠 Working on preference learning in multi-agent reinforcement learning&lt;/h4&gt;
&lt;p&gt;During the research stay, I worked with Professor Daniel S. Brown on preference learning in multi-agent reinforcement learning.&lt;/p&gt;
&lt;p&gt;One of the central questions behind this work was how to design learning signals that encourage desirable collective behavior in multi-agent systems. In mixed-motive environments, agents must often balance their individual objectives with the welfare and long-term functionality of the group. This tension makes reward and incentive design particularly important.&lt;/p&gt;
&lt;p&gt;Preference learning provides an alternative to manually specifying every component of a reward function. Instead, information obtained from comparisons or rankings between trajectories can be used to infer which behaviors are more desirable. In my research, this perspective is especially relevant for learning incentives aligned with cooperative resilience: the capacity of a multi-agent system to preserve collective well-being when it experiences disruptions.&lt;/p&gt;
&lt;p&gt;Working with Professor Brown gave me the opportunity to discuss these ideas with a researcher whose work has made important contributions to preference-based reinforcement learning. Our conversations helped me think more carefully about reward inference, experimental design, and the connection between human preferences and artificial-agent behavior.&lt;/p&gt;
&lt;div class="triple-grid"&gt;
&lt;img src="utah_presentacion.jpg" class="vertical-photo" alt="Research activities at the University of Utah"&gt;
&lt;/div&gt;
&lt;h4 id="-communicating-in-a-second-language"&gt;🗣️ Communicating in a second language&lt;/h4&gt;
&lt;p&gt;One of the most difficult aspects of the experience was communicating in English. English is not my first language, and at times I needed additional time to understand conversations, organize my ideas, or find the right words to express a technical point.&lt;/p&gt;
&lt;p&gt;At the beginning, this made me feel insecure. I worried about my accent, my grammar, and whether other people would understand what I wanted to say. However, daily interaction gradually helped me become more comfortable.&lt;/p&gt;
&lt;p&gt;I learned that successful communication does not require perfect grammar or a native accent. Most people were patient and flexible, and they were usually more interested in understanding the idea than in evaluating how perfectly it was expressed. When something was unclear, I could ask people to repeat it, speak more slowly, or explain it differently.&lt;/p&gt;
&lt;p&gt;By the end of the stay, I felt genuinely happy and proud that I had managed to communicate, participate in research discussions, and build connections in another language. My English did not suddenly become perfect, but I became more confident using it. That confidence was one of the most valuable outcomes of the experience.&lt;/p&gt;
&lt;h4 id="-living-in-an-international-community"&gt;🏡 Living in an international community&lt;/h4&gt;
&lt;p&gt;I also had the opportunity to live in the university residences. This became an important part of the experience because it allowed me to meet and spend time with people from different countries and cultural backgrounds.&lt;/p&gt;
&lt;p&gt;Daily life in the residences created natural opportunities to talk, share meals, learn about other cultures, and discover how differently people can experience university life. These interactions happened outside formal research meetings, but they contributed enormously to my personal growth.&lt;/p&gt;
&lt;p&gt;Living in a multicultural community reminded me that an international research stay is not only about working in a laboratory or attending academic meetings. It is also about learning how other people live, communicate, collaborate, and understand the world.&lt;/p&gt;
&lt;div class="triple-grid"&gt;
&lt;img src="comida.jpg" class="vertical-photo" alt="University residence in Utah"&gt;
&lt;img src="grupo1.jpeg" class="vertical-photo" alt="Sharing with different cultures"&gt;
&lt;img src="grupo2.jpeg" class="vertical-photo" alt="International community during the research stay"&gt;
&lt;/div&gt;
&lt;h4 id="-the-campus-the-mountains-and-the-snow"&gt;❄️ The campus, the mountains, and the snow&lt;/h4&gt;
&lt;p&gt;Some of my strongest memories of Utah are connected to its landscape. The mountains are visible from many parts of the university, and their presence gives the campus a distinctive atmosphere.&lt;/p&gt;
&lt;p&gt;I also remember the snow. Coming from Colombia, seeing those landscapes and experiencing winter in Utah was beautiful and unforgettable. Even ordinary walks through the campus could feel special because the surroundings were so different from what I was used to.&lt;/p&gt;
&lt;p&gt;Exploring the university and the city helped me create a balance between research and personal life. Those moments gave me time to process the experience, appreciate where I was, and recognize the significance of having reached that point in my doctoral journey.&lt;/p&gt;
&lt;div class="triple-grid"&gt;
&lt;img src="inspiracion_utah.jpg" class="vertical-photo" alt="Cute words"&gt;
&lt;img src="museo_utah.jpg" class="vertical-photo" alt="Utah Love"&gt;
&lt;img src="aros.jpg" class="vertical-photo" alt="Walking around the University of Utah"&gt;
&lt;/div&gt;
&lt;h4 id="-what-the-experience-taught-me"&gt;🌱 What the experience taught me&lt;/h4&gt;
&lt;p&gt;This research stay taught me that academic growth often happens together with personal growth. Learning new methods and discussing research were essential parts of the experience, but so were navigating another culture, communicating despite uncertainty, and becoming more independent.&lt;/p&gt;
&lt;p&gt;It also reminded me that feeling nervous or out of place at the beginning does not mean that we are not prepared for an international experience. Sometimes confidence appears only after we begin: after the first difficult conversation, the first meeting in another language, or the first time we manage to solve an everyday problem by ourselves.&lt;/p&gt;
&lt;p&gt;I returned with new research ideas, greater confidence, and a deeper appreciation for international and interdisciplinary collaboration. I also returned with memories of the people I met, the university residences, the campus, the snow, and the mountains of Utah.&lt;/p&gt;
&lt;h4 id="-advice-for-shy-latin-american-researchers-abroad"&gt;💡 Advice for shy Latin American researchers abroad&lt;/h4&gt;
&lt;p&gt;If you are shy, speak English as a second language, or are preparing for your first research stay abroad, these are some lessons that helped me:&lt;/p&gt;
&lt;ol&gt;
&lt;li&gt;
&lt;p&gt;&lt;strong&gt;Speak even if your English is not perfect.&lt;/strong&gt; You do not need a native accent or perfect grammar to contribute valuable ideas. Speaking is also how fluency and confidence develop in practice.&lt;/p&gt;
&lt;/li&gt;
&lt;li&gt;
&lt;p&gt;&lt;strong&gt;Ask for clarification when you need it.&lt;/strong&gt; It is completely acceptable to ask someone to repeat a sentence, speak more slowly, or explain an unfamiliar expression. Pretending to understand usually creates more difficulty than asking a simple question.&lt;/p&gt;
&lt;/li&gt;
&lt;li&gt;
&lt;p&gt;&lt;strong&gt;Participate in the multicultural life of the university.&lt;/strong&gt; If you live or study in a place with people from many countries, take the opportunity to meet them. Informal conversations and shared activities can become some of the most memorable parts of the experience.&lt;/p&gt;
&lt;/li&gt;
&lt;li&gt;
&lt;p&gt;&lt;strong&gt;Create small opportunities to interact.&lt;/strong&gt; You do not need to attend every social event or speak with everyone. Having lunch with a colleague, joining a campus activity, or starting a short conversation can be enough to gradually feel part of the community.&lt;/p&gt;
&lt;/li&gt;
&lt;li&gt;
&lt;p&gt;&lt;strong&gt;Ask questions and share your ideas in research meetings.&lt;/strong&gt; Shyness can make us wait until an idea feels completely finished. However, research discussions are precisely the place where incomplete ideas can be examined and improved.&lt;/p&gt;
&lt;/li&gt;
&lt;li&gt;
&lt;p&gt;&lt;strong&gt;Explore the campus and the city.&lt;/strong&gt; A research stay is also a cultural and personal experience. Walk around, visit meaningful places, observe daily life, and allow yourself to enjoy the environment beyond the office.&lt;/p&gt;
&lt;/li&gt;
&lt;li&gt;
&lt;p&gt;&lt;strong&gt;Be patient with yourself.&lt;/strong&gt; Adapting to another language, culture, and academic system takes time. Feeling tired, homesick, or insecure does not mean that the experience is going badly.&lt;/p&gt;
&lt;/li&gt;
&lt;li&gt;
&lt;p&gt;&lt;strong&gt;Document the experience.&lt;/strong&gt; Take photographs, write short notes, and record the small moments. With time, these details may become as meaningful as the formal academic achievements.&lt;/p&gt;
&lt;/li&gt;
&lt;/ol&gt;
&lt;h4 id="-closing-thoughts"&gt;💭 Closing thoughts&lt;/h4&gt;
&lt;p&gt;My research stay at the University of Utah was academically valuable and personally unforgettable. It challenged me to communicate in a second language, participate in a new research environment, and live in a multicultural community.&lt;/p&gt;
&lt;p&gt;Most importantly, it showed me that being shy or not speaking perfect English does not prevent us from taking part in international research. We can learn, contribute, communicate, and build meaningful connections while still being ourselves.&lt;/p&gt;
&lt;p&gt;Sometimes the first step is simply accepting that we do not need to feel completely ready before beginning.&lt;/p&gt;</description></item><item><title>Learning Incentive Structures for Cooperative Resilience in Multi-Agent Systems under Social Dilemmas</title><link>https://mavivi95.github.io/publications/arxiv-dic-2026/</link><pubDate>Thu, 29 Jan 2026 00:00:00 +0000</pubDate><guid>https://mavivi95.github.io/publications/arxiv-dic-2026/</guid><description>&lt;p&gt;&lt;strong&gt;Abstract.&lt;/strong&gt; Multi-agent social dilemmas, such as the tragedy of the commons, capture settings where individual incentives conflict with collective well-being, making these systems highly vulnerable to collapse under disruptions. In this context, this work studies cooperative resilience, understood as the system-level ability to maintain collective well-being under perturbations through adaptive agent behavior. We propose a framework for learning incentive structures aligned with collective well-being in multi-agent reinforcement learning systems, where reward functions shape individual decision-making and collective behavior. A resilience metric is used to score and rank agent trajectories, allowing the inference of reward functions that promote resilient collective behavior. These inferred reward functions are integrated into the multi-agent reinforcement learning process to shape agent interactions in social dilemma settings. The approach is evaluated in resource-sharing environments subject to disruptions, using three incentive structures: individual incentives, resilience-aligned incentives, and a hybrid incentive structure that combines both individual and collective components. The results show that the hybrid incentive structure promotes sustained collective behavior, reduces collapse events associated with resource depletion, and preserves system performance under disruption. These findings highlight the role of incentive design as a mechanism for promoting resilient collective behavior and provide a computational framework for multi-agent social dilemmas under disruptions.&lt;/p&gt;</description></item></channel></rss>