retreats:2024spring:agenda
Differences
This shows you the differences between two versions of the page.
| Both sides previous revision Previous revision | Last revision Both sides next revision | ||
|
retreats:2024spring:agenda [2024/04/19 11:46] adityagp |
retreats:2024spring:agenda [2024/04/19 11:47] adityagp |
||
|---|---|---|---|
| Line 10: | Line 10: | ||
| Abstract: We are in the midst of a Cambrian explosion of generative AI-enabled user experiences in research and industry. Much of the user interaction with such models has arguably focused on straightforward wrappers for interacting *with* powerful models: UIs collect text prompts for large language models and show text results; or take text input and return images for text-to-image models; etc. We introduce a complementary perspective of interacting *through* generative AI models, by introducing systems that translate information useful for user interaction to (and from) a format appropriate for these models. We call these systems UI Transducers. I will provide an initial characterization of the space of such applications based on a number of examples from our research group. | Abstract: We are in the midst of a Cambrian explosion of generative AI-enabled user experiences in research and industry. Much of the user interaction with such models has arguably focused on straightforward wrappers for interacting *with* powerful models: UIs collect text prompts for large language models and show text results; or take text input and return images for text-to-image models; etc. We introduce a complementary perspective of interacting *through* generative AI models, by introducing systems that translate information useful for user interaction to (and from) a format appropriate for these models. We call these systems UI Transducers. I will provide an initial characterization of the space of such applications based on a number of examples from our research group. | ||
| Afterwards, I will raise a more fundamental question about the role of generative AI in interactive computing systems: Do we even know what we want from these systems? A key implicit assumption of many tools is that the user knows what they want, and they just need appropriate software at the right level of abstraction to specify their goal. However, we know from studying various creative domains that people often don't know what they want a priori. They have a vague, ambiguous idea and it's only through iterative engagement with a medium that they clarify their goal. Taking this perspective has implications for what our generative AI-powered assistants should do for us and how they should engage with us. | Afterwards, I will raise a more fundamental question about the role of generative AI in interactive computing systems: Do we even know what we want from these systems? A key implicit assumption of many tools is that the user knows what they want, and they just need appropriate software at the right level of abstraction to specify their goal. However, we know from studying various creative domains that people often don't know what they want a priori. They have a vague, ambiguous idea and it's only through iterative engagement with a medium that they clarify their goal. Taking this perspective has implications for what our generative AI-powered assistants should do for us and how they should engage with us. | ||
| - | * 10:00-10:25 Shreya Shankar (20min) {{ : | + | * 10:00-10:25 Shreya Shankar (20min) {{ : |
| * 10:25-10.50 - coffee break | * 10:25-10.50 - coffee break | ||
| * 10:50-12:05 (3 talks) | * 10:50-12:05 (3 talks) | ||
retreats/2024spring/agenda.txt · Last modified: 2024/04/23 17:53 by madelon
Page Tools
Except where otherwise noted, content on this wiki is licensed under the following license: CC Attribution-Share Alike 4.0 International
