We hope to build an AI agent that can read information about pixels on a computer
Posted: Sun Jan 05, 2025 5:35 am
Before we get into that, your personal story is very interesting. You are the first OpenAI intern. Can you tell us about your personal experience and how you got to where you are today? Jim Fan Of course, I would love to share these stories with you. In the summer of 6, some of my friends told me about a new tap in town and asked me to check it out. I thought to myself, “Well, I have nothing else to do because I’ve already been accepted as a PhD student that summer, so I decided to join this tap, and that’s it.
” The company was OpenAI. When I joined OpenAI, we had cameroon phone numbers already talked about AGI, and my internship mentors were Andrey Karpati and Ilya Sotskever. Together, we talked and started a project called “World of Bits.” The idea of this project is very simple. screen, and then control the keyboard and mouse. If you think about it, this interface is the most versatile.
Everything we do on a computer, like answering emails, playing games, or browsing the web, can be done through this interface, which maps the screen pixels to keyboard and mouse controls. This is actually my first AGI attempt at OpenAI, and it's also the first chapter of my AI agent journey. Stephanie Zhan I remember the World of Bits project, which I didn't know you were involved in, being so interesting. Jim Fan Yes, it's a very interesting project, and it's also part of the OpenAI Universe platform, which is a larger plan to integrate all apps and games into this framework.
” The company was OpenAI. When I joined OpenAI, we had cameroon phone numbers already talked about AGI, and my internship mentors were Andrey Karpati and Ilya Sotskever. Together, we talked and started a project called “World of Bits.” The idea of this project is very simple. screen, and then control the keyboard and mouse. If you think about it, this interface is the most versatile.
Everything we do on a computer, like answering emails, playing games, or browsing the web, can be done through this interface, which maps the screen pixels to keyboard and mouse controls. This is actually my first AGI attempt at OpenAI, and it's also the first chapter of my AI agent journey. Stephanie Zhan I remember the World of Bits project, which I didn't know you were involved in, being so interesting. Jim Fan Yes, it's a very interesting project, and it's also part of the OpenAI Universe platform, which is a larger plan to integrate all apps and games into this framework.