Workshop on Foundation Models: Day 2 скачать в хорошем качестве

Workshop on Foundation Models: Day 2

The Center for Research on Foundation Models (CRFM), a new initiative of the Stanford Institute for Human-Centered Artificial Intelligence (HAI), hosted the Workshop on Foundation Models from August 23-24, 2021. By foundation model (e.g. BERT, GPT-3, DALL-E), we mean a single model that is trained on raw data, potentially across multiple modalities, which can be usefully adapted to a wide range of tasks. These models have demonstrated clear potential, which we see as the beginnings of a sweeping paradigm shift in AI. They represent a dramatic increase in capability in terms of accuracy, generation quality, and extrapolation to new tasks, but they also pose clear risks such as use for widespread disinformation, potential exacerbation of historical inequities, and problematic centralization of power. Experts from a diverse array of perspectives and backgrounds convened to address the opportunities, challenges, limitations, and societal impact of these models. Day 2: Session III: Industry and Applications Is Scale All We Need? Slav Petrov, Distinguished Scientist and Senior Research Director, Google The Economic Implications of Foundation Models Erik Brynjolfsson, Jerry Yang and Akiko Yamazaki Professor and Senior Fellow, HAI; Director of the Stanford Digital Economy Lab; Ralph Landau Senior Fellow, SIEPR, Stanford University Breaking the Systems Bottleneck: Faster and Cheaper Model Training Matei Zaharia, Assistant Professor of Computer Science, Stanford University Towards Transparent Foundations -- Building Accessible Infrastructure for Training Large-Scale Language Models Siddharth Karamcheti, PhD Student in Computer Science, Stanford University Laurel Orr, Postdoctoral Fellow in Computer Science, Stanford University Joint Q&A Panel Slav Petrov, Distinguished Scientist and Senior Research Director, Google Michael Carbin, Associate Professor of Electrical Engineering and Computer Science, MIT Pascale Fung, Director, Center for Artificial Intelligence Research; Professor of Electronic and Computer Engineering and Professor of Computer Science and Engineering, Hong Kong University of Science and Technology Ilya Sutskever, Co-Founder and Chief Scientific Officer, OpenAI Jakob Uszkoreit, Co-Founder and Chief Technology Officer, Inceptive Thomas Wolf, Chief Scientific Officer, Hugging Face Chris Ré (moderator), Associate Professor of Computer Science, Stanford University Break Session IV: Harms and Society Presentations Cementing a Foundation of Inequity in AI Margaret Mitchell, Research Scientist, Ethical AI, Hugging Face Anti-Muslim biases in large language models James Zou, Assistant Professor of Biomedical Data Science, Stanford University How Foundation Models will Shape Disinformation, and Implications for Human Detection Shelby Grossman, Research Scholar on Disinformation in Africa, Stanford Internet Observatory Homogenization and the Ethics of Scale Katie Creel, Postdoctoral Research Fellow of Philosophy, McCoy Family Center for Ethics in Society; Embedded EthiCS Fellow, HAI, Stanford University Joint Q&A Panel Margaret Mitchell, Research Scientist, Ethical AI Angèle Christin, Assistant Professor of Communication, Stanford University Sarah Kreps, Chair and John L. Wetherill Professor of Government, Cornell University Sameer Singh, Associate Professor of Computer Science, University of California, Irvine Rob Reich (moderator), Professor of Political Science; Director of the Center for Ethics in Society; Co-director of the Center on Philanthropy and Civil Society; Associate Director, Stanford Institute for Human-Centered Artificial Intelligence, Stanford University Closing Remarks Percy Liang, Associate Professor of Computer Science, Stanford University Watch Day 1 here:    • Workshop on Foundation Models: Day 1   Learn more about the Center for Research on Foundation Models: https://crfm.stanford.edu/index.html