Scale Virtual Events
+00:00 GMT

Scale Zeitgeist: AI Readiness Report

Sri Viswanath, Benny Du, Vijay Karunamurthy, Bihan Jiang & Fernando Amat

What’s Next for Computer Vision?

Nate Harada & Noah Gale
Popular topics
# TransformX 2022
# Fireside Chat
# TransformX 2021
# Keynote
# Tech Talk
# Computer Vision
# Transform 2021
# Breakout Session
# The Week in AI
# AI Policy & Governance
# Autonomous Vehicles
# AI in Healthcare
# Natural Language Processing (NLP)
# Expert Panel
# AI in Retail & eCommerce
# Robotics
# Research Review
# AI in National Security
# Large Language Models (LLMs)
# MLOps & Infrastructure
Sri Viswanath
Benny Du
Vijay Karunamurthy
Bihan Jiang
Fernando Amat
Sri Viswanath, Benny Du, Vijay Karunamurthy, Bihan Jiang & Fernando Amat · Apr 27th, 2023

Scale Zeitgeist: AI Readiness Report

In this talk, we'll discuss the results of the Scale Zeitgeist: AI Readiness Report. Scale’s AI Readiness Report is a survey of more than 1,700+ ML practitioners and Leaders on the challenges and best practices with building and adopting AI applications. The report explores the impact of large generative models such as LLMs, as well as examining every stage of the ML lifecycle from data and annotation to model development, deployment, and monitoring. The goal of the report is to empower organizations and ML practitioners to learn and implement best practices and unlock the full potential of AI for every business. Vijay Karunamurthy, Field CTO at Scale, hosts a panel discussion discussing the results of the report and best practices to apply these findings as companies look to build and work with ML, including best practices on RLHF and fine-tuning large models. The panel features: Sri Viswanath, General Partner at Coatue Benny Du, Senior Manager at Accenture Bihan Jiang, Product Manager at Scale Fernando Amat Gil, Senior Staff Machine Learning Research Engineer
David Rokeach
Jonathan Rosenbluth
Bihan Jiang
David Rokeach, Jonathan Rosenbluth & Bihan Jiang · Apr 27th, 2023

The 2023 Zeitgeist Report - Generative AI and Best Practices for Enterprise Adoption

In this talk, we'll discuss the results of the 2nd edition of Scale Zeitgeist: AI Readiness Report. Scale surveyed more than 1,600 executives and ML practitioners on the challenges and best practices of building and adopting AI. With this report, we help you look past the hype and explore the impact of generative models such as Large Language Models (LLMs), and how organizations can deploy AI for real business impact. Bihan Jiang, Product Manager at Scale will host a discussion with David Rokeach, VP of Enterprise AI at Scale, and Jonathan Rosenbluth, Director of Product Strategy at Cohere, to discuss the results of the report and best practices in adopting AI in the Enterprise.
Join Riley Goodside as he discusses Advanced Prompt Engineering and RLHF. Prompt engineering is the magic behind top-notch language model responses. A well-written prompt is crucial for avoiding off-topic, inconsistent, or offensive output. It's a challenging task that requires a nuanced understanding of how to talk to the models, with many research conferences and papers written on the best prompting techniques. During this webinar, you'll learn some of the most innovative prompting strategies.
Nate Harada
Noah Gale
Nate Harada & Noah Gale · Feb 24th, 2023

What’s Next for Computer Vision?

We’ve all seen significant changes in NLP in the last few years, as models have moved from highly-supervised, recurrent structures into transformers and large-scale, unsupervised models. Now, with the use of LLMs at an all-time high, we have to ask the question – has computer vision stagnated? Join Nate Harada (creator of open-source toolkit Moonshine, perception at Waymo and Cruise) along with moderator Noah Gale (co-founder at Tribe AI) as they discuss the most exciting current developments in computer vision and where the field is headed, including: How we got here – Has computer vision stagnated? The landscape – What’s most exciting in CV right now? What’s coming – Where are the most exciting opportunities in CV? From startup to scale – How to think about investing in labeled data sets, structuring teams, and evaluating success at every stage
Tribe AI CEO Jacyln Rice Nelson interviews Brendan Ittelson, CTO at Zoom, covering Brendan’s career, innovation at scale, trends in digital communications, and – of course – how Zoom is using AI. This conversation details charting a career from technology into leading technical teams, how to build a resilient org in uncertain times, how simplicity enables scale, the role of company mission for a CTO, how Zoom is using machine learning, and what's next in the era of digital communications.
Vishal Asnani
Vishal Asnani · Jan 31st, 2023

Reverse Engineering of Generative Models

State-of-the-art (SOTA) Generative Models (GMs) can synthesize photo-realistic images that are hard for humans to distinguish from genuine photos. Identifying and understanding manipulated media are crucial to mitigate the social concerns on the potential misuse of GMs. We propose to perform reverse engineering of GMs to infer model hyperparameters from the images generated by these models. We define a novel problem, "model parsing", as estimating GM network architectures and training loss functions by examining their generated images - a task seemingly impossible for human beings. To tackle this problem, we propose a framework with two components: a Fingerprint Estimation Network (FEN), which estimates a GM fingerprint from a generated image by training with four constraints to encourage the fingerprint to have desired properties, and a Parsing Network (PN), which predicts network architecture and loss functions from the estimated fingerprints. To evaluate our approach, we collect a fake image dataset with 100K images generated by 116 different GMs. Extensive experiments show encouraging results in parsing the hyperparameters of the unseen models. Finally, our fingerprint estimation can be leveraged for deepfake detection and image attribution, as we show by reporting SOTA results on both the deepfake detection (Celeb-DF) and image attribution benchmarks.
Understanding the contents of a large corpus of text, like customer reviews or tweets, is a frequently encountered challenge and a significant ML research undertaking. One approach to tackling this problem is topic modeling. We experience it daily - from trending topics on Twitter to key topics in Amazon's product reviews. In this talk, Prem presents a survey of influential methods like LDA and NMF. He then compares them to recent advances in large language models that began with transformers and showcases techniques to apply them, their effectiveness in tackling this problem, and the challenges that come with them. Prem Viswanathan is a member of Tribe AI, a collective of 250+ engineers and data scientists from industry leaders in AI. He’s also the the Co-Founder & CTO of SwiftCX - an intelligent automation platform for customer teams. Prem also serves as an adjunct faculty at Carnegie Mellon University, Pittsburgh. Previously, he was the Director of ML at, a SaaS startup, where he led applied ML research and engineering in NLP. His research focus is on NLP/NLU and Knowledge Graphs. Prem has over ten years of experience in Machine Learning and building ML-infused products at IBM and AWS. More recently, at AWS, he worked alongside Marinus AI, an AI startup that tackles and disrupts human trafficking, to develop a knowledge graph-powered solution to assist and speed up missing person investigations by 4x.
Applied Natural Language Understanding: Topic modeling for text insights -  Going from LDA to using advances in language models
Lucy Andresen
Lucy Andresen · Nov 18th, 2022

OpenAI's InstructGPT

In this article you'll learn: - How Long Ouyang and his team at OpenAI trained InstructGPT to follow human instructions - How fine-tuning with reinforcement learning from human feedback can produce better results with less data at a lower cost - How alignment can unleash untapped potential in existing models
# OpenAI
OpenAI's InstructGPT
Dave Marra leads AI and Mixed Reality initiatives at Microsoft. As a solutions-focused leader, he's dedicated to leveraging developments in ML technology to revolutionize the productivity of the most technologically underserved segment of the population-the frontline workers. Dave is focused on connecting modern day productivity tools to the people that actually use the tools: soldiers, facility workers, and a range of technicians. In this talk observe why Dave challenges the notion of a paradigm shift away from hardware to privilege software as he describes a deeply interdependent relationship between the two, and increased access and availability to hardware. AI Exchange will also host special guest, Mark Valentine, former US Air Force Commander, and General Manager of National Security at Microsoft, where Mark and Dave were colleagues. Hosted by Scale's Director of Machine Learning and Engineering, Elliot Branson, this is sure to be an unforgettable talk that will open our eyes to the ways AI can elevate the quality of life and productivity for everyday people performing the work that keeps our society running.
Microsoft and Mixed Reality: AI Revolutionizing Productivity of the Frontline
Alexandr Wang
Alexandr Wang · Oct 24th, 2022

Applying AI to Redefine Every Industry

Leading organizations across every industry also need to be technology leaders, and today that means leveraging AI. Organizations applying AI don't necessarily have AI expertise, but they are prepared to leverage AI as a strategic asset for their innovation and product strategies. Many of these companies are looking for established use cases to supercharge their products, operations, and business lines. This is where pre-trained models create an opportunity for organizations without the resources and expertise build their own AI. Alexandr Wang, Scale’s CEO and Co-Founder, will outline how Scale’s product investments are helping all types of organizations and teams apply and create their own AI. Wang will also share how the latest advancements in AI allow next-generation models to be more versatile and attuned to specific business needs that weren’t possible before. He will explain why foundation models are the most exciting advancement happening in AI, and how Scale can help advance foundation models, especially as it applies to tuning these models to make them useful for specific tasks and industries including insurance, defense, logistics and many others. Wang founded Scale while a 19-year-old student to help companies build long-term AI strategies with the right data and infrastructure. Under his leadership, Scale has grown to be valued as a $7 billion company serving hundreds of customers across industries from finance to e-commerce to U.S. government agencies.
# TransformX 2022
# Keynote
# Enterprise AI
OpenAI’s InstructGPT: Aligning Language Models With Human Intent
Long Ouyang & Aerin Kim
A Global Perspective on AI With Eric Schmidt
Eric Schmidt
ML at Waymo: Building a Scalable Autonomous Driving Stack with Drago Anguelov
Dragomir Anguelov
What's Next for AI Systems & Language Models With Ilya Sutskever of OpenAI
Ilya Sutskever