Making AI Work: How to Build and Scale Long-Running Enterprise Agents

About the Tech Talk

Join Scale AI researchers as they present their paper, “Jailbreaking to Jailbreak (J2),” which introduces a new paradigm in automated safety testing for large language models. This webinar will walk through the J2 approach—an LLM trained to systematically red-team other LLMs using a structured, multi-turn attack pipeline that mirrors the creativity and adaptability of human red-teamers.
Through in-depth exploration of methodology, model behaviors, and empirical results, we’ll show how J2 achieves red-teaming performance on par with humans, offering a scalable, cost-effective alternative for vulnerability discovery. We'll also discuss implications for safety research, limitations of current defenses, and what this means for the future of alignment and model control.

Key takeaways
Learn how a capable LLM can be trained to jailbreak other models - and itself - by simulating human-like attack strategies.
Understand J2’s multi-stage pipeline for planning, executing, and evaluating adversarial interactions with other LLMs.
Explore how this hybrid approach outperforms traditional automated red-teaming methods and approaches the success rate of professional human testers.

Gain insight into the emerging risks of scalable, self-reasoning attack agents and what this means for the next generation of AI safety defenses.

Check out the paper here:  https://scale.com/research/j2

J2: Jailbreaking to Jailbreak

Hype around Generative AI continues to grow, especially around agentic solutions, but most enterprises and governments struggle to implement impactful Generative AI. Its true value lies in how well it's directed—knowing how to set the right goals, boundaries, and feedback loops is key. When used thoughtfully, generative AI can become a powerful force multiplier, turning ideas into action with minimal oversight.

Join Scale's Director and General Manager of International Public Sector, Sahil Bhaiwala for a tech talk exploring what it takes to build agentic solutions with accuracy. 


Blueprint to Agentic AI: Identify, Build, Deploy

Humanity's Last Exam - A Fireside Chat

Join us for an insightful webinar that delves into the latest trends and best practices in enterprise AI adoption. Vijay Karunamurthy from Scale AI and Raghvender Arni from AWS will share key findings from the 2024 AI Readiness Report, focusing on the rapid deployment of generative AI, optimization techniques like fine-tuning and retrieval augmented generation (RAG), and addressing critical concerns around data security, privacy, and ethics.

Discover how leading organizations are navigating the challenges of deploying AI in production environments, aligning initiatives with business objectives, and leveraging AWS Bedrock to fine-tune models for enhanced performance. The speakers will also discuss effective test and evaluation strategies to ensure model safety and reliability, as well as the role of industry standards in mitigating risks.

Key takeaways:
Understand the latest trends in enterprise AI adoption, including the rapid deployment of generative AI models and the challenges organizations face in production environments.

Discover best practices for optimizing AI performance through techniques like fine-tuning, prompt engineering, and retrieval augmented generation (RAG), and learn how to overcome challenges in evaluating performance and handling data transformations.

Explore the role of industry standards and benchmarks in assessing model performance and mitigating risks associated with AI deployments.

Whether you're a C-suite executive, technical leader, or individual contributor, this webinar will provide valuable insights to help you harness the power of generative AI and drive successful implementations within your enterprise. Don't miss this opportunity to learn from experts and stay ahead of the curve in the rapidly evolving AI landscape.

AI Readiness Report 2024 - Insights and Strategies for Enterprise Success

Scale and BCG share their Blueprint to AI, and lessons learned from implementing Generative AI for the world’s largest enterprises. Padma Elmgart, Chief Technology Officer at Global Atlantic Financial Group joins to share her company’s journey implementing Generative AI across a large organization and how they are using Scale GenAI Platform to scale up use cases in 2024.


Blueprint to AI: Implementing Generative AI Across Your Enterprise

A Fireside Chat between Alex Levinson, Head of Security for Scale AI and Will Gamble, Director & AGC of Federal for Scale AI, on A Red Team Approach to AI Security.

A Red Team Approach to AI Security

About the Tech Talk
Fine-tuning is the key to unlocking the performance of LLMs for every organization’s most critical use cases. Join OpenAI and Scale as we explore what it takes to optimize fine-tuning for your organization and how you can unlock the potential of your data. From this talk, you will learn:

When you should consider fine-tuning GPT-3.5 and how to get started
Optimizing your proprietary data for fine-tuning GPT-3.5 and how to tell when you need to generate new data
Lessons learned and best practices from helping the world's leading enterprises fine-tune GPT-3.5 for their most difficult use cases


Fine-Tuning Open AI’s GPT-3.5 to Unlock Enterprise Use Cases

Understanding the capabilities, risks, and vulnerabilities of large language models is critical to ensuring the safety of these models. Join Scale as we discuss our vision for what an effective and comprehensive test and evaluation (“T&E”) regime for LLMs should look like moving forward, how that leverages human experts, as well as how we aim to help service this need with our new Scale LLM Test & Evaluation offering.


Building Trust in AI: Testing and Evaluating Large Language Models (LLMs) 

Content

Home

Events

Courses

Collections

People

Albums

Portals

Chat

Channels

Tools

Help

Scale events bring together AI/ML engineers, researchers, leaders, and practitioners from across the globe. 

Scale Events

Your Privacy Choices

It looks like there is no account associated with the email you provided. The event is for members only. Please complete the application to join our community first.

Thank you for your interest in joining us

Thanks for your interest in joining the event. However, your account is still pending. Once it's approved, you'll be able to register for the event. Please contact us via events@scale.com if you need support.

Pending Approval

Login to the Scale Events community to connect with others, attend community events, and more!

Login or Sign Up for even more

To unlock all parts of the community and get the best experience, complete your profile.

Hey, complete your profile

It looks like there is no account associated with the email you provided. Please complete the application to join our community.

Thank you for your interest in joining Scale Events.

Thanks for your interest in joining Scale Events. We will review your request shortly and email you once it's approved. Meanwhile, please feel free to contact us via events@scale.com for any questions.