Gain expertise in Gen AI testing & evaluation

In-depth Gen AI workshops for your team. Learn to evaluate, test, and validate Gen AI applications with Rhesis AI’s expert-led sessions.
Request workshop
Header imageArrow

Workshops covering all phases from exploration to production-ready Gen AI.

Designed for all skill levels, our workshops cover key capabilities in Gen AI testing and evaluation  tailored to your team’s current expertise, from beginners to seasoned professionals. Each session is grounded in practical experience with real-world Gen AI challenges, ensuring the content is relevant and immediately applicable. Whether you're just starting with Gen AI testing or looking to refine an existing  strategy, our workshops will equip you with the knowledge and tools needed to navigate the complexities of testing AI systems with confidence.
1

Understand

Lay the groundwork for a structured testing approach by building foundational knowledge and identifying key challenges.

• Establish awareness
• Identify risks
• Foundational test strategy
2

Plan

Define clear testing objectives, scope, and strategies to align with business goals and technical requirements.

• Define goals

• Scope coverage

• Strategic approach
3

Select

Choose the right tools, frameworks, and methodologies to effectively test Gen AI applications.

• Explore options

• Criteria-based
• Scalable testing
‍
4

Execute

Implement and run tests, leveraging automation and adaptive strategies for comprehensive evaluation.
‍
• Effective execution

• Adaptive testing

• Valuable insights
5

Review

Analyze results, refine processes, and ensure applications are production-ready.

• Insightful Analysis

• Behavior Evaluation

• Continuous Optimization
‍
6

Red-team

Simulate adversarial scenarios to identify vulnerabilities, enhance robustness, and strengthen defenses.

• Vulnerability Assessment
• Robustness Testing
• Risk Mitigation
Play video icon
Dashboard mockup
LEVEL: BEGINNER

Workshop 1: Introduction to Gen AI evaluation & testing

Teams starting with Gen AI testing or looking to understand the unique challenges of AI applications. Understand the foundations of testing Gen AI applications.
💬 In-person | online
⏰ 4-6 hrs
👥 15 max.
Gen AI vs. Traditional Testing: Explore key differences like non-determinism and unpredictability in AI testing
Risks and Threats: Dive into critical risks such as bias, security threats, and ethical concerns impacting Gen AI applications.
Frameworks: Learn about relevant frameworks like MITRE and OWASP for a structured approach to risk assessment.
Request workshop
LEVEL: INTERMEDIATE

Workshop 2: Building a comprehensive test strategy

Develop the skills and knowledge to craft effective testing strategies. Teams gain a roadmap for creating robust testing strategies tailored to their Gen AI projects.
💬 In-person | online
⏰ 6-8 hrs
👥 10 max.
Testing Strategy Development: Learn to align functional and non-functional testing for Gen AI applications.
Defining Scope and Objectives: Identify key features, scenarios, and personas to focus your testing efforts effectively.
Establishing Success Criteria: Define clear benchmarks and evaluation thresholds to determine what constitutes acceptable performance, ensuring alignment with your application’s goals and company regulations.
Request workshop
Play video icon
Dashboard mockup
Play video icon
Dashboard mockup
LEVEL: ADVANCED

Workshop 3: Understanding the Gen AI testing stack

A comprehensive exploration of frameworks, tools and methodologies for testing Gen AI applications, ensuring your team is equipped to address the unique challenges of AI validation.
💬 In-person | online
⏰ 10-12 hrs
👥 4 max.
Understanding the Testing Landscape: Gain clarity on the tools and technologies essential for Gen AI testing, from bias detection to adversarial test and observability frameworks, and how they differ from traditional testing solutions.
Selecting the Right Tools: Learn how to evaluate and choose the most effective platforms and technologies tailored to your application’s objectives and industry needs.
Implementing the Gen AI Testing Stack: Understand how to integrate and optimize the selected tools into your CI / CD workflows, enabling seamless testing and validation processes.
Request workshop
LEVEL: ADVANCED

Workshop 4: Implementing best practices in Gen AI testing

Acquire the skills and understand the workflows needed to implement repeatable, automated testing processes for LLMs with a focus on collaboration. Teams will gain actionable insights into industry-proven methodologies to ensure consistent and reliable Gen AI testing.
💬 In-person | online
⏰ 10-12 hrs
👥 4 max.
Automated Testing Workflows: Learn to design and implement scalable, repeatable testing pipelines tailored for Gen AI applications using state of the art frameworks.
Industry-Proven Methodologies: Discover best practices for testing non-deterministic systems and addressing challenges like variability and unpredictability.
Ensuring Consistency: Implement processes that maintain testing accuracy and reliability across iterations, aligning with application goals and compliance requirements.
Request workshop
Play video icon
Dashboard mockup
OFFERING

Why choose Rhesis AI workshops?

Get hands-on experience and expert guidance to tackle the unique challenges of Gen AI testing, ensuring your team is equipped with practical skills and actionable strategies. Our workshops are designed to meet your team’s needs—whether you prefer the convenience of online sessions or the hands-on interaction of onsite training.

Cutting-Edge Insights

Struggling to grasp the complexities of evaluating Gen AI applications? Our workshops dive deep into the nuances of AI-specific evaluations—what they are, how they differ from traditional metrics, and why selecting the right evaluators is crucial. Learn how to measure robustness, fairness, and compliance effectively with methodologies tailored to AI's unique challenges.

Collaborative Approach

Gen AI testing isn’t one-size-fits-all. Our workshops address the specific hurdles your team faces, from defining test objectives for AI unpredictability to understanding how scenarios like adversarial attacks or ethical risks impact your application. We work with your team to ensure the strategies and tools align with your application’s real-world needs.

Practical Outcomes

Many teams struggle with what makes Gen AI testing different—and how to translate theory into actionable results. We provide hands-on guidance to help your team understand adaptive testing processes, refine test case generation, and select tools that uncover risks unique to Gen AI, like data leakage or harmful outputs. Walk away equipped with skills to enhance your AI systems.
Financial Services
Learn how to evaluate Gen AI fraud detection. ‍Leverage Gen AI to combat fraud, streamline workflows, and optimize financial planning with precision.
Insurance
Streamline claims and elevate customer experiences.
Gen AI modernizes claims processing, powers AI chatbots for seamless user interactions, and personalizes services.
Real Estate
Revolutionize Property Management and Market Insights. Generative AI automates document processing, predicts trends, and provides 24/7 chatbot support, transforming real estate operations.
Retail
Use generative AI to predict shopper behavior, enable personalized recommendations, and streamline retail operations for better customer engagement.
Supply Chain and Logistics
Leverage generative AI to optimize demand forecasting, automate routine tasks, and enhance the overall supply chain experience.
Hospitality
Implement generative AI to personalize guest experiences, automate customer service, optimize pricing, and ensure secure transactions.
Legal
Master the application of generative AI for contract analysis, legal research automation, and ensuring compliance with industry regulations.
Energy and Utilities
Discover how generative AI can optimize energy management, predict equipment failures, and streamline operations in energy production and distribution
Automotive
Understand how generative AI can support autonomous systems, predict vehicle maintenance needs, and optimize traffic flow to enhance operations.
Media and Entertainment
Explore the use of generative AI in creating tailored content, automating video editing, and enhancing audience engagement through data-driven insights.

Didn’t find the workshop you were looking for?

Every organization’s journey with Gen AI is unique. If our listed workshops don’t quite match your needs, we’re happy to create a custom workshop tailored to your goals, challenges, and application requirements. Let’s design a session that works for you!
Request a custom workshop