Which ONE of the following options describes a scenario of A/B testing the LEAST? SELECT ONE OPTION

1. A. A comparison of two different websites for the same company to observe from a useracceptance perspective.
2. B. A comparison of two different offers in a recommendation system to decide on the more effective offer for same users.
3. C. A comparison of the performance of an ML system on two different input datasets.
4. D. A comparison of the performance of two different ML implementations on the same input data.

Correct Answer: C
A/B testing, also known as split testing, is a method used to compare two versions of a product or system to determine which one performs better. It is widely used in web development, marketing, and machine learning to optimize user experiences and model performance. Here??s why option C is the least descriptive of an A/B testing scenario:
✑ Understanding A/B Testing:
✑ Application in Machine Learning:
✑ Why Option C is the Least Descriptive:
✑ Clarifying the Other Options:
References:
✑ ISTQB CT-AI Syllabus, Section 9.4, A/B Testing, explains the methodology and application of A/B testing in various contexts.
✑ "Understanding A/B Testing" (ISTQB CT-AI Syllabus).

Which ONE of the following statements correctly describes the importance of flexibility for Al systems?
SELECT ONE OPTION

1. A. Al systems are inherently flexible.
2. B. Al systems require changing of operational environments; therefore, flexibility is required.
3. C. Flexible Al systems allow for easier modification of the system as a whole.
4. D. Self-learning systems are expected to deal with new situations without explicitly having to program for it.

Correct Answer: C
Flexibility in AI systems is crucial for various reasons, particularly because it allows for easier modification and adaptation of the system as a whole.
✑ AI systems are inherently flexible (A): This statement is not correct. While some AI
systems may be designed to be flexible, they are not inherently flexible by nature. Flexibility depends on the system's design and implementation.
✑ AI systems require changing operational environments; therefore, flexibility is
required (B): While it's true that AI systems may need to operate in changing environments, this statement does not directly address the importance of flexibility for the modification of the system.
✑ Flexible AI systems allow for easier modification of the system as a whole (C): This
statement correctly describes the importance of flexibility. Being able to modify AI systems easily is critical for their maintenance, adaptation to new requirements, and improvement.
✑ Self-learning systems are expected to deal with new situations without explicitly
having to program for it (D): This statement relates to the adaptability of self- learning systems rather than their overall flexibility for modification.
Hence, the correct answer is C. Flexible AI systems allow for easier modification of the system as a whole.
References:
✑ ISTQB CT-AI Syllabus Section 2.1 on Flexibility and Adaptability discusses the importance of flexibility in AI systems and how it enables easier modification and adaptability to new situations.
✑ Sample Exam Questions document, Question #30 highlights the importance of flexibility in AI systems.