IEEE 3128-2025

This recommended practice establishes an evaluation framework of the capabilities of artificial intelligence (AI) dialogue systems, such as the chatbots or consulting terminals of AI systems. The recommended practice defines and classifies the intelligence capabilities, as well as subdivides the levels of the capabilities according to a series of checklists. The checklists, given under each class of AI capabilities, describe the behavior and performance as corresponding criteria to which the evaluation is carried out with reference. This document may also be used to design and assess the applications of general AI if the classes and levels of intelligence capabilities defined herein are adopted. Only the performance of the features relating to the intelligence of the system is in the scope of this document. Other features, apart from the intelligence, are not in scope. They should follow the interaction principles and general recommendations of other standards not related to AI in design, operation, and maintenance. NOTE--Ability is referred to as being able to fulfill a task, innately or after-trained. Furthermore, capability includes not only present ability but potential competence as well. For this document, both the existing abilities and future potential are in scope.