Artificial intelligence (AI) or machine learning (ML) models that can be sufficiently reverse-engineered to illustrate why a particular response to a query was given. In lay terms, a human can often (but not always) 'explain their thinking' when questioned about a decision, but not all AI/ML models can due to either their proprietary nature and/or the mathematical processes within.
"Conversational AI like ChatGPT is not always explainable AI, making it unsuitable for situations where decision-making must be explained, such as credit scoring, hiring decisions or academia."
