Precisely comments on ChatGPT study
A recent study by The Purdue University into ChatGPT answers to 517 Stack Overflow questions found that the artificial intelligence (AI) model produced incorrect answers to more than half (52%) of the software engineering questions posed.  As the study continues to spark questions around the limitations of ChatGPT, we talk to Anjan Kundavaram, Chief Product Officer at Precisely (www.precisely.com) about how it’s essential it is to explore the data ChatGPT is based on, and how it makes decisions …

“The foundation of ChatGPT's insights lies in historical data, with the AI model powering the tool currently only trained on datasets going up until September 2021.  However, the value of AI models is greatly amplified by a steady stream of accurate, current data, that helps businesses react to changing conditions.  Furthermore, the base version of the model is trained on text-based human conversations, and some of that data may be inaccurate, untruthful, and otherwise misleading at times – requiring careful model fine-tuning.  Despite efforts to reduce biases during training, biased or subjective responses may arise on sensitive topics or when the model encounters ambiguous queries.”
 
“The integrity of the data fuelling an AI model directly impacts its performance and reliability.  Therefore, it’s essential to ensure that the data used for training is accurate, consistent, and contextual.  A data integrity strategy helps organisations connect different data sources, ensuring it has the highest levels of quality and governance, while proactively addressing issues before they create problems downstream.  AI technology also greatly benefits from contextual richness, which allows it to discover more meaningful patterns in the data.”
 
“Addressing and mitigating biases during the AI training process is essential.  Techniques such as careful dataset curation, diverse data representation, bias-aware evaluation, and ongoing monitoring can help identify and correct biases and promote fairness and inclusivity.  By prioritizing data integrity, business leaders can ensure that the insights generated by AI models are both trustworthy and reliable.”

More details about Study can be found at www.itpro.com/technology/artificial-intelligence/chatgpt-gives-wrong-answers-to-programming-questions-more-than-50-of-the-time