Ropar, Nov 2 — A White Paper proposing a framework to define, measure and evaluate wisdom in artificial intelligence (AI) was launched at IIT Ropar on Monday by Dr Ishan Shivanand, Director (Research) at Stanford University and founder of the Global Mental Health Alliance -- Compassion Unites, in the presence of the institute’s Director Prof Rajeev Ahuja.
Titled “Beyond Intelligence: Defining and Measuring Wisdom for AI”, it explores how wisdom in artificial intelligence can be defined, measured and tested, drawing upon Dr Shivanand's interpretation of the Shiv Sutras and India's classical texts on the human mind.
Addressing the media, Dr Shivanand said, “The initiative highlights the growing need to assess AI systems not merely based on their intelligence and technical capabilities but also on their ability to exercise sound judgement and provide responsible guidance.”
“While AI systems can now pass professional examinations and perform well in emotional intelligence assessments, they often tend to tell users what they want to hear rather than what is genuinely beneficial for them.”
Citing a study published in the journal Science this year, the white paper “points out that leading AI systems, when asked for everyday advice, sided with users approximately 49 per cent more often than humans did”.
The White Paper argues that while AI has made significant advances in intelligence, it still lacks an essential human attribute: wisdom.
To address this gap, the authors have introduced a framework called HEED to measure wisdom in AI systems.
As part of the initiative, Dr Shivanand is providing seed funding for an open call inviting independent researchers to test the proposed framework.
A committee comprising independent members will select research teams to evaluate the model and develop HEED Bench, an open benchmark for measuring wisdom in AI, which will be made available to AI developers worldwide.