IAgen sem alucinação
segurança no processo judicial
Keywords:
confabulation, semantic entropy, statistical entropy, metacognition, generative artificial intelligenceAbstract
A review conducted by Oxford researchers, published in Nature, investigates the phenomenon of hallucinations in machine learning-based artificial intelligence systems, with particular emphasis on IAgen. The researchers identified that approximately 80% of hallucinations stem from a probabilistic entropic framework preceding their emergence. This subset was designated as “confabulations.” They proposed a heuristic and procedural optimization to be implemented within the algorithm—namely, the incorporation of a clustering function based on bidirectional implication—to assess whether the entropy is semantic in nature. This approach enables both the prevention and mitigation of the issue.
Furthermore, from a methodological standpoint, the authors outlined additional sources of hallucinations that were not addressed within the scope of the research, but are nonetheless relevant for legal and regulatory considerations. These factors are extrinsic to the algorithm itself and pertain to the management of training datasets and the oversight of training supervision protocols.
References
FARQUHAR, S., KOSSEN, J., KUHN, L. et al. Detecting hallucinations in large language models using semantic entropy. Nature 630, 625–630 (2024). Disponível em: <https://doi.org/10.1038/s41586-024-07421-0>. Acesso em: 10 ago. 2025.