10th International Congress on Information and Communication Technology

Authors - Chi-Hung Wang, Xiang-Shun Yang, Jun-Yi Liu, Yao-Jun Liu
Abstract - Contract review is a common challenge for governments, businesses, and individuals. It becomes challenging when manual reviews are slow, legal expertise is lacking, and clauses are complex. These issues often lead to legal disputes and business conflicts. Traditional rule-based contract review tools often struggle with ambiguous language and unstructured content. Large language models (LLM) can quickly analyze contracts and find risks. But, they are unreliable due to "hallucinations" and a lack of knowledge of rare clauses. This study used retrieval-augmented generation (RAG) technology to overcome these challenges. It integrated verified legal data with large language models. This improved review accuracy to 93.67%. The F1-scores reached 91.95% for compliant clauses and 94.79% for non-compliant ones. The ROC-AUC metric improved to 0.93. The results show that this approach works. It improves the classification and risk identification of contract clauses. It also helps in contract review in the legal and business sectors, promoting the use of legal tech.