Purpose This study aims to assess the performance of 4 generative artificial intelligence (AI) platforms—Gemini (formerly Bard), Bing, GPT-4, and Wrtn—in answering questions about colon cancer in the Korean language. Two main research questions guided this study. First, which AI platform provides the most accurate answers? Second, can these AI-generated answers be reliably used to educate patients and their families about colon cancer?
Methods Ten questions selected by the author were posed to the 4 generative AI platforms on February 22, 2024. Two colorectal surgeons in Korea, each with over 20 years of clinical experience, independently evaluated the answers provided by these generative AI platforms.
Results The generative AI platforms scored an average of 5.5 out of 10 points. Wrtn achieved the highest score at 6 points, followed by GPT-4 and Gemini, each with 5.5, and Bing, scoring 5 points. The weighted κ for inter-rater reliability was 0.597 (P<0.001). The generative AI platforms performed well in explaining the occult blood test for cancer screening, keyhole surgery, and dietary recommendations for cancer prevention. However, they demonstrated significant limitations in answering more complex topics, such as estimating survival rates following surgery, choosing targeted therapy after surgery, and accurately reporting the mortality rate due to colon cancer in Korea.
Conclusion The findings suggest that using these generative AI platforms as educational resources for patients and their families regarding colon cancer is premature. Further training on colorectal diseases is required before these AI platforms can be considered reliable information sources for the general public in Korea.
Purpose The efficacy of adjuvant chemotherapy (AC) in stage IIa colon cancer is controversial. This study aimed to investigate the factors influencing survival in patients with stage IIa colon cancer, the role of AC, and the indications for AC utilization by surgical oncologists.
Methods Between January 2004 and December 2010, 736 patients with stage IIa colon cancer underwent curative resection in 1 of 6 participating hospitals. Factors related to survival were identified and analyzed according to whether AC was administered or not. After high- and low-risk groups were identified, their respective results were analyzed.
Results The 5-year overall survival (OS) of stage IIa colon cancer was 90.3%. With the exception of poorly differentiated histology, indications for AC did not include typical high-risk factors. The indications for AC were significantly younger patients, higher body mass index (BMI), lower American Society of Anesthesiologists (ASA) physical status classification, and higher histologic grade. BMI, preoperative carcinoembryonic antigen, and harvested lymph node (LN) count were significant factors for disease-free survival, while BMI and ASA physical status classification were significant factors for OS in the chemotherapy group. In the high-risk group, AC was associated with increased OS in univariate analysis. BMI and harvested LN count were statistically significant in multivariate analysis.
Conclusion Surgical oncologists consider the patient’s condition and postoperative course rather than high-risk factors to determine use of AC. Regardless of AC use, both the extent of surgery and the patient’s subsequent status affected the survival rate in the high-risk group. None of the factors identified influenced survival rate in the low-risk group.
Citations
Citations to this article as recorded by
Use of ascitic CEA levels as a predictive value for distant metastasis in high-risk stage II and III colorectal cancer Abdullah Al-Sawat, Jung Hoon Bea, Seung-Rim Han, Hyo Jin Lee, Mi Ran Yoon, Yoon Suk Lee, Do Sang Lee, Chul Seung Lee, In Kyu Lee International Journal of Colorectal Disease.2022; 37(2): 365. CrossRef
Prognostic Factor and Survival Benefit of Adjuvant Chemotherapy in Stage IIA Colon Cancer Mok-Won Lee, Jin-Su Kim, Ji-Yeon Kim, Kyung-ha Lee Annals of Coloproctology.2021; 37(1): 35. CrossRef