Browsing by Author "Marques, Catarina"
Now showing 1 - 4 of 4
Results Per Page
Sort Options
- Assessing the quality and reliability of ChatGPT’s responses to radiotherapy-related patient queries: comparative study with GPT-3.5 and GPT-4Publication . Grilo, Ana; Marques, Catarina; Corte-Real, Maria; Carolino, Elisabete; Caetano, MarcoBackground: Patients frequently resort to the internet to access cancer information. However, these websites often lack content accuracy and readability. Recently, ChatGPT, an artificial intelligence-powered chatbot, has signified a potential paradigm shift in how patients with cancer can access vast amounts of medical information, including insights into radiotherapy. However, the quality of the information provided by ChatGPT remains unclear. This is particularly significant given the general public's limited knowledge of this treatment and concerns about its possible side effects. Furthermore, evaluating the quality of responses is crucial, as misinformation can foster a false sense of knowledge and security, lead to noncompliance, and result in delays in receiving appropriate treatment. Objective: This study aims to evaluate the quality and reliability of ChatGPT's responses to common patient queries about radiotherapy, comparing the performance of ChatGPT's two versions: GPT-3.5 and GPT-4. Methods: We selected 40 commonly asked radiotherapy questions and entered the queries in both versions of ChatGPT. Response quality and reliability were evaluated by 16 radiotherapy experts using the General Quality Score (GQS), a 5-point Likert scale, with the median GQS determined based on the experts' ratings. Consistency and similarity of responses were assessed using the cosine similarity score, which ranges from 0 (complete dissimilarity) to 1 (complete similarity). Readability was analyzed using the Flesch Reading Ease Score, ranging from 0 to 100, and the Flesch-Kincaid Grade Level, reflecting the average number of years of education required for comprehension. Statistical analyses were performed using the Mann-Whitney test and effect size, with results deemed significant at a 5% level (P=.05). To assess agreement between experts, Krippendorff α and Fleiss κ were used. Results: GPT-4 demonstrated superior performance, with a higher GQS and a lower number of scores of 1 and 2, compared to GPT-3.5. The Mann-Whitney test revealed statistically significant differences in some questions, with GPT-4 generally receiving higher ratings. The median (IQR) cosine similarity score indicated substantial similarity (0.81, IQR 0.05) and consistency in the responses of both versions (GPT-3.5: 0.85, IQR 0.04; GPT-4: 0.83, IQR 0.04). Readability scores for both versions were considered college level, with GPT-4 scoring slightly better in the Flesch Reading Ease Score (34.61) and Flesch-Kincaid Grade Level (12.32) compared to GPT-3.5 (32.98 and 13.32, respectively). Responses by both versions were deemed challenging for the general public. Conclusions: Both GPT-3.5 and GPT-4 demonstrated the capability to address radiotherapy concepts, with GPT-4 showing superior performance. However, both models present readability challenges for the general population. Although ChatGPT demonstrates potential as a valuable resource for addressing common patient queries related to radiotherapy, it is imperative to acknowledge its limitations, including the risks of misinformation and readability issues. In addition, its implementation should be supported by strategies to enhance accessibility and readability.
- Assessing the quality and reliability of ChatGPT’s responses to radiotherapy-related patient queries: GPT-3.5 versus GPT-4Publication . Grilo, Ana; Marques, Catarina; Corte-Real, Maria; Carolino, Elisabete; Caetano, MarcoPatients frequently resort to the Internet to access cancer information. Nevertheless, these online websites often need more content accuracy and readability. Recently, ChatGPT, an artificial intelligence-powered chatbot, signifies a potential paradigm shift in how cancer patients can access vast medical information. However, given that ChatGPT was not explicitly trained for oncology-related inquiries, the quality of the information it provides still needs to be verified. Evaluating the quality of responses is crucial, as misinformation can foster a false sense of knowledge and security, lead to noncompliance, and delay appropriate treatment. Objective: This study aims to evaluate the quality and reliability of ChatGPT’s responses to standard patient queries about radiotherapy, comparing the performance of GPT-3.5 and GPT-4. Methods: Forty commonly asked radiotherapy questions were selected and inserted into both versions. Responses were evaluated by six radiotherapy experts using a General Quality Score (GQS), assessed for consistency and similarity using the cosine similarity score, and analyzed for readability using the Flesch Reading Ease Score (FRES) and Flesch-Kincaid Grade Level (FKGL). Statistical analysis was performed using the Mann-Whitney test. Results: GPT-4 demonstrated superior performance, with higher GQS and a complete absence of lower scores compared to GPT-3.5. The Mann-Whitney test revealed statistically significant differences in some questions, with GPT-4 generally receiving higher ratings. The cosine similarity score indicated substantial similarity and consistency in responses from both versions. Readability scores for both versions were considered college-level, with GPT-4 scoring slightly better in FRES (35.55) and FKGL (12.71) compared to GPT-3.5 (30.68 and 13.53, respectively). Both versions’ responses were deemed challenging for the public to read. Conclusions: While GPT-4 generates more accurate and reliable responses than GPT-3.5, both models present readability challenges for the public. ChatGPT reveals potential as a valuable resource for addressing common patient queries related to radiotherapy. However, it is crucial to acknowledge its limitations, including the risks of misinformation and readability issues.
- A certificação de alimentos orgânicos: influência na decisão de compra do consumidor ecologicamente conscientePublication . Batista, Manuel José Marques; Reis, Elizabeth; Marques, Catarina; Santos, ConceiçãoO objetivo principal do presente estudo é compreender o processo de decisão de compra de Alimentos Orgânicos do consumidor Ecologicamente Consciente, em particular, o impacto da certificação no referido processo. Pretende-se entender o comportamento do consumidor numa perspetiva de marketing e contribuir para a criação de produtos/serviços sustentáveis, que resultem em fatores críticos de sucesso e em vantagem competitiva para as instituições que os desenvolvam.
- Os princípios do socioconstrutivismo no processo de ensino e aprendizagem na disciplina de técnica de dança clássica, com os alunos do ensino secundário da Escola de Dança Lugar PresentePublication . Marques, Catarina; Marques, AnaO presente trabalho foi desenvolvido no âmbito das Unidades Curriculares Estágio I e II, inseridas no Curso de Mestrado em Ensino de Dança (8.ª edição) e apresenta um relatório de estágio em que o seu estudo foi posto em prática no ano letivo 2019/2020, na disciplina de Técnica de Dança Clássica. Teve como público-alvo os alunos do Ensino Secundário (6.º, 7.º e 8.º anos do Ensino Artístico Especializado) da Escola de Dança Lugar Presente, situada em Viseu. Sendo a evolução de um indivíduo uma interligação do meio social, com a linguagem e a cultura, pretendeu dar-se aos alunos implicados a oportunidade de realizarem um trabalho partilhado e cooperativo durante as aulas, onde eles próprios pudessem experienciar situações diferenciadas na disciplina de Técnica de Dança Clássica. A estrutura convencional de uma aula de Técnica de Dança Clássica foi mantida, acrescentando as estratégias cooperativas durante a lecionação. Este estágio teve como objetivo principal utilizar estratégias cooperativas implicadas ao Socioconstrutivismo como estratégias da melhoria do Trabalho de pés, Equilíbrio, Eixo corporal e Capacidade de salto, dificuldades de execução técnica de movimento detetadas na turma em questão. Para a concretização deste estágio recorreu-se à metodologia da Investigação-ação, metodologia que alia investigação de natureza qualitativa e quantitativa e foram usados como instrumentos de recolha de dados a Observação direta, as Tabelas de observação, o Questionário, o Diário de bordo e a Vídeo gravação. De acordo com o tema subjacente a este estágio pretendeu-se proporcionar aos alunos envolvidos uma experiência de uma aprendizagem acente em abordagens cooperativas variadas em que se permitisse analisar e melhorar o rendimento e qualidade de execução técnica de movimento dos alunos, a partir da relação interpessoal estabelecida em que se promoveu a expressão livre individual para uma comunicação socializada de acordo com uma pedagogia e princípios que o Movimento da Escola Moderna defende. No culminar do trabalho desenvolvido considera-se que os resultados obtidos evidenciam o ultrapassar das dificuldades de postura e de movimento e o atingir dos objetivos propostos na medida em que se verificou uma evolução a curto prazo, em cada aula, mas que se transportavam a longo prazo as correções que eram feitas durante as aulas.