Högskolan i Skövde

his.sePublikasjoner
Endre søk
RefereraExporteraLink to record
Permanent link

Direct link
Referera
Referensformat
  • apa
  • apa-cv
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Annet format
Fler format
Språk
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Annet språk
Fler språk
Utmatningsformat
  • html
  • text
  • asciidoc
  • rtf
The impact of task specification on code generated via ChatGPT
Högskolan i Skövde, Institutionen för informationsteknologi.
Högskolan i Skövde, Institutionen för informationsteknologi.
Högskolan i Skövde, Institutionen för informationsteknologi.
2023 (svensk)Independent thesis Basic level (degree of Bachelor), 20 poäng / 30 hpOppgave
Abstract [en]

ChatGPT has made large language models more accessible and made it possible to code using natural language prompts. This study conducted an experiment comparing prompt engineering techniques called task specification and investigated their impacton code generation in terms of correctness and variety. The hypotheses of this study focused on whether the baseline method had a statistically significant difference in code correctness compared to the other methods. Code is evaluated using a software requirement specification that measures functional and syntactical correctness. Additionally, code variance is measured to identify patterns in code generation. The results show that there is a statistically significant difference in some code correctness criteria between the baseline and the other task specification methods, and the code variance measurements indicate a variety in the generated solutions. Future work could include using another large language model; different programming tasks andprogramming languages; and other prompt engineering techniques.

sted, utgiver, år, opplag, sider
2023. , s. 60, 29
Emneord [en]
Code generation, task specification, prompt engineering, ChatGPT, human evaluation, code similarity
HSV kategori
Identifikatorer
URN: urn:nbn:se:his:diva-22866OAI: oai:DiVA.org:his-22866DiVA, id: diva2:1776870
Fag / kurs
Informationsteknologi
Utdanningsprogram
Computer Science - Specialization in Systems Development
Veileder
Examiner
Tilgjengelig fra: 2023-06-28 Laget: 2023-06-28 Sist oppdatert: 2023-06-28bibliografisk kontrollert

Open Access i DiVA

fulltext(3538 kB)784 nedlastinger
Filinformasjon
Fil FULLTEXT01.pdfFilstørrelse 3538 kBChecksum SHA-512
77da424870a337c7b97dce6a325cb0d64799d6df1fa35e29adaa380733a2082eff2bb3964284c8557d55dd50b96cba22db35547d85650315efed5824cd2e7e3e
Type fulltextMimetype application/pdf

Av organisasjonen

Søk utenfor DiVA

GoogleGoogle Scholar
Totalt: 784 nedlastinger
Antall nedlastinger er summen av alle nedlastinger av alle fulltekster. Det kan for eksempel være tidligere versjoner som er ikke lenger tilgjengelige

urn-nbn

Altmetric

urn-nbn
Totalt: 849 treff
RefereraExporteraLink to record
Permanent link

Direct link
Referera
Referensformat
  • apa
  • apa-cv
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Annet format
Fler format
Språk
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Annet språk
Fler språk
Utmatningsformat
  • html
  • text
  • asciidoc
  • rtf