Výsledky vyhľadávania - Programming Exercise Generation Benchmark

A Survey Study on the State of the Art of Programming Exercise Generation Using Large Language Models Autor Frankford, Eduard, Hohn, Ingo, Sauerwein, Clemens, Breu, Ruth

“…This paper analyzes Large Language Models (LLMs) with regard to their programming exercise generation capabilities…”
Získať plný text

JavaBench: A Benchmark of Object-Oriented Code Generation for Evaluating Large Language Models Autor Cao, Jialun, Chen, Zhiyong, Wu, Jiarong, Cheung, Shing-Chi, Xu, Chang

“…Code generation benchmarks such as HumanEval are widely adopted to evaluate LLMs' capabilities…”
Získať plný text

On the performance of large language models on introductory programming assignments Autor Raihan, Nishat, Goswami, Dhiman, Puspo, Sadiya Sayara Chowdhury, Siddiq, Mohammed Latif, Newman, Christian, Ranasinghe, Tharindu, Santos, Joanna C. S., Zampieri, Marcos

“…) have led to the development of a new generation of Large Language Models (LLMs) trained on massive amounts of data…”
Získať plný text

Dataset of Program Source Codes Solving Unique Programming Exercises Generated by Digital Teaching Assistant Autor Demidova, Liliya A., Andrianova, Elena G., Sovietov, Peter N., Gorchakov, Artyom V.

“…This paper presents a dataset containing automatically collected source codes solving unique programming exercises of different types…”
Získať plný text

JavaBench: A Benchmark of Object-Oriented Code Generation for Evaluating Large Language Models Autor Cao, Jialun, Chen, Zhiyong, Wu, Jiarong, Shing-chi Cheung, Chang, Xu

“…Code generation benchmarks such as HumanEval are widely adopted to evaluate LLMs' capabilities…”
Získať plný text

Evaluating the quality of scenarios of short-term wind power generation Autor Pinson, P., Girard, R.

“… ► Guidelines for future evaluation/benchmark exercises. Scenarios of short-term wind power generation are becoming increasingly popular as input to multistage decision-making problems e.g…”
Získať plný text

DiffCoder: Enhancing Large Language Model on API Invocation via Analogical Code Exercises Autor Zan, Daoguang, Yu, Ailun, Shen, Bo, Chen, Bei, Li, Wei, Gong, Yongshun, Chen, Xiaolin, Yao, Yafen, Luo, Weihua, Guan, Bei, Liu, Yan, Wang, Yongji, Wang, Qianxiang, Cui, Lizhen

“…The task of code generation aims to generate code solutions based on given programming problems…”
Získať plný text

SEDGE: Symbolic example data generation for dataflow programs Autor Kaituo Li, Reichenbach, Christoph, Smaragdakis, Yannis, Diao, Yanlei, Csallner, Christoph

“… Past work demonstrated effective ways to generate small example data sets that exercise operators in the Pig platform, used to generate Hadoop map-reduce programs…”
Získať plný text

CSEPrompts: A Benchmark of Introductory Computer Science Prompts Autor Nishat Raihan, Goswami, Dhiman, Sadiya Sayara Chowdhury Puspo, Newman, Christian, Ranasinghe, Tharindu, Zampieri, Marcos

“…Recent advances in AI, machine learning, and NLP have led to the development of a new generation of Large Language Models (LLMs…”
Získať plný text

A Track-Based Conference Scheduling Problem Autor Riquelme, Fabian, Montero, Elizabeth, Pérez-Cáceres, Leslie, Rojas-Morales, Nicolás

“…The scheduling of conferences is a challenging task that aims at creating successful conference programs that fulfill an often wide variety of requirements. In…”
Získať plný text

Single muscle fibre biomechanics and biomechatronics – The challenges, the pitfalls and the future Autor Friedrich, Oliver, Haug, Michael, Reischl, B, Prölß, G, Kiriaev, Leon, Head, Stewart I, Reid, Michael B

“… We review major standard systems available from research labs and commercial sources, and benchmark those to our recently developed automated MyoRobot biomechatronics platform that provides…”
Získať plný text

Coordinating self-sizing and self-repair managers for multi-tier systems Autor Gueye, Soguy Mak-Karé, De Palma, Noël, Rutten, Éric, Tchana, Alain, Berthier, Nicolas

“…Computing systems have become more and more distributed and heterogeneous, making their manual administration difficult and error-prone. The Autonomic…”
Získať plný text

Strategic Behaviour in a Capacity Market? The New Irish Electricity Market Design Autor Teirilä, Juha, Ritz, Robert A.

“…The transition to a low-carbon power system requires growing the share of generation from (intermittent…”
Získať plný text

Evaluating and Aligning CodeLLMs on Human Preference Autor Yang, Jian, Yang, Jiaxi, Jin, Ke, Miao, Yibo, Zhang, Lei, Yang, Liqun, Cui, Zeyu, Zhang, Yichang, Binyuan Hui, Lin, Junyang

“… Most previous code-related benchmarks, which consist of various programming exercises along with the corresponding test cases, are used as a common measure to evaluate the performance and capabilities of code LLMs…”
Získať plný text

Swarm inspired test case generation for online C++ programming assessment Autor Oi-Mean Foong, Quang-Trung Tran, Suet-Peng Yong, Rais, Helmi Md

“… Moreover, they also need to define test cases for different programming exercises in order to assess students' code…”
Získať plný text

Improving differential evolution through a unified approach Autor Padhye, Nikhil, Bhardawaj, Piyush, Deb, Kalyanmoy

“…— Initialization, Selection, Generation and Replacement , which are sufficient to describe…”
Získať plný text

Generation of variational standard plant room solutions Autor Medjdoub, Benachir, Richens, Paul, Barnard, Nick

“…We have used the object-based CAD programming to take advantage of standardisation to handle the selection, sizing, layout and (potentially…”
Získať plný text

MixFX-SCORE: Heterogeneous Fixed-Point Compilation of Dataflow Computations Autor Deheng Ye, Kapre, Nachiket

“… When designing circuits for reconfigurable hardware, we can exercise independent control over bitwidth selection of each variable in the computation…”
Získať plný text

Test input reduction for result inspection to facilitate fault localization Autor Hao, Dan, Xie, Tao, Zhang, Lu, Wang, Xiaoyin, Sun, Jiasu, Mei, Hong

“…Testing-based fault-localization (TBFL) approaches often require the availability of high-statement-coverage test suites that sufficiently exercise the areas around the faults…”
Získať plný text

Health Club Industry Benchmarks Show Some Good and Some Bad Autor Scudder, Michael Scott

“… Group exercise class attendance increases crested in early 2013 and-though still a healthy part of many clubs' programming-needs a shot of adrenaline and stronger promotion…”
Získať plný text