Hi Authors,
Thank you for the amazing work on RepoCoder!
We wanted to test the performance of just In-file code completion (the "In-file" column in Table 2 (a,b)) - i.e. without any retrieved context, we noticed that the actual benchmark files are present here
|
api_completion_benchmark = 'datasets/random-api-completion.test.jsonl' |
'datasets/random-api-completion.test.jsonl', 'datasets/random-line-completion.test.jsonl'
But we cannot find these files even after unzipping the datasets folder. Could you please upload those files, or suggest if we are doing something wrong here
Hi Authors,
Thank you for the amazing work on RepoCoder!
We wanted to test the performance of just In-file code completion (the "In-file" column in Table 2 (a,b)) - i.e. without any retrieved context, we noticed that the actual benchmark files are present here
CodeT/RepoCoder/utils.py
Line 23 in 35f54d6
'datasets/random-api-completion.test.jsonl', 'datasets/random-line-completion.test.jsonl'But we cannot find these files even after unzipping the datasets folder. Could you please upload those files, or suggest if we are doing something wrong here