Revisiting, benchmarking and exploring API recommendation: How far are we?

Y Peng, S Li, W Gu, Y Li, W Wang… - IEEE Transactions on …, 2022 - ieeexplore.ieee.org
… including Java and Python. • We build an open-sourced … details of APIBENCH, current
baselines and evaluation metrics in … -based API recommendation approach specially designed for …

Exploring ChatGPT's Potential in Java API Method Recommendation: An Empirical Study

Y Wang, W Xue, Q Huang, B Jiang… - Journal of Software …, 2025 - Wiley Online Library
API recommendation tasks. Specifically, we utilized the existing benchmark APIBENCH-Q
and the newly constructed dataset … new approach named MACAR to enhance ChatGPT's API

Pyart: Python api recommendation in real-time

X He, L Xu, X Zhang, R Hao, Y Feng… - 2021 IEEE/ACM 43rd …, 2021 - ieeexplore.ieee.org
… as effective as on Java due to the inherent challenges of analyzing Python programs. In this
paper, we propose a new real-time API recommendation approach for Python called PyART (…

Apigen: Generative api method recommendation

Y Chen, C Gao, M Zhu, Q Liao… - 2024 IEEE International …, 2024 - ieeexplore.ieee.org
APIBENCH-Q, we randomly select 500 questions with API … BIKER-Dataset comprises
33,000 Java-related questions … languages like Python, since our approach relies solely on …

Why not Just Look for Answers? Using a More Direct Way for API Recommendation

C Liu, L Xu, W Mu, R Qin - 2024 31st Asia-Pacific Software …, 2024 - ieeexplore.ieee.org
… • we propose an API recommendation approach named … are based on the Java dataset
APIBench-Q provided by Peng et … , such as Python or C#, the recommendation performance may …

Ptm-apirec: Leveraging pre-trained models of source code in api recommendation

Z Li, C Li, Z Tang, W Huang, J Ge, B Luo, V Ng… - ACM Transactions on …, 2024 - dl.acm.org
… , we use APIBench [38], a benchmark dataset for the API … For APIHelper [50], we re-implement
it using Python 3 and … that we use the API recommendation dataset for Java, and we …

API UTILITY ENHANCEMENT: FROM TRADITIONAL SOFTWARE TO DEEP LEARNING FRAMEWORKS

M Wei - 2025 - yorkspace.library.yorku.ca
… It analyzes the performance of existing approaches on Python-… For instance, a Java API
recommendation tool’s knowledge … a unified benchmark dataset for API recommendation is a …

Complexcodeeval: A benchmark for evaluating large code models on more complex code

J Feng, J Liu, C Gao, CY Chong, C Wang… - Proceedings of the 39th …, 2024 - dl.acm.org
… tasks, such as APIbench [27], facilitate the assessment of … We collect Java and Python
repositories from GitHub with over … We adopt a flexible approach by adding timestamps to each …

Bridge and hint: Extending pre-trained language models for long-range code

Y Chen, C Gao, Z Yang, H Zhang, Q Liao - Proceedings of the 33rd ACM …, 2024 - dl.acm.org
… ] dataset, which comprises 556 Java files and 544 Python files … tasks: API recommendation
on the APIBench-C dataset and … statistical methods to capture API usage patterns from API co-…

PandasBench: A Benchmark for the Pandas API

A Broihier, S Baziotis, D Kang, C Mendis - arXiv preprint arXiv:2506.02345, 2025 - arxiv.org
Kaggle hosts other kinds of workloads (eg, Python (ie, .py) or … sufficient to have a useful
Pandas API benchmark. We also need to … of the Pandas API, which includes all the methods and …