ADC: Enhancing Function Calling Via Adversarial Datasets and Code Line-Level Feedback

W Zhang, Y Zhang, L Zhu, Q Jia, F Jiang… - ICASSP 2025-2025 …, 2025 - ieeexplore.ieee.org
W Zhang, Y Zhang, L Zhu, Q Jia, F Jiang, H Guo, Z Li, M Zhou
ICASSP 2025-2025 IEEE International Conference on Acoustics …, 2025ieeexplore.ieee.org
Large Language Models (LLMs) have made significant strides in Natural Language
Processing and coding, yet they struggle with robustness and accuracy in complex function
calls. To tackle these challenges, this paper introduces ADC, an innovative approach that
enhances LLMs' ability to follow function formats and match complex parameters. ADC
utilizes a high-quality code fine-tuning dataset with line-level execution feedback, providing
granular process supervision that fosters strong logical reasoning and adherence to function …
Large Language Models (LLMs) have made significant strides in Natural Language Processing and coding, yet they struggle with robustness and accuracy in complex function calls. To tackle these challenges, this paper introduces ADC, an innovative approach that enhances LLMs’ ability to follow function formats and match complex parameters. ADC utilizes a high-quality code fine-tuning dataset with line-level execution feedback, providing granular process supervision that fosters strong logical reasoning and adherence to function formats. It also employs an adversarial dataset generation process to improve parameter matching. The staged training methodology capitalizes on both enriched code datasets and refined adversarial datasets, leading to marked improvements in function calling capabilities on the Berkeley Function-Calling Leaderboard (BFCL) Benchmark. The innovation of ADC lies in its strategic combination of process supervision, adversarial refinement, and incremental learning, setting a new standard for LLM proficiency in complex function calling.
ieeexplore.ieee.org
Showing the best result for this search. See all results