VTechAGP: An Academic-to-General-Audience Text Paraphrase Dataset and Benchmark Models

Abstract

Existing text simplification or paraphrase datasets mainly focus on sentence-level text generation in a general domain. These datasets are typically developed without using domain knowledge. In this paper, we release a novel dataset, VTechAGP, which is the first academic-to-general-audience text paraphrase dataset consisting of document-level these and dissertation academic and general-audience abstract pairs from 8 colleges authored over 25 years. We also propose a novel dynamic soft prompt generative language model, DSPT5. For training, we leverage a contrastive-generative loss function to learn the keyword vectors in the dynamic prompt. For inference, we adopt a crowd-sampling decoding strategy at both semantic and structural levels to further select the best output candidate. We evaluate DSPT5 and various state-of-the-art large language models (LLMs) from multiple perspectives. Results demonstrate that the SOTA LLMs do not provide satisfactory outcomes, while the lightweight DSPT5 can achieve competitive results. To the best of our knowledge, we are the first to build a benchmark dataset and solutions for academic-to-general-audience text paraphrase dataset. Models will be public after acceptance.

Citation

BibTeX

@inproceedings{cheng2025vtechagp,
  title = {{VT}ech{AGP}: An Academic-to-General-Audience Text Paraphrase Dataset and Benchmark Models},
  author = {Cheng, Ming and Gong, Jiaying and Yuan, Chenhan and Ingram, William A and Fox, Edward and Eldardiry, Hoda},
  year = {2025},
  month = apr,
  booktitle = {Proceedings of the 2025 Conference of the Nations of the Americas Chapter of the Association for Computational Linguistics: Human Language Technologies (Volume 1: Long Papers)},
  publisher = {Association for Computational Linguistics},
  address = {Albuquerque, New Mexico},
  pages = {6110--6130},
  doi = {10.18653/v1/2025.naacl-long.311},
  isbn = {979-8-89176-189-6},
  editor = {Chiruzzo, Luis and Ritter, Alan and Wang, Lu},
  month_numeric = {4}
}