About

prompto is a Python library written by the Research Engineering Team (REG) at the Alan Turing Institute. It was originally written by Ryan Chan, Federico Nanni and Evelina Gabasova.

The library is designed to facilitate the running of language model experiments stored as jsonl files. It automates querying API endpoints and logs progress asynchronously. The library is designed to be extensible and can be used to query different models.

Citation

A pre-print for this work is available on arXiv.

Please cite the library as:

@article{chan2024prompto,
  title={Prompto: An open source library for asynchronous querying of LLM endpoints},
  author={Chan, Ryan Sze-Yin and Nanni, Federico and Brown, Edwin and Chapman, Ed and Williams, Angus R and Bright, Jonathan and Gabasova, Evelina},
  journal={arXiv preprint arXiv:2408.11847},
  year={2024}
}