Versions
PCA-EVAL V1.0
| Domain | Number of Instances | Data Source |
|---|---|---|
| Traffic | 100 | Tsinghua-Tencent 100K |
| Domestic Robot | 100 | ALFRED |
| Open World Game | 100 | Minecraft |
| Total | 300 | - |
Contributors
Liang Chen, Yichi Zhang, Shuhuai Ren, Haozhe Zhao, Zefan Cai, Yuchi Wang
We warmly welcome additions of new domains, data, and models to PCA-EVAL as we are actively working to enlarge the benchmark in more realistic and interactive envrionments. If you’re interested in contributing or joining our efforts, please don’t hesitate to open an issue/Pull Request on our GitHub repository or email us.