LLM Agents Play Pokemon Showdown

4 comments

• pgn 28 minutes ago
  what was the selection for the teams? random per round? how does it play against people in ladder?
• doctorpangloss 17 minutes ago
  Pokémon Showdown isn't a game so much as it is competitive Wiki reading.
  [-]
  • grabnero 1 minute ago
    Not going to lie I agree lol but still interesting to see
• deadbabe 46 minutes ago
  Jev will give better results on this kind of thing.
  [-]
  • grabnero 2 minutes ago
    Yeah Jev can play it but Jev cant communicate with its teammate in the 2v2 + it cant reason and is just a decision model
  • nico 24 minutes ago
    For sure are many better models for this use case[0]

    At the same time, it’s interesting seeing how generally capable language models/LLMs/agents/harnesses are getting

    We’ll probably see a lot more experiments and benchmarks like these in the near future

    0: simple classifiers can play quite a few game, including Doom https://playground.jeffyclassify.com/#doom