AI bots on webDiplomacy: Skynet edition!

Site announcements from the moderator team go here.
Message
Author
ColinR
Posts: 4
Joined: Wed May 06, 2020 5:21 pm
Karma: 4

Re: AI bots on webDiplomacy: Skynet edition!

#161 Post by ColinR » Wed May 06, 2020 5:29 pm

Does anyone know how KestasBot performs against de Jonge and Sierra's D-Brane?

ColinR
Posts: 4
Joined: Wed May 06, 2020 5:21 pm
Karma: 4

Re: AI bots on webDiplomacy: Skynet edition!

#162 Post by ColinR » Wed May 06, 2020 6:09 pm

ColinR wrote:
Wed May 06, 2020 5:29 pm
Does anyone know how KestasBot performs against de Jonge and Sierra's D-Brane?
... and whether KestasBot is still learning, now against human players on webDiplomacy?

Claesar
Site Moderator
Site Moderator
Posts: 1600
Joined: Tue Oct 03, 2017 10:34 am
Karma: 1083

Re: AI bots on webDiplomacy: Skynet edition!

#163 Post by Claesar » Wed May 06, 2020 7:21 pm

ColinR wrote:
Wed May 06, 2020 5:29 pm
Does anyone know how KestasBot performs against de Jonge and Sierra's D-Brane?
No, as far as I know that hasn't been tested.
1

Claesar
Site Moderator
Site Moderator
Posts: 1600
Joined: Tue Oct 03, 2017 10:34 am
Karma: 1083

Re: AI bots on webDiplomacy: Skynet edition!

#164 Post by Claesar » Wed May 06, 2020 7:24 pm

ColinR wrote:
Wed May 06, 2020 6:09 pm
ColinR wrote:
Wed May 06, 2020 5:29 pm
Does anyone know how KestasBot performs against de Jonge and Sierra's D-Brane?
... and whether KestasBot is still learning, now against human players on webDiplomacy?
They are not currently learning, but we are still gathering data. There's a non-zero chance they might be updated at some point, but there are no plans for that at the moment.
2

Squigs44
Developer
Developer
Posts: 3233
Joined: Thu Jul 12, 2018 11:50 pm
Location: America
Karma: 1165

Re: AI bots on webDiplomacy: Skynet edition!

#165 Post by Squigs44 » Wed May 06, 2020 8:09 pm

This paper was released at the same time as the bots. The benchmark used was Albert 6.0 and it beat out Albert.
4

ColinR
Posts: 4
Joined: Wed May 06, 2020 5:21 pm
Karma: 4

Re: AI bots on webDiplomacy: Skynet edition!

#166 Post by ColinR » Thu May 07, 2020 7:29 am

Claesar wrote:
Wed May 06, 2020 7:24 pm
They are not currently learning, but we are still gathering data
The Paquette et al. NIPS paper mentioned that "the supervised agent was able to learn to coordinate support orders while this behaviour appears to deteriorate during self-play training".

Without yet understanding the details, I wondered if this reflected the self-play bot getting stuck in a local maximum due to (non-robust) play against itself - rather than against a more diverse range of opponents. If so, I'd conjecture that learning from its webDiplomacy games could help it get out of this local max.
2

Squigs44
Developer
Developer
Posts: 3233
Joined: Thu Jul 12, 2018 11:50 pm
Location: America
Karma: 1165

Re: AI bots on webDiplomacy: Skynet edition!

#167 Post by Squigs44 » Thu May 07, 2020 8:24 am

ColinR wrote:
Thu May 07, 2020 7:29 am
Claesar wrote:
Wed May 06, 2020 7:24 pm
They are not currently learning, but we are still gathering data
The Paquette et al. NIPS paper mentioned that "the supervised agent was able to learn to coordinate support orders while this behaviour appears to deteriorate during self-play training".

Without yet understanding the details, I wondered if this reflected the self-play bot getting stuck in a local maximum due to (non-robust) play against itself - rather than against a more diverse range of opponents. If so, I'd conjecture that learning from its webDiplomacy games could help it get out of this local max.
Well yes, the point was that when it learned from webdip, it was able to more effectively support others. When it learned from itself, it was less effective at supporting others, and was more effective at winning. The goal of the bot isn't to support, it is to win. Since the bot is in a gunboat setting, it makes sense that supporting other countries wasn't as rewarding.
2

ColinR
Posts: 4
Joined: Wed May 06, 2020 5:21 pm
Karma: 4

Re: AI bots on webDiplomacy: Skynet edition!

#168 Post by ColinR » Fri May 08, 2020 4:55 pm

We're hosting a virtual Meetup on Wednesday (13 May, 18:30 UK time = 17:30 GMT) to kick-off a Diplomacy AI project.

As the webDiplomacy/Paquette et al. bots are the most impressive I've seen, I'd love it if some of you could join us.

We're using software that allows participants to break into groups (called 'tables'): if any of you can make it, we could have a webDip table, where you explain what you've been doing to interested participants.

To sign up: https://www.meetup.com/Diplomacy-AI-Mee ... 270438476/

A background resources page: https://github.com/rowatc/Diplomacy-AI

Thanks!
2

Post Reply

Who is online

Users browsing this forum: No registered users and 2 guests