Artificial intelligence in 1v1 diplomacy

Use this forum to discuss Diplomacy strategy.
Forum rules
This forum is limited to topics relating to the game Diplomacy only. Other posts or topics will be relocated to the correct forum category or deleted. Please be respectful and follow our normal site rules at http://www.webdiplomacy.net/rules.php.
Message
Author
Squigs44
Developer
Developer
Posts: 3720
Joined: Thu Jul 12, 2018 11:50 pm
Location: OKC
Karma: 1970

Re: Artificial intelligence in 1v1 diplomacy

#21 Post by Squigs44 » Wed Mar 20, 2019 7:20 am

Someone just code this up already
1

teacon7
Posts: 1248
Joined: Fri Oct 06, 2017 7:48 pm
Location: Midwestern USA
Karma: 135

Re: Artificial intelligence in 1v1 diplomacy

#22 Post by teacon7 » Wed Mar 20, 2019 1:46 pm

I would love to see Albert coded into webdip. We'd all lose, but still. I wonder what it would take to translate the AI to this code framework ?

...it's probably really hard, and that's why no one has done it.
1

Restitution
Posts: 225
Joined: Thu Jan 31, 2019 7:00 am
Karma: 180

Re: Artificial intelligence in 1v1 diplomacy

#23 Post by Restitution » Wed Mar 20, 2019 4:46 pm

Squigs44 wrote:
Wed Mar 20, 2019 7:20 am
Someone just code this up already
The intersection of people who can build NN's and diplomacy players is probably pretty small.

bozotheclown
Posts: 9022
Joined: Sun Dec 31, 2017 8:13 am
Karma: 2069

Re: Artificial intelligence in 1v1 diplomacy

#24 Post by bozotheclown » Wed Mar 20, 2019 7:46 pm

It would be interesting to see what AlphaZero could do with an imperfect information game like 1v1 Diplomacy. However, the estimate for the AlphaGo Zero hardware is $25 million, and AlphaZero likely costs more, so someone has to talk DeepMind into trying Diplomacy.
1

captainmeme
Posts: 260
Joined: Fri Sep 29, 2017 3:06 pm
Location: Manchester, UK
Karma: 544

Re: Artificial intelligence in 1v1 diplomacy

#25 Post by captainmeme » Wed Mar 20, 2019 8:25 pm

bozotheclown wrote:
Wed Mar 20, 2019 7:46 pm
It would be interesting to see what AlphaZero could do with an imperfect information game like 1v1 Diplomacy. However, the estimate for the AlphaGo Zero hardware is $25 million, and AlphaZero likely costs more, so someone has to talk DeepMind into trying Diplomacy.
the CEO of DeepMind actually attended WDC 2017 Oxford, it's not impossible that this could happen

Claesar
Posts: 1932
Joined: Tue Oct 03, 2017 10:34 am
Karma: 1450

Re: Artificial intelligence in 1v1 diplomacy

#26 Post by Claesar » Wed Mar 20, 2019 8:40 pm

captainmeme wrote:
Wed Mar 20, 2019 8:25 pm
bozotheclown wrote:
Wed Mar 20, 2019 7:46 pm
It would be interesting to see what AlphaZero could do with an imperfect information game like 1v1 Diplomacy. However, the estimate for the AlphaGo Zero hardware is $25 million, and AlphaZero likely costs more, so someone has to talk DeepMind into trying Diplomacy.
the CEO of DeepMind actually attended WDC 2017 Oxford, it's not impossible that this could happen
Did anyone explain 1v1 to them?

bozotheclown
Posts: 9022
Joined: Sun Dec 31, 2017 8:13 am
Karma: 2069

Re: Artificial intelligence in 1v1 diplomacy

#27 Post by bozotheclown » Wed Mar 20, 2019 9:05 pm

captainmeme wrote:
Wed Mar 20, 2019 8:25 pm
bozotheclown wrote:
Wed Mar 20, 2019 7:46 pm
It would be interesting to see what AlphaZero could do with an imperfect information game like 1v1 Diplomacy. However, the estimate for the AlphaGo Zero hardware is $25 million, and AlphaZero likely costs more, so someone has to talk DeepMind into trying Diplomacy.
the CEO of DeepMind actually attended WDC 2017 Oxford, it's not impossible that this could happen
Does anyone have some connections?
1

BobMcBob
Posts: 2433
Joined: Mon Feb 11, 2019 6:28 am
Location: Also Not Austalia
Karma: 1097

Re: Artificial intelligence in 1v1 diplomacy

#28 Post by BobMcBob » Thu Mar 21, 2019 3:05 am

What about an AI for all variants of Diplomacy? I don't think it would be too much harder and you could have it all on the one AI.

Puddle
Posts: 28
Joined: Sat Oct 13, 2018 1:18 pm
Karma: 20

Re: Artificial intelligence in 1v1 diplomacy

#29 Post by Puddle » Thu Mar 21, 2019 1:16 pm

@BobMcBob, I would think that the task of teaching the AI how to Gunboat would be quite a bit simpler than teaching it how to play full press. Setting aside the need to pass the Turing Test to really be able to play full press, even just doing something like what Albert does wouldn't be quite a step up from just learning to gunboat.

RoganJosh
Silver Donator
Silver Donator
Posts: 550
Joined: Sun Dec 31, 2017 1:02 am
Location: Stockholm
Karma: 454
Contact:

Re: Artificial intelligence in 1v1 diplomacy

#30 Post by RoganJosh » Thu Mar 21, 2019 1:46 pm

I think 1v1 diplomacy is to simple - AI would probably solve it completely. That would be pretty boring.

Squigs44
Developer
Developer
Posts: 3720
Joined: Thu Jul 12, 2018 11:50 pm
Location: OKC
Karma: 1970

Re: Artificial intelligence in 1v1 diplomacy

#31 Post by Squigs44 » Fri Mar 22, 2019 4:54 am

RoganJosh wrote:
Thu Mar 21, 2019 1:46 pm
I think 1v1 diplomacy is to simple - AI would probably solve it completely. That would be pretty boring.
I'm not sure there is a complete solution. Too much guesswork involved.

The hard thing about diplomacy is its turn structure. In chess, or go, one decision is made at a time. White makes 1 move, then black makes one move, etc. In diplomacy, two players are simultaneously making up to 17 decisions that all interact with one another. So although there are fewer turns in diplomacy, each turn requires multiple complex interlocking decisions. Also, the fact that you are taking your turn at the same time as your opponent means you are working with incomplete information at every step.

Restitution
Posts: 225
Joined: Thu Jan 31, 2019 7:00 am
Karma: 180

Re: Artificial intelligence in 1v1 diplomacy

#32 Post by Restitution » Fri Mar 22, 2019 5:17 am

Squigs44 wrote:
Fri Mar 22, 2019 4:54 am
RoganJosh wrote:
Thu Mar 21, 2019 1:46 pm
I think 1v1 diplomacy is to simple - AI would probably solve it completely. That would be pretty boring.
I'm not sure there is a complete solution. Too much guesswork involved.

The hard thing about diplomacy is its turn structure. In chess, or go, one decision is made at a time. White makes 1 move, then black makes one move, etc. In diplomacy, two players are simultaneously making up to 17 decisions that all interact with one another. So although there are fewer turns in diplomacy, each turn requires multiple complex interlocking decisions. Also, the fact that you are taking your turn at the same time as your opponent means you are working with incomplete information at every step.
You can solve a probabilistic game. Nash equilibriums.

Squigs44
Developer
Developer
Posts: 3720
Joined: Thu Jul 12, 2018 11:50 pm
Location: OKC
Karma: 1970

Re: Artificial intelligence in 1v1 diplomacy

#33 Post by Squigs44 » Fri Mar 22, 2019 5:38 am

Restitution wrote:
Fri Mar 22, 2019 5:17 am
Squigs44 wrote:
Fri Mar 22, 2019 4:54 am
RoganJosh wrote:
Thu Mar 21, 2019 1:46 pm
I think 1v1 diplomacy is to simple - AI would probably solve it completely. That would be pretty boring.
I'm not sure there is a complete solution. Too much guesswork involved.

The hard thing about diplomacy is its turn structure. In chess, or go, one decision is made at a time. White makes 1 move, then black makes one move, etc. In diplomacy, two players are simultaneously making up to 17 decisions that all interact with one another. So although there are fewer turns in diplomacy, each turn requires multiple complex interlocking decisions. Also, the fact that you are taking your turn at the same time as your opponent means you are working with incomplete information at every step.
You can solve a probabilistic game. Nash equilibriums.
You might be able to solve for the best move-set at any scenario with your given information using probability. But you can't solve for a "complete" solution in the sense that you can't guarantee that an AI will win every game it plays.

Restitution
Posts: 225
Joined: Thu Jan 31, 2019 7:00 am
Karma: 180

Re: Artificial intelligence in 1v1 diplomacy

#34 Post by Restitution » Fri Mar 22, 2019 5:58 am

Squigs44 wrote:
Fri Mar 22, 2019 5:38 am
Restitution wrote:
Fri Mar 22, 2019 5:17 am
Squigs44 wrote:
Fri Mar 22, 2019 4:54 am


I'm not sure there is a complete solution. Too much guesswork involved.

The hard thing about diplomacy is its turn structure. In chess, or go, one decision is made at a time. White makes 1 move, then black makes one move, etc. In diplomacy, two players are simultaneously making up to 17 decisions that all interact with one another. So although there are fewer turns in diplomacy, each turn requires multiple complex interlocking decisions. Also, the fact that you are taking your turn at the same time as your opponent means you are working with incomplete information at every step.
You can solve a probabilistic game. Nash equilibriums.
You might be able to solve for the best move-set at any scenario with your given information using probability. But you can't solve for a "complete" solution in the sense that you can't guarantee that an AI will win every game it plays.
No, but that's not what solving a game means. Solving the game means that there exists an algorithm which can play perfectly.

RoganJosh
Silver Donator
Silver Donator
Posts: 550
Joined: Sun Dec 31, 2017 1:02 am
Location: Stockholm
Karma: 454
Contact:

Re: Artificial intelligence in 1v1 diplomacy

#35 Post by RoganJosh » Fri Mar 22, 2019 7:23 am

Restitution wrote:
Fri Mar 22, 2019 5:17 am
You can solve a probabilistic game. Nash equilibriums.
Nash equilibrium doesn't exist at every stage in this game.
Squigs44 wrote:
Fri Mar 22, 2019 5:38 am
You might be able to solve for the best move-set at any scenario with your given information using probability. But you can't solve for a "complete" solution in the sense that you can't guarantee that an AI will win every game it plays.
Solving means to describe the optimal strategy. In this game, there is usually no "best move-set." Solving, in this case, means to describe the distribution of frequencies by which you should play each possible move-set. Then you randomize...

Also, no AI in any game is guaranteed win, just let AI play against AI...

Restitution
Posts: 225
Joined: Thu Jan 31, 2019 7:00 am
Karma: 180

Re: Artificial intelligence in 1v1 diplomacy

#36 Post by Restitution » Fri Mar 22, 2019 4:41 pm

RoganJosh wrote:
Fri Mar 22, 2019 7:23 am
Restitution wrote:
Fri Mar 22, 2019 5:17 am
You can solve a probabilistic game. Nash equilibriums.
Nash equilibrium doesn't exist at every stage in this game.
?

If diplomacy is solvable then there necessarily exists a Nash equilibrium for any decision

Squigs44
Developer
Developer
Posts: 3720
Joined: Thu Jul 12, 2018 11:50 pm
Location: OKC
Karma: 1970

Re: Artificial intelligence in 1v1 diplomacy

#37 Post by Squigs44 » Fri Mar 22, 2019 5:43 pm

RoganJosh wrote:
Fri Mar 22, 2019 7:23 am
Also, no AI in any game is guaranteed win, just let AI play against AI...
Depends on the game. In a game of Nim, depending on who goes first and the starting heaps, you could build an AI that would win every single time.

RoganJosh
Silver Donator
Silver Donator
Posts: 550
Joined: Sun Dec 31, 2017 1:02 am
Location: Stockholm
Karma: 454
Contact:

Re: Artificial intelligence in 1v1 diplomacy

#38 Post by RoganJosh » Fri Mar 22, 2019 5:51 pm

Restitution wrote:
Fri Mar 22, 2019 4:41 pm
If diplomacy is solvable then there necessarily exists a Nash equilibrium for any decision
What can I say. In 50/50 guess for the win there is no Nash equilibrium. I think we don't use the same definition of "solve."
Squigs44 wrote:
Fri Mar 22, 2019 5:43 pm
In Nim, depending on who goes first and the starting heaps, you could build an AI that would win every single time.
Even if AI plays against AI? Both would win?

Restitution
Posts: 225
Joined: Thu Jan 31, 2019 7:00 am
Karma: 180

Re: Artificial intelligence in 1v1 diplomacy

#39 Post by Restitution » Fri Mar 22, 2019 6:29 pm

RoganJosh wrote:
Fri Mar 22, 2019 5:51 pm


What can I say. In 50/50 guess for the win there is no Nash equilibrium. I think we don't use the same definition of "solve."
The nash equilibrium is to do option A 50% of the time and option B 50% of the time, anything else would be exploitable. That is exactly what a nash equilibrium means... I do not mean to be rude but I think you might be thinking of a different concept, or have not been taught the concept correctly.

Like, the nash equilibrium on rock paper scissors is to guess each option 33% of the time, which means it's a solved game. There is a GTO solution.

If 1v1 Diplomacy is solvable, there is an optimal (meaning non-exploitable) strategy. Which necessarily means that there exists some Nash equilibrium for every decision.
RoganJosh wrote:
Fri Mar 22, 2019 5:51 pm
Even if AI plays against AI? Both would win?
Pure sophistry

RoganJosh
Silver Donator
Silver Donator
Posts: 550
Joined: Sun Dec 31, 2017 1:02 am
Location: Stockholm
Karma: 454
Contact:

Re: Artificial intelligence in 1v1 diplomacy

#40 Post by RoganJosh » Fri Mar 22, 2019 6:39 pm

Restitution wrote:
Fri Mar 22, 2019 6:29 pm
The nash equilibrium is to do option A 50% of the time and option B 50% of the time, anything else would be exploitable. That is exactly what a nash equilibrium means...
Sorry, but that is not what a Nash equilibrium is. A Nash equilibrium is a situation where both players made a choice, and neither player would want to change their mind even if they were told what the other player chose.

Soo - at least it turns out we had the same definition of what "solve" means! :)

Post Reply

Who is online

Users browsing this forum: No registered users and 2 guests