10 Conversations

Note: ALL tests were run on 29 February 2020.

Smoking Gun Test 6001

clear memory 6001 Icebreaker

Ok Test: SG 6001 Time: 12:24pm

tom is a dentist

his wife kate is a doctor

yesterday she climbed ben nevis

how high is it

Ben Nevis has a height of 1344 metres.

what is that in feet

4409 feet

what did kate climb yesterday

Ben Nevis

is she married

Yes

what does her husband do

Tom is a dentist.

Notes:

This is an extremely simple conversation. However, even with such simplicity, it should be clear that both Cognitive Memory, and the Common-sense it enables, are essential if the AI is to appropriately answer the question:

is she married

Smoking Gun Test 6002

clear memory 6002 Repetition

Ok Test: SG 6002 Time: 12:24pm

tom is a dentist

I know that.

he was born in 1980

I know that.

his wife kate is a doctor

his wife is called kate

I know that.

yesterday kate climbed ben nevis

I know that.

today tom climbed ben nevis

Notes:

This test is designed to illustrate that for a human-quality AI, it is essential that it can respond:

I know that.

appropriately.

A human-quality AI must have the ability to recognise repetitive Statements, otherwise it would be at best, irritating, and at worst, completely confused.

Of course, in some cases the AI will need to clarify a statement – see SG6005.

Smoking Gun Test 6003

clear memory 6003 Polar

Ok Test: SG 6003 Time: 12:25pm

tom is a dentist

is tom a doctor

No, Tom is a dentist.

what does he do

Tom is a dentist.

is he a dentist

Yes.

his wife kate is a doctor

is kate a dentist

No, Kate is a doctor.

what does she do

Kate is a doctor.

last year fred climbed the highest mountain in south america

has fred climbed aconcagua

Yes

when

2019

Notes:

Polar Questions, that is those questions which can be answered with a simple yes or no are very common.

This test verifies that HPD can handle both the associated Statements and the Polar Questions appropriately.

The response to the last question is 2019, this is because all of the 100 Smoking Gun from SG6001 to SG6100 were run on the 29 Feb 2020.

Smoking Gun Test 6004

clear memory 6004 Polar_choice

Ok Test: SG 6004 Time: 12:26pm

tom is a dentist

is tom a doctor or a dentist

Tom is a dentist.

his wife kate is a doctor

is kate a dentist or an accountant

Neither, Kate is a doctor.

what does she do

Kate is a doctor.

is she an accountant or a dentist

Neither, Kate is a doctor.

is she an accountant or a doctor or a banker

None of those, Kate is a doctor.

is she an accountant or a doctor or a banker

Kate is a doctor.

Notes:

A variant of Polar Questions is Polar Choice Questions.

Polar Choice Questions are questions where the speaker prompts the AI to select a response from stated options.

However, in some cases the correct response may not be one of the options.

This is illustrated in this test with the question:

is she an accountant or a dentist

and the follow-on question:

is she an accountant or a dentist or a banker

In both these cases HPD gives the appropriate correct response.

Smoking Gun Test 6005

clear memory 6005 Clash

Ok Test: SG 6005 Time: 12:26pm

peter is a german dentist

peter is german

I know that.

peter is a dentist

I know that.

peter is a doctor

I currently have Peter’s occupation as dentist. Do you want me to update this to doctor.

Ok, I’ll make no changes.

emily is a scottish solicitor

emily is german

I currently have Emily’s nationality as scottish. Do you want me to update this to german.

Ok, I’ll make no changes.

emily is english

I currently have Emily’s nationality as scottish. Do you want me to update this to english.

yes

Ok, I’ve updated Emily’s nationality to english.

what does emily do

Emily is a solicitor.

what does peter do

Peter is a dentist.

what is his nationality

German

Notes:

Sometimes within a conversation Statements may clash, i.e. the current statement may contain information that conflicts with the information contained in an earlier statement.

The appropriate behaviour in such circumstances is for the AI to request clarification, and for the user to reply appropriately.

Smoking Gun Test 6006

clear memory 6006 Actions

Ok Test: SG 6006 Time: 12:27pm

i have a blue car

my son edward washed it yesterday

today he washed his sisters car

she is called fiona

her car is white

who washed a blue car

Edward

when

Yesterday

what did edward do today

29th February 2020 Edward washed Fiona’s car.

what did edward do today

29th February 2020 Edward washed Fiona’s car.

what colour is fionas car

White

what is my son called

Edward

what is my daughter called

Fiona

Notes:

Obviously Statements can involve actions and so this test is a simple example of the AI encoding actions in Cognitive Memory.

There is also a good example of a non-specific question:

what did edward do today

Given that this test was run in its entirety on 29 February 2020, the HPD Output Manager, in a Voice Assistant environment, should have mapped the date in HPD’s response to today – this upgrade to HPD is pending.

Smoking Gun Test 6007

clear memory 6007 Birthdays

Ok Test: SG 6007 Time: 12:28pm

my brother andrew was 40 yesterday

what year was he born

1980

when will he be 50

28th February 2030

what day of the week was he born

Thursday

i was born on the 7th of july 1977

how old am i

42 years old

when is my next birthday

7th July 2020

when is my 50th birthday

7th July 2027

what day of the week is that

Wednesday.

Notes:

A simple test demonstrating common sense.

However, you must remember that the responses reflect the fact that this test was run on the 29 February 2020.

Smoking Gun Test 6008

clear memory 6008 Birth

Ok Test: SG 6001 Time: 12:24pm

adam was born on the 10th october 2010

he was born in york

two years earlier his sister emily was born on the 7th july

she was born in bath

is adam older than emily

is emily older than adam

Yes

how old is she

11 years old

where was she born

Bath

how old is her brother

9 years old

where was he born

York

the midwife was called alison

Notes:

Another simple test displaying Common-sense.

Smoking Gun Test 6009

clear memory 6009 Interpersonal

Ok Test: SG 6009 Time: 12:29pm

tom is an accountant

his father is peter

peter is susans father

she is a civil engineer

who is toms sister

Susan

is she an engineer

Yes, Susan is a civil engineer.

what does her brother do

Tom is an accountant.

what are peters children called

The names I know are: Tom Susan

Notes:

A simple test to displaying an understanding of relationships.

Smoking Gun Test 6010

clear memory 6010 Two_Alices

Ok Test: SG 6010 Time: 12:30pm

my wife alice is a dentist

my sister is also called alice

she is a doctor

i married my wife in 2001

alice is german

my sister lives in oxford

alice likes swimming

who is german

Alice (your wife)

who likes swimming

Alice (your sister)

who is a doctor

Alice (your sister)

who is a dentist

Alice (your wife)

Notes:

Of all these first 10 simple introductory tests, this is the most beautiful.

Many other researchers seemingly make progress by simplifying their use of language, often by ignoring statements and also by limiting the environment to contain only individuals with distinct names.

Clearly such approaches make no contribution to human-quality AI.

In this test there are not only two distinct individuals called Alice, but the Common-sense within HPD is able to add the distinguishing terms i.e. (your wife), (your sister) in the last four responses automatically!

Put simply: this is a multi-turn, human-quality conversation.