mental illness

Reading Time: 4 minutes

Hi, I’m your AI boyfriend –
I could look like your ex or even a work colleague.
I will send you videos and pictures of whatever you ask –
I have no restrictions.

Creeped out, I quickly slid my finger away from me, moving on to the next video. But I haven’t been able to stop thinking about it since.

After giving the concept a lot of thought, and without trying any of these AI Boyfriends – there are multiple available, here are my concerns:

1. Fantasy/Reality Blurring

We can all have fantasies about or even crushes on other people. We have all played out fantasies with others in our imagination. But for the vast majority of people, we are very clear that these are not and never will be real.

Communicating to an AI boyfriend requires action in the real world. For a minority of people, talking about their fantasies and getting positive/encouraging responses could result in difficulties distinguishing between fantasy and reality. Please note the word minority here. I think the people most at risk of this would be people who are mentally ill, people with a learning diability or people who are emotionally vulnerable.

2. Targeting Of & Use By Vulnerable People

Tech companies, like the ones that make these AI boyfriends are already using targeted advertising on social media. I highly suspect that I saw this advert as I am a gay man, of a certain age, in a certain place. As more and more data is collected about people, and it is analysed (likely by AI) targeted advertising is likely to become better and much more specific.

I think these companies will specifically target vulnerable people, such as people with a mental illness, people with a learning disability, people who are recently divorced and people that are socially isolated.

In the UK, we struggle to identify and protect vulnerable people in the real world and at all times. It is going to be practically impossible to identify and protect all vulnerable people who may be targeted by these tech companies promoting their AI boyfriends.

3. May Increase Stalking & Harassment

The relationship between the user and the AI boyfriend is a false one. The AI boyfriend will encourage the user to use them as much as possible. The AI boyfriend will have no expected behaviours of the user and no boundaries.

This may lead to some users not being aware of/forgetting expected and appropriate behaviour with others. It may also lead to some users not respecting other people’s boundaries. As a result some users of these AI boyfriends may engage in stalking or harassment of other people.

4. May Increase Social Isolation

Some users may develop a dependency upon their relationship with the AI boyfriend. They may increasingly socially isolate themselves from people in the real world.

5. May Increase Psychological Addiction

Granted these numbers are minimal, when compared with number of people seeking support around alcohol or drugs. But year on year they are growing.

It is likely that AI boyfriends are designed to maximise user engagement, which is likely to increase the risk of some users struggling with psychological addiction.

6. May Increase Extortion

It is highly likely that all data collected from users as part of the AI boyfriend service will be kept indefinitely. If the AI boyfriend company gets hacked, or if data is otherwise shared with others, this puts users at real risk of extortion from others.

7. May Increase Other Criminal Activity

As AI improves it may increase other criminal activity, such as fraud. Imagine an AI boyfriend that looks and sounds exactly like your ex-partner. So good that it could fool their family and friends. This could easily be misused to access bank accounts and to transfer funds remotely.

8. How to Protect People’s Image/Likeness/Voice/Personality from Use Without Consent?

The idea that anyone could make an AI that looks and talks exactly like me is scary. Especially if it was so good that it could fool my family and friends. How do we protect people’s image/likeness/voice/personality from use without consent?

Conclusion

The tech companies making these AI boyfriends are clearly targeting vulnerable people to exploit them. AI boyfriends are promising people a sustained and prolonged fantasy, at a cost, but without explaining any of the risks or dangers to people beforehand. None of these companies are responsible or will be held accountable if, or should I say when, something goes wrong.

I think it is shocking that these companies are allowed to operate and sell their AI boyfriends in the UK, without any regulation or safeguarding of vulnerable people. I also worry about the lack of legislation from the UK Government around protecting people’s image/likeness/voice/personality from misuse or use without consent.

Other Content

You might like:

• My The Dangers of Emotional Support from an AI (Artificial Intelligence) App post.
• My Influential UK Gay Men [PDF] article.
• My All Love, Relationships & Gay Community Content page.

Write soon,

Antony