You don’t need to be an AI-trained multi-billion dollar tool to have a slight idea that Portugal and Brazil are not the same countries. Yet, ChatGPT, the viral chatbot launched in 2020, thinks exactly that. It may be due to the fact that Portugal colonized the largest South American country from 1500 until 1815. Granted.
This week, I attempted to use ChatGPT for the second time, this time to understand how the AI tool can organise and deliver information in an easy-to-read format.
When prompted to write an article on ‘Six content creators from Portugal that you should be following on Instagram’ the results, indeed, were returned neatly ordered. The accuracy of the content, however, was well off – 100% inaccurate, to be precise.
Influencer Marketing has rapidly grown in Portugal in the past years, with more businesses and brands recognizing the potential to reach their target audience through social media, content creators and their loyal followers. According to a study by Influencer Marketing Hub, the influencer marketing industry in Portugal was estimated to be worth €26.4 million in 2020, with a projected growth rate of 9.2% over the next five years. So, you would expect that ChatGPT could, at least, find a few names based in Portugal to populate the requested article.
Some of the influencers highlighted within the article are easy to spot as the completely wrong people living on the other side of the ocean.
Take @AdrianaLima, for instance. According to ChatGPT, she is a ‘food and travel content creator with over 120,000 followers on Instagram. Known for her stunning photography and unique travel experiences, Adriana offers a fresh perspective on Portuguese cuisine and culture’ – the AI tool even lists her Instagram handle. The only problem is that Adriana Lima is a Brazilian supermodel with over 15m followers on the Meta-owned social media platform. And she lives in Los Angeles.
Smaller influencers – or at least what ChatGPT thinks are small – kept popping up throughout the 650-word feature, written by the AI tool in exactly 18 seconds. Unfortunately, while the chatbot excels in speed, it lacks accuracy.
According to ChatGPT, Maria Cristina Martins (@mariacristinamartins) is a fashion and beauty content creator with over 5,000 followers on Instagram, and is based in Portugal. ‘With a keen eye for detail and a passion for fashion, Maria provides her followers with the latest trends and inspiration’. You will be thrilled to know that the real Mrs. Martins posting under the suggested handle is in fact miles away from Portugal: she lives in a small town called São Vicente, in Minas Gerais, Brazil.
Another content creator listed as part of the article delivered by ChatGPT was Nuno Gouveia, apparently, a food and travel content creator providing his over 10,000 followers on Instagram with a unique and authentic look at Portuguese cuisine. The only problem? You can’t find Nuno. I tried different variations of the suggested @nunogouveia handle, adding symbols, sometimes numbers or an underscore at the beginning, middle, or end of the handle – a common practice used by those who already had their preferred choice of handle taken.
Out of the whole list provided, all suggested content creators either didn’t exist or lived far away from Portugal – which was the main area I was interested in for the purpose of the test feature.
To be fair, it is very easy to change your handle on Instagram. And some of the smaller content creators featured on the ChatGPT list of suggestions may have recently changed their handles, misleading the AI tool that, according to OpenAI, the San Francisco-based research lab behind ChatGPT, has seen its user-base increase by over 200% in the past year. Remember: the AI tool has only been trained on data up to 2021, it means that ChatGPT has no knowledge of current events – so we have to take its results with a generous pinch of salt.
But how can we make sure that time spent fact-checking and rewriting an AI-generated piece of content will not actually take longer than it would to write an article from scratch in the first place?
Only time – and an enormous amount of fine-tuning – will tell if ChatGPT is the answer to our prayers of artificial intelligence freeing up our scarce time by doing tasks such as research and writing. However, until it can tell Portugal apart from Brazil, I will stick to the old fashion way of news gathering: less AI, more typing and accuracy.