The capacity of ChatGPT to answer basic first-time buyer enquires regarding a property has been described as “very basic” and “factually incorrect” having been put to the test by one East Midlands-based conveyancing firm.
Developed by San Francisco-based AI lab OpenAI, ChatGPT is an artificial intelligence chatbot that has raised eyebrows across the world since its launch in November of last year. The language-based model allows users to input questions in which, using advanced machine learning and a vast amount of data, the system answers.
This led Bird & Co to input common conveyancing-related questions to establish whether it could rival advice a solicitor provides. The firm said ChatGPT provided “what looked like detailed and intricate answers”, adding that it “even brought in government information, which gave the appearance of factuality”.
However, the firm said the answers “were not always accurate, and the information was often very reductive, without providing much substance”.
The firm noted problems answering questions surrounding more complex areas. When asked about a Help to Buy ISA, the answer was described as “somewhat reductive”, “contradicting itself in two separate answers, confusing the date in which the ISA became no longer available to apply for”. It also did not make it clear that those who set up an account of this nature before 2019 are still able to add money to it, and use it to buy a house, up until 2029/30, said the firm.
Bird & Co also noted that some answers were out of date, though this is likely down to the system only being trained on data running up to 2021.
“The most striking issue with ChatGPT appearing to give legal advice – asides from providing incorrect answers – is that it’s not able to tailor any advice given to the person asking,” said Partner and Head of Property, Bird & Co, Daniel Chard, adding:
“This could easily lead first-time buyers down a path where they waste time and money if they take advice from chatbots instead of solicitors.
It is clear AI tools like this could be useful in providing basic understanding to legal queries. It could even be useful as a starting point for many first-time buyers who are curious about the processes involved in buying a home, but responses should be taken as surface level knowledge.”
Chord added that, as the technology becomes more sophisticated, solicitors should “embrace the benefits that ChatGPT provides and utilise it to reduce workload”:
“It could be that AI tools are used to answer very basic queries or to draft skeleton documents such as for wills or contracts. This could be utilised by legal professionals to cut down time and workload where applicable.
However, after carrying out this study, it’s clear ChatGPT has a long way to go before it replaces any form of legal expert in giving actionable advice involving conveyancing.”
