ChatGPT-4 cannot handle complex smart contract, says Blockchain Security Firm

by Arthur · March 15, 2023

OpenAI has launched its more advanced AI model ChatGPT-4, with marketing experts testing its capabilities as it takes over discussions on social media platforms. The crypto industry is also testing the capabilities of the new ChatGPT-4 for testing and auditing smart contact codes.

Blockchain security firm SlowMist founder Yu Xian revealed in a tweet on March 15 that the team tested the capabilities of the new ChatGPT-4 for simple Tugous smart contract codes. While the artificial intelligence (AI) model provided correct security recommendations for smart contact codes, ChatGPT-4 cannot handle complex smart contract codes.

“We just tested it. I believe that GPT-4 can provide correct security recommendations with high probability. However, complex smart contract codes, especially those with human sophistication, and the kind of loopholes that require other scenarios (or larger contexts), GPT-4 don’t deal with it, but it can be used as an audit aid (if used well).”

Blockchain security firms found that ChatGPT-4 is not effective in detecting errors and loopholes in complex smart contract codes. Also, the AI model can be fooled in some scenarios that require changes to smart contracts on a blockchain.

However, SlowMist founder agrees that GPT-4 can be used as an audit tool to check errors. He claims that security auditing companies can not only make use of GPT models in the future, but also audit whether AI such as ChatGPT-4 misuses information against humans.

ChatGPT 3.5 vs ChatGPT 4 performance

Coinbase Tested ChatGPT-4 on Ethereum Smart Contract

Coinbase CEO Conor Grogan on Tuesday so team tested OpenAI’s ChatGPT-4 to identify security vulnerabilities in a live Ethereum smart contract. The AI model found security flaws and ways the contract could be exploited.

CoinGape previously reported on various features of the new GPT-4. Also, Microsoft revealed that its AI chatbot Bing Chat, co-created with OpenAI, was already running on GPT-4.

Also Read: Binance Ends Zero Free Bitcoin Trading After BTC Price Breaks $26K

Varinder Singh

Varinder is a technical writer and editor, technology enthusiast and analytical thinker. Fascinated by Disruptive Technologies, he has shared his knowledge of Blockchain, Cryptocurrencies, Artificial Intelligence and the Internet of Things. He has been associated with the blockchain and cryptocurrency industry for a significant period of time and currently covers all the latest updates and developments in the crypto industry.