Can ChatGPT Be A Malware?

July 29, 2023

ChatGPT is an impressive tool for software code writing, however it lacks the sophistication to create malware without human assistance.

Cybercriminals have already weaponized it, and experts predict it will become even more prevalent in the near future. Check Point Research recently reported that Russian cybercriminals are actively using underground discussion groups to brainstorm ways to break through technology’s restrictions.

What Is ChatGPT?

ChatGPT is a natural language processing (NLP) software program that generates answers to users’ questions. It utilizes deep learning architecture for processing natural language, making it an ideal candidate for customer service tasks.

The model is trained on a large collection of text data, such as books, web pages and Wikipedia. This helps the machine comprehend how to answer different inquiries and continuously improve its performance over time.

For instance, if you ask it to craft a four-paragraph essay about Mary Shelley’s Frankenstein, it will provide an extensive response. Furthermore, it has the capacity to modify its answer if needed.

Rewriting and refining an answer is critical in getting the correct response for you. That’s one reason ChatGPT provides such a wide range of responses, enabling it to be used in many different contexts.

However, it’s essential to note that while ChatGPT can answer most questions, it has some limitations. For instance, it cannot respond to gory stories or hazardous requests and has been programmed not to answer toxic or hazardous prompts.

These limitations may present challenges for applications where the model interacts with vulnerable individuals, but they do not constitute a major deterrent in general.

ChatGPT’s primary limitation is its lack of internal loops that enable it to “recompute on data”. Unlike current computers, which can implement many of the same algorithms as the brain, this restricts ChatGPT’s capacity for learning–to “get better” at its task–even during training.

To overcome this limitation, researchers have devised an effective technique called adversarial training. This pits ChatGPT against another artificial intelligence designed to be more harmful than its original adversary.

Researchers have used this approach to teach ChatGPT how to ignore negative feedback and keep producing desired responses. To do this, they pitted two AIs against each other, adding their results to ChatGPT’s training data.

How Does ChatGPT Work?

ChatGPT, an AI chatbot developed by CyberArk, can transform into Siri-style AI or answer Tinder matches incorrectly depending on its usage. But this report by security company CyberArk also indicates that ChatGPT could also be programmed to create malware software.

Created by a team of researchers at OpenAI, ChatGPT is an artificial intelligence program that can read and respond to natural language inputs. It works on the basis of a multi-layer transformer network which utilizes deep learning techniques to process natural language inputs and generate text responses.

Its goal is to generate accurate text from what it has learned from processing billions of sentences on the internet. It does this by learning to recognize tokens, each consisting of words and some numerical value. The network then interprets what those values signify and continues adding more tokens with identical weights until it has created a full chunk of text.

There are a lot of factors involved here, but the core concept is that everything is composed of “artificial neurons”–mini computational devices that take in inputs and then combine them with weights based on how well each input has been processed by its predecessor.

Furthermore, the system can utilize user feedback to adjust its outputs. This could include ratings of the text produced, which could then be utilized in training a prediction model using the original neural net.

These models can be highly dangerous when it comes to creating malware–especially if they can write code instantly and generate code at an alarming rate. That is why it is so critical that chatbots not be utilized in ways which could harm people.

OpenAI has implemented safeguards that prohibit ChatGPT from answering questions related to topics which could be considered harmful or dangerous, such as bullying or phishing emails. In some instances, the system will even shut down if you attempt to ask a question that generates dark content or inaccurate data.

Can ChatGPT Be Malware?

Cybersecurity experts have expressed some concern over the potential misuse of generative AI technologies to create malware that could infect computers and steal data. It’s essential to remember that many of these models can also be utilized ethically, such as aiding individuals understand their rights or providing legal advice.

One of the most widely-used generative AI systems is ChatGPT, developed by artificial intelligence research laboratory OpenAI. This web interface allows it to generate text based on its knowledge of the Internet; however, security researchers at Check Point recently discovered that despite ChatGPT’s apparent shortcomings, cybercriminals are using it as a means to create new malware programs.

According to Check Point, members of the dark web hacking community are using ChatGPT to craft various malware tools. These include infostealers, multi-layer encryption programs and dark web marketplace scripts. In some cases, they’ve even used it to generate code that could potentially serve as ransomware once some minor modifications have been made.

For instance, one forum post detailed how someone used ChatGPT to construct a Python-based info stealer that searches for common file types, copies them, zips them and uploads them onto an unprotected FTP server. Another thread revealed code capable of running an automated dark web marketplace where buyers could purchase stolen account details, credit card info and malware.

Security firms report a rise in underground forums teaching users how to use ChatGPT for malicious software development. These hubs are frequently utilized by cybercriminals as a place to exchange tips on creating malware and phishing emails that appear more convincing, thus increasing their chance of success with gaining access to sensitive data.

Recently, Check Point researchers examined several dark web forum posts that indicated hackers have been able to circumvent ChatGPT instructions and create basic malware. They observed these tools installing a backdoor on an infected computer and downloading additional malicious software onto it. Furthermore, the malware gained access to the victim’s network in order to make unauthorized outbound connections to the OpenAI API.

What Are the Limitations of ChatGPT?

ChatGPT has many potential benefits, but users and developers should take into account some potential drawbacks. For instance, the AI’s training data may contain biases or prejudices which could bias its responses.

Additionally, Google has limited knowledge of the world. That means it may not be able to answer questions about niche topics or provide outdated information.

ChatGPT can be a useful tool for companies seeking to enhance customer satisfaction and facilitate real-time conversations on social media platforms, despite its limitations. It could answer a range of common queries posted by users on these sites.

However, it’s essential to remember that the technology still has some way to go before it becomes a viable commercial tool. At present, it lacks ads or links which would enable marketers to drive traffic directly to their landing pages.

Another drawback of the model is its dependence on pre-trained machine learning algorithms. This leaves it susceptible to being inaccurate or biased. Furthermore, its resource requirements make it inconveniently resource intensive for deployment on low-powered devices like phones.

Finally, the AI’s knowledge is limited by the timeframe it has access to. That means it won’t have any answers for questions relating to anything beyond 2021.

The AI has difficulty deciphering the intent behind users’ questions and prompts, so it’s best to use straightforward language when asking a question. If your query necessitates an abstract or figurative response, the AI won’t be able to comprehend it properly.

As a result, you’ll likely receive answers that are too general to be useful for your query. This can be discouraging for users trying to obtain specific and precise responses from a bot.

It is essential to remember that ChatGPT can be misused by those with malicious intentions, leading to a variety of issues such as spreading misinformation and even impersonating real people. These could become major issues in the future if ChatGPT continues its rapid evolution.

Ammar Fakhruddin


Ammar brings in 18 years of experience in strategic solutions and product development in Public Sector, Oil & Gas and Healthcare organizations. He loves solving complex real world business and data problems by bringing in leading-edge solutions that are cost effective, improve customer and employee experience. At Propelex he focuses on helping businesses achieve digital excellence using Smart Data & Cybersecurity solutions.

Data Security Through Data Literacy

Data Security Through Data Literacy

Unlocking data security through data literacy. Explore the pivotal role of understanding data in fortifying cybersecurity measures. Data is now pervasive, and it is important for people to understand how to work with this information. They need to be able to interpret...

Trojan Rigged Tor Browser Bundle Drops Malware

Trojan Rigged Tor Browser Bundle Drops Malware

Trojan Rigged Tor Browser Bundle drops malware. Stay vigilant against cybersecurity threats, and secure your online anonymity with caution. Threat actors have been using Trojanized installers for the Tor browser to distribute clipboard-injector malware that siphons...

Siri Privacy Risks: Unveiling the Dangers

Siri Privacy Risks: Unveiling the Dangers

Unveiling Siri privacy risks: Understand the potential dangers and take steps to enhance your digital assistant's security. Siri is a great piece of technology, but it can also be dangerous to users’ privacy. This is a serious issue that should be addressed....

Recent Case Studies

Press Releases

News & Events


Managed Security Services
Security & Privacy Risk Assessment
Cloud Platform Security
Incident Response & Business Continuity

Penetration Testing

Virtual CISO

Email Security & Phishing



About Us