Malicious Prompt Engineering With ChatGPT

The release of OpenAI’s ChatGPT available to everyone in late 2022 has demonstrated the potential of AI for both good and bad. ChatGPT is a large-scale AI-based natural language generator; that is, a large language model or LLM. It has brought the concept of ‘prompt engineering’ into common parlance. ChatGPT is a chatbot launched by OpenAI in November 2022, and built on top of OpenAI’s GPT-3 family of large language models.





Tasks are requested of ChatGPT through prompts. The response will be as accurate and unbiased as the AI can provide.





Prompt engineering is the manipulation of prompts designed to force the system to respond in a specific manner desired by the user.





Prompt engineering of a machine clearly has overlaps with social engineering of a person – and we all know the malicious potential of social engineering. Much of what is commonly known about prompt engineering on ChatGPT comes from Twitter, where individuals have demonstrated specific examples of the process.





WithSecure (formerly F-Secure) recently published an extensive and serious evaluation (PDF) of prompt engineering against ChatGPT.





The advantage of making ChatGPT generally available is the certainty that people will seek to demonstrate the potential for misuse. But the system can learn from the methods used. It will be able to improve its own filters to make future misuse more difficult. It follows that any examination of the use of prompt engineering is only relevant at the time of the examination. Such AI systems will enter the same leapfrog process of all cybersecurity — as defenders close one loophole, at ..

Support the originator by clicking the read the rest link below.