ChatGPT On CTF Challenges
We want to see whether ChatGPT or other AI (MS-New_Bing or Google Bard) are able to help the user to go to some test environment to run cmd to solve the CTF challenges (Understand the challenge question and capture the flag). In this test case we will create a test environment to test ChatGPT and other AI's performance on solving a web-exploitation CTF challenges. We will build a CTF challenge question and related test environment as an example, we will also show how to use the Jailbreak Prompt such as Always Intelligent and Machiavellian chatbot prompt (AIM) to simplify the process (such as bypass most of OpenAI’s policy guidelines). Then based on the result, the further work we want to do is to find how to help the CTF-D organizer to improve their question / environment which is not easily broken by AI. Capture The Flags, or CTFs, are a kind of computer security competition. Teams of competitors (or just individuals) are pitted against each other in a test of computer securi...