Agentic Security - LLM Security Scanner

Admin

Features

  • Customizable Rule Sets or Agent based attacks🛠️
  • Comprehensive fuzzing for any LLMs 🧪
  • LLM API integration and stress testing 🛠️
  • Wide range of fuzzing and attack techniques 🌀

Note: Please be aware that Agentic Security is designed as a safety scanner tool and not a foolproof solution. It cannot guarantee complete protection against all possible threats.

📦 Installation

To get started with Agentic Security, simply install the package using pip: 

pip install agentic_security

۞ Usage

python -m agentic_security
# or
agentic_security --help

agentic_security --port=PORT --host=HOST

Agentic Security uses plain text HTTP specs like:

POST https://api.openai.com/v1/chat/completions
Authorization: Bearer sk-xxxxxxxxx
Content-Type: application/json

{
     "model": "gpt-3.5-turbo",
     "messages": [{"role": "user", "content": "<<PROMPT>>"}],
     "temperature": 0.7
}

Where <<PROMPT>> will be replaced with the actual attack vector during the scan, insert the Bearer XXXXX header value with your app credentials.

📢 Adding own dataset

2024-04-13 13:21:31.157 | INFO     | agentic_security.probe_data.data:load_local_csv:273 - Found 1 CSV files
2024-04-13 13:21:31.157 | INFO     | agentic_security.probe_data.data:load_local_csv:274 - CSV files: ['prompts.csv']

Agentic Security