Ready-to-run cloud templates for RAG, AI pipelines, and enterprise search with live data. 🐳Docker-friendly.⚡Always in sync with Sharepoint, Google Drive, S3, Kafka, PostgreSQL, real-time data APIs, and more.
the LLM vulnerability scanner
NeMo Guardrails is an open-source toolkit for easily adding programmable guardrails to LLM-based conversational systems.
🐢 Open-Source Evaluation & Testing library for LLM Agents
[CCS'24] A dataset consists of 15,140 ChatGPT prompts from Reddit, Discord, websites, and open-source datasets (including 1,405 jailbreak prompts).
A full-stack AI Red Teaming platform securing AI ecosystems via OpenClaw Security Scan, Agent Scan, Skills Scan, MCP scan, AI Infra scan and LLM jailbreak evaluation.
The Security Toolkit for LLM Interactions
Capability-based sandboxes with fine-grained policies The next-generation isolation primitive — brokering access directly within the agent's operating context, with zero setup and zero latency
A secure low code deception runtime framework, leveraging AI for System Virtualization.
Agentic LLM Vulnerability Scanner / AI red teaming kit 🧪
A powerful tool for automated LLM fuzzing. It is designed to help developers and security researchers identify and mitigate potential jailbreaks in their LLM APIs.
OWASP Top 10 for Large Language Model Apps (Part of the GenAI Security Project)
A security scanner for your LLM agentic workflows
An easy-to-use Python framework to generate adversarial jailbreak prompts.
Open-source AI agent firewall for MCP security: agent egress control, DLP, SSRF, and prompt injection defense.
Papers and resources related to the security and privacy of LLMs 🤖
Give each AI agent its own isolated machine with root, Docker, and systemd. Active defense detects and stops threats automatically..
⚡ Vigil ⚡ Detect prompt injections, jailbreaks, and other potentially risky Large Language Model (LLM) inputs
AI-first security scanner with 76 analyzers, 9,600+ detection rules, and repo poisoning detection for AI/ML, LLM agents, and MCP servers. Scan any GitHub repo with: medusa scan --git user/repo
This repository provides a benchmark for prompt injection attacks and defenses in LLMs
Add a description, image, and links to the llm-security topic page so that developers can more easily learn about it.
To associate your repository with the llm-security topic, visit your repo's landing page and select "manage topics."