Skip to content
@protectai

Protect AI

Securing ML

Protect AI OSS

Protect AI's OSS portfolio includes tools aimed at improving security of AI/ML software. These tools are meant for a wide range of engineering, security and ML practitioners including:

  • Developers
  • Security Engineers/Researchers
  • ML Engineers
  • LLM Engineers & Prompt Engineers
  • Data Scientists

Project Description
ModelScan 🔍 ML Model Security Scanner
AI Exploits 🗡️ Collection of AI/ML Exploits
LLM Guard 🛡️ Security Toolkit for LLM Interactions
rebuff 💉 LLM Prompt Injection Attack Detection
NB Defense 📓 Jupyter Notebooks Security
Vulnhuntr 🏹 Autonomous AI-Discovered 0Day Tool

Pinned Loading

  1. modelscan Public

    Protection against Model Serialization Attacks

    Python 353 76

  2. nbdefense Public

    Secure Jupyter Notebooks and Experimentation Environment

    Python 63 12

  3. llm-guard Public

    The Security Toolkit for LLM Interactions

    Python 1.3k 173

  4. rebuff Public

    LLM Prompt Injection Detector

    TypeScript 1.2k 82

  5. ai-exploits Public

    A collection of real world AI/ML exploits for responsibly disclosed vulnerabilities

    Python 1.5k 116

Repositories

Showing 10 of 13 repositories
  • nbdefense Public

    Secure Jupyter Notebooks and Experimentation Environment

    Python 63 Apache-2.0 12 1 4 Updated Jan 13, 2025
  • llm-guard Public

    The Security Toolkit for LLM Interactions

    Python 1,344 MIT 173 21 3 Updated Jan 13, 2025
  • modelscan Public

    Protection against Model Serialization Attacks

    Python 353 Apache-2.0 76 15 (1 issue needs help) 5 Updated Jan 10, 2025
  • chart-testing Public Forked from helm/chart-testing

    CLI tool for linting and testing Helm charts

    Go 0 Apache-2.0 222 0 0 Updated Dec 11, 2024
  • vulnhuntr Public

    Zero shot vulnerability discovery using LLMs

    Python 1,329 AGPL-3.0 135 6 4 Updated Oct 31, 2024
  • .github Public
    1 0 0 0 Updated Oct 24, 2024
  • ai-exploits Public

    A collection of real world AI/ML exploits for responsibly disclosed vulnerabilities

    Python 1,482 116 1 2 Updated Oct 23, 2024
  • TypeScript 11 Apache-2.0 6 2 6 Updated Oct 1, 2024
  • grepdiff Public Forked from rsc/grepdiff

    grep for diffs

    Go 1 BSD-3-Clause 4 0 1 Updated Aug 7, 2024
  • rebuff Public

    LLM Prompt Injection Detector

    TypeScript 1,159 Apache-2.0 82 26 (9 issues need help) 6 Updated Aug 7, 2024