GitHub Tames Secret Scans with LLMs

GitHub is using LLMs to slash false positives in secret scanning, boosting alert accuracy and developer efficiency by over 75%.

Abstract representation of code with glowing lines and a lock icon, symbolizing secure code scanning.
GitHub leverages LLMs to enhance secret scanning accuracy.· Github Blog
Visual TL;DR
Secret Scanning NoiseDriver
too many alerts that look like secrets but aren't
From the article 3 mentionsGitHub is leveraging Large Language Models (LLMs) to make its secret scanning more trustworthy.
GitHub Secret ScanningContext
existing pipeline combining pattern and AI detection
From the article 3 mentionsThis enhancement builds upon GitHub's existing secret scanning pipeline, which combines pattern-based and AI-based detection.
Microsoft Security & AICore
From the article 4 mentionsTo combat this, GitHub partnered with Microsoft Security & AI to integrate more contextual reasoning into the verification process.
Developer FrictionDriver
wasting time triaging false positive security alerts
From the article 4 mentionsThis friction erodes confidence in automated security systems.
LLM Contextual AnalysisCore
examining how detected values are used within the code
From the articleThe new approach focuses on the verification step, adding LLM-based contextual analysis.
Boosted Alert AccuracyEffect
slashing false positives in secret scanning
Developer EfficiencyOutcome
over 75% improvement in focusing on genuine threats
From the article 4 mentionsThis focused context, rather than more raw code, is crucial for accuracy and efficiency.

GitHub is leveraging Large Language Models (LLMs) to make its secret scanning more trustworthy. The move aims to cut down on the 'noise' of false positives that plague automated security tools, allowing developers to focus on genuine threats.

The core issue: too many alerts that look like secrets but aren't, forcing developers to waste time triaging. This friction erodes confidence in automated security systems. To combat this, GitHub partnered with Microsoft Security & AI to integrate more contextual reasoning into the verification process.

Context is Key

This enhancement builds upon GitHub's existing secret scanning pipeline, which combines pattern-based and AI-based detection. The new approach focuses on the verification step, adding LLM-based contextual analysis. Instead of just matching patterns, the system now examines how a detected value is used within the code.

The goal is to make alerts more actionable. By understanding the usage context, for instance, if a value is assigned to a variable and then passed into an API request or SDK call, the LLM can better determine if it's a real secret or just a placeholder, test data, or an opaque string. This focused context, rather than more raw code, is crucial for accuracy and efficiency.

This strategy yielded impressive results. In evaluations against hundreds of customer-confirmed false positives, the new method achieved a 75.76% reduction, surpassing their 65% target. This translates directly to fewer irrelevant alerts and faster remediation of actual security incidents, a significant win for developer productivity.

The work continues, with GitHub exploring larger datasets and refining context extraction. The ultimate aim is clearer signals, fewer distractions, and quicker action on genuine risks, making GitHub's free code scan and other offerings more effective. This advancement is part of a broader trend in improving GitHub secret scanning with AI, echoing efforts like Uber's AI data guards in their pursuit of reducing false positives at scale.

© 2026 StartupHub.ai. All rights reserved. You may not republish this article in full without a license. Search engines and AI research tools may crawl and summarize for reference. Bulk reproduction or model training requires a license. See our terms.
Daniel Singer

Written by

Daniel Singer

Editor, StartupHub.ai

Daniel Singer is the editor of StartupHub.ai, a technology expert and thought leader on AI and its applications across sectors, from fintech and healthcare to developer tooling and consumer software. He writes and tests the tools covered here thoroughly and regularly, and built StartupHub.ai to give founders, operators and buyers a clearer read on what they are actually being sold.