PartnerAlly Docs
Documents

AI Document Analysis

Learn how PartnerAlly's AI analyzes documents to identify compliance gaps.

AI Document Analysis

When you upload a document, PartnerAlly's AI automatically analyzes it against your enabled compliance frameworks. This guide explains how analysis works and how to interpret results.

How Analysis Works

Document Parsing

The AI reads and understands your document's content, structure, and context. It identifies sections, headings, and key topics.

Framework Mapping

The document is compared against each enabled compliance framework's controls and requirements.

Coverage Assessment

The AI determines which controls the document addresses and how completely it addresses them.

Gap Identification

Where coverage is missing or incomplete, the AI identifies compliance gaps with confidence scores.

Results Generation

Gaps are created in your system with detailed reasoning and source references.

Understanding Analysis Results

Analysis Summary

After analysis completes, you'll see:

MetricDescription
Controls AnalyzedHow many framework controls were checked
Controls AddressedControls the document covers
Coverage PercentageAddressed ÷ Analyzed
Gaps IdentifiedNew gaps found from this document
Confidence RangeMin-max confidence of identified gaps

Gap List

Each identified gap shows:

  • Gap title and description
  • Associated control
  • Severity rating
  • Confidence score
  • Relevant document excerpt

Analysis Per Framework

The AI analyzes against each enabled framework:

SOC 2 Analysis

Checks for coverage of:

  • Trust Service Criteria (CC series)
  • Common criteria mapping
  • Points of focus for each control
  • Required policy language

ISO 27001 Analysis

Checks for coverage of:

  • Annex A controls
  • Mandatory clause requirements
  • Control implementation evidence
  • Risk treatment alignment

HIPAA Analysis

Checks for coverage of:

  • Administrative safeguards
  • Physical safeguards
  • Technical safeguards
  • Required policies and procedures

Other Frameworks

Each framework has tailored analysis:

  • GDPR: Data protection principles, rights
  • PCI-DSS: Cardholder data protection
  • AML: Transaction monitoring, KYC
  • NIST: Security functions, categories

Analysis only runs for frameworks you've enabled. Enable additional frameworks in Settings to expand analysis scope.

Document Types and Analysis

Different document types produce different results:

Policies

Policies typically:

  • Address high-level controls
  • Cover multiple control families
  • Generate gaps about specifics

Example gaps from policy analysis:

  • "Policy lacks specific encryption requirements"
  • "No mention of access review frequency"

Procedures

Procedures typically:

  • Address specific operational controls
  • Cover implementation details
  • Generate gaps about completeness

Example gaps from procedure analysis:

  • "Procedure missing escalation steps"
  • "No defined approval workflow"

Evidence

Evidence documents:

  • May not generate gaps directly
  • Validate control implementation
  • Support gap resolution

Viewing Analysis Details

From the Document

Open the Document

Click the document in the Documents list.

Select Analysis Tab

Click the "Analysis" tab to see results.

Review Gaps

See all gaps identified from this document.

View Excerpts

Click "View Source" to see relevant document sections.

From Gaps Page

Filter gaps by source document:

  1. Go to Compliance Gaps
  2. Filter by "Source Document"
  3. Select the specific document
  4. See only gaps from that document

Analysis Quality Factors

What Improves Analysis

FactorImpact
Clear structureAI can identify sections
Text-based PDFFull content readable
Proper headingsControl mapping works better
Complete contentFewer false gaps
Updated languageMatches current requirements

What Hurts Analysis

FactorImpact
Scanned PDFsText may be unreadable
No structureAI struggles to parse
Incomplete docsMay miss valid coverage
Outdated contentFlags obsolete issues
Embedded imagesText in images not analyzed

Confidence Scores

Each gap includes a confidence score:

What Confidence Means

ScoreInterpretation
90-100%Very certain the gap exists
75-89%High confidence, likely valid
50-74%Moderate confidence, review recommended
Below 50%Lower confidence, verify manually

Factors Affecting Confidence

Higher confidence:

  • Clear absence of required content
  • Explicit requirements in framework
  • Well-structured document

Lower confidence:

  • Ambiguous language
  • Complex control requirements
  • Poor document quality

Multi-Document Analysis

When multiple documents address the same control:

Aggregate Coverage

The AI considers:

  • Combined coverage across documents
  • Which document provides best evidence
  • Gaps that persist across all documents

Gap Deduplication

If multiple documents generate similar gaps:

  • Only one gap is created
  • All source documents are linked
  • Confidence may be higher

Analysis Notifications

You'll be notified when:

  • Analysis completes successfully
  • Analysis fails (with error details)
  • New gaps are identified (configurable)

Configure notifications in Settings.

Troubleshooting Analysis

No Gaps Identified

If analysis finds no gaps:

  • Document may be very comprehensive
  • Frameworks may not apply to document type
  • Check which frameworks were analyzed

Too Many Gaps

If analysis finds excessive gaps:

  • Document may be a general template
  • Wrong document type analyzed
  • Frameworks may need adjustment

Unexpected Gaps

If gaps seem incorrect:

  • Review the AI reasoning
  • Check the source excerpts
  • Consider document context
  • Override if truly invalid

AI Capabilities and Limits

What AI Does Well

  • Identifies missing policy content
  • Catches incomplete procedures
  • Finds control language gaps
  • Processes documents consistently

What AI May Miss

  • Context from other documents
  • Organizational specifics
  • Implicit coverage
  • Industry nuances

Human Review Required

Always review:

  • Critical severity gaps
  • Low confidence gaps
  • Gaps in complex areas
  • Results that seem off

Analysis History

Each document tracks:

  • All analysis runs
  • What changed between runs
  • Historical gap counts
  • Version comparisons

View in the document's History tab.

Previous analysis results are preserved. You can compare current gaps to earlier runs to track improvement.

Next Steps

On this page