AI Document Analysis
Learn how PartnerAlly's AI analyzes documents to identify compliance gaps.
AI Document Analysis
When you upload a document, PartnerAlly's AI automatically analyzes it against your enabled compliance frameworks. This guide explains how analysis works and how to interpret results.
How Analysis Works
Document Parsing
The AI reads and understands your document's content, structure, and context. It identifies sections, headings, and key topics.
Framework Mapping
The document is compared against each enabled compliance framework's controls and requirements.
Coverage Assessment
The AI determines which controls the document addresses and how completely it addresses them.
Gap Identification
Where coverage is missing or incomplete, the AI identifies compliance gaps with confidence scores.
Results Generation
Gaps are created in your system with detailed reasoning and source references.
Understanding Analysis Results
Analysis Summary
After analysis completes, you'll see:
| Metric | Description |
|---|---|
| Controls Analyzed | How many framework controls were checked |
| Controls Addressed | Controls the document covers |
| Coverage Percentage | Addressed ÷ Analyzed |
| Gaps Identified | New gaps found from this document |
| Confidence Range | Min-max confidence of identified gaps |
Gap List
Each identified gap shows:
- Gap title and description
- Associated control
- Severity rating
- Confidence score
- Relevant document excerpt
Analysis Per Framework
The AI analyzes against each enabled framework:
SOC 2 Analysis
Checks for coverage of:
- Trust Service Criteria (CC series)
- Common criteria mapping
- Points of focus for each control
- Required policy language
ISO 27001 Analysis
Checks for coverage of:
- Annex A controls
- Mandatory clause requirements
- Control implementation evidence
- Risk treatment alignment
HIPAA Analysis
Checks for coverage of:
- Administrative safeguards
- Physical safeguards
- Technical safeguards
- Required policies and procedures
Other Frameworks
Each framework has tailored analysis:
- GDPR: Data protection principles, rights
- PCI-DSS: Cardholder data protection
- AML: Transaction monitoring, KYC
- NIST: Security functions, categories
Analysis only runs for frameworks you've enabled. Enable additional frameworks in Settings to expand analysis scope.
Document Types and Analysis
Different document types produce different results:
Policies
Policies typically:
- Address high-level controls
- Cover multiple control families
- Generate gaps about specifics
Example gaps from policy analysis:
- "Policy lacks specific encryption requirements"
- "No mention of access review frequency"
Procedures
Procedures typically:
- Address specific operational controls
- Cover implementation details
- Generate gaps about completeness
Example gaps from procedure analysis:
- "Procedure missing escalation steps"
- "No defined approval workflow"
Evidence
Evidence documents:
- May not generate gaps directly
- Validate control implementation
- Support gap resolution
Viewing Analysis Details
From the Document
Open the Document
Click the document in the Documents list.
Select Analysis Tab
Click the "Analysis" tab to see results.
Review Gaps
See all gaps identified from this document.
View Excerpts
Click "View Source" to see relevant document sections.
From Gaps Page
Filter gaps by source document:
- Go to Compliance Gaps
- Filter by "Source Document"
- Select the specific document
- See only gaps from that document
Analysis Quality Factors
What Improves Analysis
| Factor | Impact |
|---|---|
| Clear structure | AI can identify sections |
| Text-based PDF | Full content readable |
| Proper headings | Control mapping works better |
| Complete content | Fewer false gaps |
| Updated language | Matches current requirements |
What Hurts Analysis
| Factor | Impact |
|---|---|
| Scanned PDFs | Text may be unreadable |
| No structure | AI struggles to parse |
| Incomplete docs | May miss valid coverage |
| Outdated content | Flags obsolete issues |
| Embedded images | Text in images not analyzed |
Confidence Scores
Each gap includes a confidence score:
What Confidence Means
| Score | Interpretation |
|---|---|
| 90-100% | Very certain the gap exists |
| 75-89% | High confidence, likely valid |
| 50-74% | Moderate confidence, review recommended |
| Below 50% | Lower confidence, verify manually |
Factors Affecting Confidence
Higher confidence:
- Clear absence of required content
- Explicit requirements in framework
- Well-structured document
Lower confidence:
- Ambiguous language
- Complex control requirements
- Poor document quality
Multi-Document Analysis
When multiple documents address the same control:
Aggregate Coverage
The AI considers:
- Combined coverage across documents
- Which document provides best evidence
- Gaps that persist across all documents
Gap Deduplication
If multiple documents generate similar gaps:
- Only one gap is created
- All source documents are linked
- Confidence may be higher
Analysis Notifications
You'll be notified when:
- Analysis completes successfully
- Analysis fails (with error details)
- New gaps are identified (configurable)
Configure notifications in Settings.
Troubleshooting Analysis
No Gaps Identified
If analysis finds no gaps:
- Document may be very comprehensive
- Frameworks may not apply to document type
- Check which frameworks were analyzed
Too Many Gaps
If analysis finds excessive gaps:
- Document may be a general template
- Wrong document type analyzed
- Frameworks may need adjustment
Unexpected Gaps
If gaps seem incorrect:
- Review the AI reasoning
- Check the source excerpts
- Consider document context
- Override if truly invalid
AI Capabilities and Limits
What AI Does Well
- Identifies missing policy content
- Catches incomplete procedures
- Finds control language gaps
- Processes documents consistently
What AI May Miss
- Context from other documents
- Organizational specifics
- Implicit coverage
- Industry nuances
Human Review Required
Always review:
- Critical severity gaps
- Low confidence gaps
- Gaps in complex areas
- Results that seem off
Analysis History
Each document tracks:
- All analysis runs
- What changed between runs
- Historical gap counts
- Version comparisons
View in the document's History tab.
Previous analysis results are preserved. You can compare current gaps to earlier runs to track improvement.
Next Steps
- Folders & Tags - Organize analyzed documents
- Re-analyzing - Re-run analysis
- Compliance Gaps - Work with identified gaps