Microsoft is revolutionizing photo editing with AI-powered features in its Photos app, specifically designed for Copilot+ PCs. The new Relight tool and Semantic Search capabilities leverage on-device AI processing to deliver professional-grade edits and intuitive organization without compromising privacy.
The AI-Powered Relight Feature
The Relight feature uses advanced neural networks to analyze and adjust lighting in photos dynamically. Unlike traditional brightness/contrast sliders, it:
- Recreates realistic directional lighting
- Preserves shadows and highlights naturally
- Works on both new and old photos
Early tests show the tool outperforms cloud-based alternatives in speed, with edits applying in under 2 seconds on Snapdragon X Elite devices.
Semantic Search: Finding Photos by Meaning
Microsoft's semantic search understands:
- Objects ("red car", "birthday cake")
- Emotions ("happy moments", "surprised faces")
- Locations ("beach photos", "mountain views")
- Time periods ("last summer", "Christmas 2020")
This goes beyond filename/metadata searches by analyzing actual image content through:
- Computer vision models
- Natural language processing
- Contextual understanding
Privacy-First AI Processing
All processing happens on-device thanks to:
- NPU acceleration (40+ TOPS)
- Windows Studio Effects
- Local AI model caching
This addresses growing concerns about cloud-based photo analysis while maintaining performance.
Copilot+ PC Requirements
To use these features, you'll need:
- Snapdragon X Elite/Plus processor
- Windows 11 24H2 or later
- Minimum 16GB RAM
- Photos app version 2024.11020.1001.0+
Comparative Analysis
| Feature | Traditional Apps | AI Cloud Services | Photos App (Copilot+) |
|---|---|---|---|
| Speed | Fast | Slow (network) | Instant |
| Privacy | High | Low | Highest |
| Accuracy | Manual | High | Highest |
| Cost | $$ | $$$ | Free |
Real-World Applications
- Content Creators: Quickly adjust product photo lighting
- Families: Find specific moments across decades of photos
- Researchers: Organize visual data by conceptual themes
Future Roadmap
Microsoft hints at upcoming features:
- AI-powered photo restoration
- Multi-photo style transfer
- Collaborative albums with shared AI tags
These updates position the Photos app as a serious competitor to Adobe Lightroom for casual users, with the added advantage of complete privacy and offline functionality.