Heritage AR Explorer – Full Roadmap (SIH 2025)
Step 1 – Project Setup & Planning
- Aim: AR app to scan monuments and show 3D model + info + audio guide.
- USP: Judges impressed because AR + AI + heritage = unique combo.
Tech Stack
- App: Flutter / React Native
- AR: Unity + AR Foundation or ARCore
- 3D Models: Sketchfab / Blender
- Backend: Firebase
- AI: CV model (monument detection), NLP summarizer, TTS for audio
Step 2 – Research & Data Collection
- Select 3–5 monuments for prototype (Taj Mahal, Qutub Minar, Gateway of India, Charminar, Red
Fort).
- Collect data: Images, 3D models, historical info.
Step 3 – AI Model Development
- Monument Recognition: TensorFlow/Keras (MobileNet/ResNet), OpenCV.
- Info Generation: HuggingFace Transformers (T5/BART), spaCy.
- Audio Guide: gTTS, Coqui TTS, or Google TTS.
Step 4 – AR Integration
- Marker-based AR (use monument photo as marker) → easier for hackathon demo.
- Overlay 3D models on camera feed using Unity AR Foundation.
Step 5 – App Development
- Flutter/React Native frontend with Firebase backend.
- Features: Scan monument → detect → AR model + info + audio.
- Firebase Firestore + Storage for data and assets.
Step 6 – Extra Features
- Gamification (collect monuments, badges).
- Multi-language support (Hindi + English).
- Offline mode for rural/tourist areas.
- Leaderboard (optional).
Step 7 – Testing & Demo
- Run demo on Android phones.
- Use printed monument photos for testing.
- Presentation: Problem → Solution → Demo → Future scope.
Tools & Libraries
AI / ML Tools (Member 1)
- TensorFlow/Keras, OpenCV, HuggingFace Transformers, spaCy, gTTS, Coqui TTS.
AR & 3D Tools (Member 2)
- Unity + AR Foundation, ARCore, Vuforia SDK.
- Sketchfab, Blender.
App Development Tools (Member 3)
- Flutter or React Native.
- Firebase SDK, Google Maps API (optional).
Backend Tools (Member 4)
- Firebase Firestore, Firebase Storage.
- Node.js/Express (optional), Google Sheets API.
UI/UX & Presentation
- Figma, Canva, PowerPoint, Miro.
Work Division
Member 1 – AI/ML Engineer
- Monument recognition model, NLP summarizer, TTS integration.
Member 2 – AR/Unity Developer
- Unity + AR Foundation setup, 3D model import, marker recognition.
Member 3 – App Developer
- Flutter/React Native app, Firebase integration, AR SDK linking.
Member 4 – Backend + Content
- Data collection, Firebase DB setup, 3D models sourcing, presentation deck.
End Result
- Camera scans monument → AI recognizes → AR 3D model + info popup → audio guide plays.
- Judges impressed with AI + AR + cultural heritage combo.
