Module Code & Module Title
CS6P05NI Final Year Project
Assessment Weightage & Type
5% FYP Proposal
Year and Semester 2023-24 Autumn
Object Detection and Assist for Visually Impaired
Student Name: Bernard Dhakal
Group: C16
London Met ID: 22068161
College ID: np01cp4a220509
Assignment Due Date: 11/28/2024
Assignment Submission Date: 11/28/2024
Submitted To:
External Supervisor- Krity Dangol
Internal Supervisor-Pranchee Singh
Word Count : 2268
I confirm that I understand my coursework needs to be submitted online via Google Classroom under
the relevant module page before the deadline in order for my assignment to be accepted and marked. I
am fully aware that late submissions will be treated as non-submission and a marks of zero will be
awarded.
Contents
1. Introduction ............................................................................................................ 6
a. Problem Scenario ............................................................................................... 6
b. The Project as a Solution .................................................................................... 6
2. Aims and Objectives .............................................................................................. 7
Aim .......................................................................................................................... 7
Objectives ............................................................................................................... 7
3. Expected Outcomes and Deliverables .................................................................. 8
4. Project Risks, Threats and Contingency Plan: ...................................................... 9
5. Project Milestones: .............................................................................................. 10
5.1 Project Approval and Kickoff ........................................................................... 11
5.2 Requirement Gathering Completed ................................................................ 11
5.3 Wireframe and Initial Design Completed ........................................................ 11
5.4 Prototype Version 1 Developed ...................................................................... 11
5.5 Prototype Iteration Based on User Feedback ................................................. 12
5.6 Integration of App Features ............................................................................ 12
5.7 Testing Phase Completed .............................................................................. 12
5.8 Beta Version Ready ........................................................................................ 12
5.9 Final Version Ready ....................................................................................... 13
5.10 Project Submission ....................................................................................... 13
6. PROJECT WBS: ................................................................................................. 14
7. Gantt Chart: ......................................................................................................... 15
8. Methodology: Prototype Evolutionary Approach: ................................................ 16
7.1 Overview of the Prototype Evolutionary Model in this project: ....................... 17
7.2 Phases of the Prototype Evolutionary Methodology ....................................... 17
7.3 Benefits of the Prototype Evolutionary Model ................................................. 19
9. Conclusion ........................................................................................................... 20
10. References .......................................................................................................... 21
Figure 1 Milestone Chart .......................................................................................... 10
Figure 2 Work Breakdown Structure ........................................................................ 14
Figure 3 Gantt-1 ....................................................................................................... 15
Figure 4 Gantt-2 ....................................................................................................... 15
Figure 5 Gantt-3 ....................................................................................................... 15
Figure 6 Prototype Methodology .............................................................................. 16
1. Introduction
a. Problem Scenario
Around 253 million people live with vision impairment world million are blind.
(WHO, 2017). These users face various kinds of struggle in there day to day
life and are assisted by various things like white canes, guide dogs but in this
era of technology the advancements are to effectively help them get a new
resource which will ensure them a better way to navigate throughout the ways
and obstacles helping them to better understand the advancement in the
technology aswell as experience it.
b. The Project as a Solution
This project aims on building a mobile app that will help visual impaired users to
recognize pr navigate themselves throughout the objects around them. By simply
only using their phone’s camera and the app itself will detect objects in real time
and provide user with information such as what those objects are and where they
are using audio feedback. The app will use an AI trained model to identify objects
and a text to speech system to provide audio feedbacks to user such as saying
the object names. This will allow users to better understand their surroundings
helping to make their daily life easier and more independent for them.
2. Aims and Objectives
Aim
To create a mobile app that helps blind individuals identify objects in real-time
using the phone’s camera, providing audio feedback to help them understand
their environment.
Objectives
1. Development of the object detection feature using an AI model that can
detect and recognize objects from the phone’s camera feed.
2. Adding of TTS so that the application can speak out names of detected
objects to the user.
3. Optimization of the app for mobile platforms, converting the model into a
format like TensorFlow Lite to make it run efficiently on Android and iOS.
4. Design an easy to use interface that works without visual input, using voice
commands or gestures to control the app.
5. Test the app in real-life situations to make sure the object detection is
accurate and the audio feedback is fast enough.
3. Expected Outcomes and Deliverables
Through the app the following outcomes will be delivered to the users:
1. A Mobile App: A fully functional mobile app that will detect objects in real
time and provide TTS feedback to help blind users navigate thoroughly.
2. Object Detection Feature: A computer vision model that runs on mobile
devices and can accurately detect objects in real-time.
3. Text-to-Speech Integration: A feature that will call out the names of
detected objects using the phone’s built in text to speech system.
4. Technical Documentation: A guide for developers detailing the app code,
how it works, and how it can be updated or modified or trained in the future
if any changes are to be made in the future.
5. User Documentation: A simple user manual for setting up the visually
impaired users experience with the app which will be explaining how to use
the app with voice commands.
6. Testing Report: A report showing how the app performed in tests, including
feedback from some users and how they got along with the app.
This project will result in the creation of a practical tool that will visually impaired
users to recognize objects around them whilst improving their ability to navigate
their environment independently.
4. Project Risks, Threats and Contingency Plan:
Risks:
a. Technical Challenges
b. Insufficient dataset
c. Time management issues
d. UI challenges
Contingency Plans:
a. Allocation of proper hardware and test devices.
b. Conduction of user testing with visually impaired users to ensure the UI
is very easy to use for them.
c. Enhancing of more of the functions in the application to ensure of best
of user experiences.
5. Project Milestones:
Figure 1 Milestone Chart
5.1 Project Approval and Kickoff
The starting date will be from the 12th of October and the ending date will be on
19th of October of 2024.
Deliverables: Approved project scope, objectives, and expected deliverables.
5.2 Requirement Gathering Completed
The starting date will be from the 2nd of November and the ending date will be
on 10th of November of 2024.
Deliverables: Documentation of functional and non-functional requirements
finalized.
5.3 Wireframe and Initial Design Completed
The starting date will be from the 22nd of November and the ending date will
be on 30th of November of 2024.
Deliverables: Approved wireframes and UI.
5.4 Prototype Version 1 Developed
The starting date will be from the 1st of December and the ending date will be
on January 15th of 2025.
Deliverables: Working on the prototype with YOLO object detection and basic
TTS for the system integrated.
5.5 Prototype Iteration Based on User Feedback
The starting date will be from the 16th of January and the ending date will be
on the 10th of February of 2025.
Deliverables: Updated version of the prototype based on user feedback from
visually impaired user.
5.6 Integration of App Features
The starting date will be from the 11th of February and the ending date will be
on the 5th of March of 2025
Deliverables: Feature integration such as video output, object detection, TTS,
UI/UX finalized.
5.7 Testing Phase Completed
The starting date will be from the 6th of March and the ending date will be on
the 25th of March of 2025.
Deliverables: Unit, integration, usability testing completion and critical bugs
fixing.
5.8 Beta Version Ready
The starting date will be from the 26th of March and the ending date will be on
the 10th of April of 2025.
Deliverables: Beta version deployed for limited user testing and the feedback
will be collected for some final fixes.
5.9 Final Version Ready
The starting date will be from the 11th of April and the ending date will on the
25th of April of 2025.
Deliverables: Final version of the application to be completed and a user
manual and technical documentation to be prepared.
5.10 Project Submission
The starting date will be from the 26th of April and the ending date will be on
the 30th of April of 2025.
Deliverables: Final application to be submitted and presented on the FYP
presentation or meeting.
6. PROJECT WBS:
“A work breakdown structure (WBS) visually organizes project deliverables
into different levels based on dependencies. It’s essentially your project
plan in a visual form, with your project objective at the top, then
dependencies and sub-dependencies below.” (Asana, 2024)
Figure 2 Work Breakdown Structure
7. Gantt Chart:
“A gantt chart is a horizontal bar chart used in project management to
visually represent a project over time. Gantt charts typically show you the
timeline and status—as well as who’s responsible—for each task in the
project.” (TeamGantt, n.d.)
Figure 3 Gantt-1
Figure 4 Gantt-2
Figure 5 Gantt-3
8. Methodology: Prototype Evolutionary Approach:
“The evolutionary prototyping model combines incremental and extreme models.
This model involves a series of prototyping refinements. The first assignment is
to design and split the system into several independent modules. Each module is
given required functionalities and then presented to the customers.
(Wondershare Technology Group, 2024) Below is the step-by-step
methodological roadmap for achieving the project's expected outcomes:
Figure 6 Prototype Methodology
8.1 Overview of the Prototype Evolutionary Model in this project:
The Prototype Evolutionary methodology involves of building of prototype
systems which will go through different phases of changes as per the user
feedback ensuring of a complete project and also that the system will consist
of all the necessary functionalities which are important for the program. The
major points for why this Prototype Evolutionary Methodology is good for this
project is because:
• The requirements for this application are very dynamic and will require real
word testing and feedbacks from the visually impaired users in needs for
this app to work well.
• There are requirements for immediate feedback is critical to ensure the
usability, accuracy, and accessibility of the application.
8.2 Phases of the Prototype Evolutionary Methodology
1. Requirement Gathering and Analysis
o Collection of functional and non functional requirements from
visually impaired users and advices from general app users which
will help to gather information about what to add to the application.
o Identifying of key system features which are required for the
application such as object detection, TTS integration, hardware
compatibility, and a user friendly interface with minimalistic design
easy for the users to guide themselves thorough the application.
2. Quick Design Phase
o Development of wireframes and an initial user flow which will show
us where to focus on factors like accessibility and usability.
o Preparation of a well developed application architecture for
integration of the hardware, software, and cloud systems.
3. Prototype Development (Initial Version)
o Implementation of the core features including:
▪ YOLO-based object detection.
▪ Basic text-to-speech (TTS) system.
▪ Initial integration with IoT devices and sensors.
o Ensuring that the prototype demonstrates all the important, essential
functionality without fully optimizing performance.
4. User Testing and Feedback Collection
o Conducting of testing with visually impaired users to gather insights
and feedbacks in terms of the usability and feature performance and
how comfortable the users are in guiding themselves thorough the
application.
o Collection of specific feedback on accessibility, accuracy, and user
interaction flow to ensure the application is integrated to the best of
performance modules.
5. Refinement and Iteration
o Refinement of the prototypes based on user feedback majorly
focusing on enhancement of the performance while as also to fix
bugs and provide a premium user experience.
o Add additional features or modifications requested by the visually
impaired users like improving of the TTS accuracy or better object
detection range.
o Iteration of the prototype multiple times until it fulfils the expectations
with the expected outcomes.
6. Integration of Final Features
o Integration of all the system components into one which includes of:
▪ Finalized object detection and TTS functionalities.
▪ Implementation of advanced features such as live GPS
navigation and IoT cloud connectivity.
▪ Optimization of the UI/UX for smooth and non problematic or
easy interaction with the application.
7. Testing and Validation
o Conduction of testing such as unique, integration and usability to
make sure that the system is reliable and useful or accessible.
o Performing of final level evaluations which will require of the visually
impaired users to confirm that the system meets their needs.
8. Deployment and Documentation
o Deployment of the system in a broader use form which will also
including of training the user and providing them guidelines.
o Preparation of a technical documentation which will include of
system architecture and coding details.
8.3 Benefits of the Prototype Evolutionary Model
1. Flexibility
2. User-Centric Approach
3. Risk Reduction
4. Scalability
8.4 Considered Methodology: Agile
Before finalizing on the prototype methodology the project was going to adapt
into agile methodology but later on this methodology wasn’t used because of
the vast number of reports and systems to be made and since this project
relies hugely on the user response and fast changes to be implemented and
tested it was best suited to use prototype methodology.
9. Conclusion
This project focuses on creating a practical and helpful tool for visually
impaired individuals, using object detection and recognition to make their daily
lives easier. By following the Prototype Evolutionary Model we can build and
improve the system step by step making more prototypes to ensure the final
app that comes out of it will meet the needs of the users and results to
success in the field of impact.
With clear goals, proper planning, and a user-focused approach, the project is
designed to deliver a reliable and easy-to-use solution. The final product will
not only assist visually impaired users in identifying objects around them but
also help improve their independence and quality of life.
10. References
Asana, 2024. Asana. [Online]
Available at: https://asana.com/resources/work-breakdown-structure
[Accessed 2 12 2024].
TeamGantt, n.d. teamgantt. [Online]
Available at: https://teamgantt.com/what-is-a-gantt-
chart#:~:text=A%20gantt%20chart%20is%20a%20horizontal%20bar%20chart
%20used%20in,each%20task%20in%20the%20project.
[Accessed 2 12 2024].
WHO, 2017. 1. [Online]
Available at: https://www.who.int/news-room/events/detail/2017/10/12/default-
calendar/world-sight-day-2017
[Accessed 1 December 2024].
WHO, 2017. World Sight. World Sight Day-2017, Issue 12 October, 2017, p. 1.
Wondershare Technology Group Co., Ltd., 2024. Wondershare. [Online]
Available at: https://mockitt.wondershare.com/prototyping/evolutionary-
prototyping.html
[Accessed 2 12 2024].
Wondershare Technology Group, 2024. 1. [Online]
Available at: https://mockitt.wondershare.com/prototyping/evolutionary-
prototyping.html
[Accessed 2 12 2024].
