This is the official repository for paper "SkyEyeGPT: Unifying Remote Sensing Vision-Language Tasks via Instruction Tuning with Large Language Model". [paper] [SkyEye-968k]

This is an ongoing project. We will be working on improving it.

• 📦 Chatbot, codebase, and model inference tutorial coming soon! 🚀
• May-13-2025: SkyEyeGPT model checkpoint is released. [huggingface] 🔥🔥 （The Model Weight can be run directly with MiniGPT-v2）
• Jan-19-2025: SkyEyeGPT paper is accepted by ISPRS. [paper] 🔥🔥
• Jun-12-2024: RS instruction dataset SkyEye-968k is released. [huggingface] 🔥🔥
• Jan-18-2024: paper is released. 🔥🔥
• Jan-17-2024: A curated list about remote sensing multimodal large language model (Vision-Language) is created. 🔥🔥

The online demo will be released.

We release the model weight in [huggingface]! The Model Weight can be run directly with MiniGPT-v2

The model and checkpoint are coming soon! 🚀

The download link of the unified remote sensing vision-language instruction dataset is here! 🚀

Download link: https://huggingface.co/datasets/ZhanYang-nwpu/SkyEye-968k

@ARTICLE{zhan2025skyeyegpt,
      title={SkyEyeGPT: Unifying Remote Sensing Vision-Language Tasks via Instruction Tuning with Large Language Model}, 
      author={Yang Zhan and Zhitong Xiong and Yuan Yuan},
      year={2025},
      journal={ISPRS Journal of Photogrammetry and Remote Sensing},
      volume = {221},
      pages = {64-77}
}

Our code is based on MiniGPT-4, shikra, and MiniGPT-v2. We sincerely appreciate their contributions and authors for releasing source codes. We are thankful to EVA and LLaMA2 for releasing their models as open-source contributions. I would like to thank Xiong zhitong and Yuan yuan for helping the manuscript. I also thank the School of Artificial Intelligence, OPtics, and ElectroNics (iOPEN), Northwestern Polytechnical University for supporting this work.

If you have any questions about this project, please feel free to contact [email protected].