Introduction to Oracle Grid Engine

Introduction to Oracle Grid Engine

• 1.
  Oracle Grid Engine Introductionto By: Morteza Zakeri School of Computer Engineering Iran University of Science and Technology Winter 2017
• 2.
  Contents at aGlance • Introduction • Features • History • Architecture • Basics • Scheduler • Consultation 3/5/2017 Oracle Grid Engine - M.Zakeri 2 of 18
• 3.
  Introduction • Oracle GridEngine, previously known as Sun Grid Engine is: • A grid computing computer cluster software system • CODINE (Computing in Distributed Networked Environments) or GRD (Global Resource Director). • Typically used on: • A computer farm or high-performance computing (HPC) cluster. 3/5/2017 Oracle Grid Engine - M.Zakeri 3 of 18
• 4.
  Introduction • Responsible for: •accepting, scheduling, dispatching, and managing the remote and distributed execution of large numbers of standalone, parallel or interactive user jobs. • manages and schedules the allocation of distributed resources such as processors, memory, disk space, etc. 3/5/2017 Oracle Grid Engine - M.Zakeri 4 of 18
• 5.
  Features 3/5/2017 Oracle GridEngine - M.Zakeri 5 of 18 • Advance reservation • Array job interdependencies • Rule-based Resource Quota control • Enhanced remote execution • Multi-clustering • Daemons managed by the Service Management Facility on Solaris • Job Submission Verifier (client-side and server-side job verification) • GUI Installer and SGE Inspect
• 6.
  Features 3/5/2017 Oracle GridEngine - M.Zakeri 6 of 18 A screenshot of the xml-qstat web interface
• 7.
  History • In 2000,Sun acquired Gridware, Inc. a privately owned commercial vendor of advanced computing resource management software. • Later that year, Sun offered a free version of Gridware for Solaris and Linux, and renamed the product Sun Grid Engine. • In 2001, Sun made the source code available. • In 2010, after the purchase of Sun by Oracle. 3/5/2017 Oracle Grid Engine - M.Zakeri 7 of 18
• 8.
  Grid Engine ComponentArchitecture 3/5/2017 Oracle Grid Engine - M.Zakeri 8 of 18
• 9.
  Grid Engine Basicsand Concepts • Jobs • Batch job • Parametric job • Parallel job • Interactive job • Queues • Host Groups • Resources 3/5/2017 Oracle Grid Engine - M.Zakeri 9 of 18
• 10.
  Grid Engine Basicsand Concepts 3/5/2017 Oracle Grid Engine - M.Zakeri 10 of 18
• 11.
  Grid Engine Scheduler •At the heart of a Sun Grid Engine cluster is the scheduler. • It is responsible for prioritizing pending jobs and deciding which jobs to schedule to which resources. • Job Selection • The first stage of the scheduling process, in which every job in the pending job list is assigned a priority, and the entire list of sorted according to priority order. • Job Scheduling • The second step of the scheduling process is the actual job scheduling, or assignment of a job to a set of free resources. 3/5/2017 Oracle Grid Engine - M.Zakeri 11 of 18
• 12.
  Grid Engine Scheduler:Job Selection 1. Ticket Policies I. Share Tree Policy II. Functional Ticket Policy III. Override Ticket Policy 2. Urgency Policies I. Wait Time Policy II. Deadline Policy III. Resource Urgency Policy 3. Custom Policy 3/5/2017 Oracle Grid Engine - M.Zakeri 12 of 18
• 13.
  Grid Engine Scheduler:Job Selection 3/5/2017 Oracle Grid Engine - M.Zakeri 13 of 18
• 14.
  Grid Engine Scheduler:Job Selection 3/5/2017 Oracle Grid Engine - M.Zakeri 14 of 18
• 15.
  Grid Engine Scheduler:Job Scheduling 1. The list of queue instances is filtered according to hard resource requests. 2. The remaining list of queue instances is sorted according to soft resource requests. 3. The top tier of the sorted list of queue instances from the previous step is further sorted according to queue sequence number. 4. The top tier of the sorted list of queue instances from the previous step is further sorted according to the host load. 3/5/2017 Oracle Grid Engine - M.Zakeri 15 of 18
• 16.
  Grid Engine Scheduler:Scheduling Features • Resource Quota Sets • Resource Reservation • Advance Reservation 3/5/2017 Oracle Grid Engine - M.Zakeri 16 of 18
• 17.
  Consultation • Job schedulingwith the Sun Grid Engine software is a very large topic. • The Sun Grid Engine software provides a wide variety of scheduling policies with a great degree of flexibility. • What is presented above only scratches the surface of what can be done with the Sun Grid Engine 6.2 software. 3/5/2017 Oracle Grid Engine - M.Zakeri 17 of 18
• 18.
  References • BEGINNER'S GUIDETO SUN™ GRID ENGINE 6.2, Installation and Configuration, White Paper September 2008. • Oracle Grid Engine page on Wikipedia, the free encyclopedia, available at https://en.wikipedia.org/wiki/Oracle_Grid_Engine 3/5/2017 Oracle Grid Engine - M.Zakeri 18 of 18