Scribd
Upload
61 views18 pages

Chart N c45

The document contains details of an analysis using decision tree algorithms to classify a dataset containing information about employees. It includes a chart with attributes like gender, age, occupation, salary and level for 11 candidates. The document describes running the C4.5 and CART algorithms over multiple iterations to determine the best attributes to split or classify the data. In each iteration, different attributes like occupation, gender, and various age ranges are tested as candidate splits to minimize entropy and maximize information gain at each node of the decision tree. The algorithm with the highest information gain is selected as the optimal split for that level of the tree.

Uploaded by

white_powder
Copyright
© Attribution Non-Commercial (BY-NC)
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as DOCX, PDF, TXT or read online on Scribd
61 views18 pages

Chart N c45

The document contains details of an analysis using decision tree algorithms to classify a dataset containing information about employees. It includes a chart with attributes like gender, age, occupation, salary and level for 11 candidates. The document describes running the C4.5 and CART algorithms over multiple iterations to determine the best attributes to split or classify the data. In each iteration, different attributes like occupation, gender, and various age ranges are tested as candidate splits to minimize entropy and maximize information gain at each node of the decision tree. The algorithm with the highest information gain is selected as the optimal split for that level of the tree.

Uploaded by

white_powder
Copyright
© Attribution Non-Commercial (BY-NC)
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as DOCX, PDF, TXT or read online on Scribd

1.

CHART
Iterasi 1
Gander

Age

Female

45

Male

25

Male

33

Male

25

Female

35

Male

26

Female

45

Female

40

Male

30

Female

50

Male

25

Less than $35.000


$35.000 less than $45.000
$45.000 less than $55.000
Above $55.000

CANDIDATE SPLITE
No.

Salary
$
48.000
$
25.000
$
35.000
$
45.000
$
65.000
$
45.000
$
70.000
$
50.000
$
40.000
$
40.000
$
25.000

Level
3
1
2
3
4
3
4
3
2
2
1

Level 1
Level 2
Level3
Level 4

Left Child

1 Occupation = Service
Occupation =
2 Management
3 Occupation = Sales
4 Occupation = Staff
5 Gender = Male
6 Gender = Female
7 Age 25
8 Age 30
9 Age 33
10 Age 40

Right Child
Occupation {Management,Sales,Staff}
Occupation {Service,Sales,Staff}
Occupation {Service,Management,Staff}
Occupation {Service,Management,Sales}
Gender {Female}
Gender {Male}
Age > 25
Age > 30
Age > 33
Age > 40

11 Age 45

Splite
1

PL
0.2727

Pr
0.7273

0.3636

0.6364

0.1818

0.8182

0.5454

0.4546

0.4545

0.5455

0.2727

0.7273

0.454

0.546

0.636

0.364

0.636

0.364

10

0.727

0.273

Age >45

P(J|Pl)
0.333
0.333
0.333
0
0
0
0.5
0.5
0
0.5
0.5
0
0.5
0.5
0
0
0.33
0.33
0.33
0
0
0.2
0.4
0.4
0.667
0
0.333
0
0.4
0.2
0.4
0
0.333
0.333
0.333
0
0.25
0.25
0.375
0.125

P(J|Pr)
0.125
0.25
0.375
0.25
0.28
0.428
0.28
0
0.222
0.222
0.333
0.222
0.11
0.22
0.44
0.22
0
0.2
0.4
0.4
0.33
0.33
0.33
0
0
0.375
0.375
0.25
0
0.33
0.33
0.33
0
0.2
0.4
0.4
0
0.33
0.33
0.33

(s|t)

[Link]
0.39666942

Q (s|t)
0.58

0.231258

0.46279008

1.43

0.660864

0.29749752

0.89

0.264475

0.49587768

1.33

0.659517

0.4958595

0.93

0.461149

0.39666942

0.93

0.368903

0.495768

1.33

0.661355

0.463008

0.93

0.430597

0.463008

0.93

0.431986

0.396942

0.58

0.230226

11

0.909

0.091

0.2
0.2
0.4
0.2

0
1
0
0

0.165438

1.60

0.264701

Iterasi 2
No.

Occupation

Gander

Age

Management

Male

25

Female

35

Male

26

Female

45

P(J|Pl)

Splite
5

PL
0.5

Pr
0.5

0.5

0.5

0.25

0.75

0
0
1
0
0
0
0
1
0
0
1

Salary
$
45.000
$
65.000
$
45.000
$
70.000

Level

P(J|Pr)

[Link]
0.5

Q (s|t)
2.00

(s|t)

0.5

2.00

0.375

1.33

0.49875

0
0
0
1
0
0
1
0
0
0
0.33

3
4
3
4

0.5

0.5

0.5

0.5

10

0.75

0.25

11

0
0
0
0
1
0
0
1
0
0
0
0.66
0.33
0
0
0.5
0.5

0.66
0
0
1
0
0
0
0
1
0
0
0
1
0
0
0
0

0.5

2.00

0.5

2.00

0.375

1.33

0.49875

1.00

Iterasi 3

No.

Occupation

Gander

Age

Service

Female

45

Male

25

Male

33

Female

40

Male

30

Female

50

Male

25

Sales

9
10

Staff

11

CANDIDATE SPLITE
No.
Left Child
1
2
3
4
5
6
7
8
9
10

Occupation = Service
Occupation = Sales
Occupation = Staff
Gender = Male
Gender = Female
Age 25
Age 30
Age 33
Age 40
Age 45

Splite

PL

Pr

0.428

0.572

0.285

0.715

Salary
$
48.000
$
25.000
$
35.000
$
50.000
$
40.000
$
40.000
$
25.000

Level
3
1
2
3
2
2
1

Right Child
Occupation {Sales,Staff}
Occupation {Service,Staff}
Occupation {Service,Sales}
Gender {Female}
Gender {Male}
Age > 25
Age > 30
Age > 33
Age > 40
Age >45

P(J|Pl)
0.333
0.333
0.333
0
0
0.5
0.5

P(J|Pr)
0.25
0.5
0.25
0
0.4
0.4
0.2

(s|t)

[Link]
0.489632

Q (s|t)
0.33

0.163047

0.40755

0.80

0.32604

0.285

0.715

0.571

0.429

0.429

0.571

0.28

0.72

0.42

0.58

0.57

0.43

0.71

0.29

10

0.85

0.15

0
0.5
0.5
0
0
0.5
0.5
0
0
0
0.333
0.667
0
1
0
0
0
0.667
0.333
0
0
0.5
0.5
0
0
0.4
0.4
0.2
0
0.333
0.333
0.333
0

0
0.2
0.4
0.4
0
0
0.333
0.6
0
0
0.5
0.5
0
0
0.6
0.4
0
0
0.4
0.4
0
0
0.333
0.667
0
0
0.5
0.5
0
0
1
0
0

0.40755

0.80

0.32604

0.489918

1.27

0.620726

0.489918

0.33

0.163633

0.4032

2.00

0.8064

0.4872

1.13

0.552485

0.4902

1.33

0.653927

0.4118

0.80

0.32944

0.255

1.33

0.339915

Iterasi 4
No.

Occupation

Gander

Age

Service

Female

45

Male

33

Female

40

Male

30

Female

50

3
8

Sales

9
10

Staff

Salary
$
48.000
$
35.000
$
50.000
$
40.000
$
40.000

Level
3
2
3
2
2

CANDIDATE
SPLITE
No.

Left Child
1
2
3
4
5
6
7
8
9

Occupation = Service
Occupation = Sales
Occupation = Staff
Gender = Male
Gender = Female
Age 30
Age 33
Age 40
Age 45

Splite

PL

Pr

0.4

0.6

0.4

0.2

0.6

0.8

P(J|Pl)

P(J|Pr)

0.5

0.67

0.5

0.14

0.5

0.67

0.5

0.33

0.5

Right Child
Occupation {Sales,Staff}
Occupation {Service,Staff}
Occupation {Service,Sales}
Gender {Female}
Gender {Male}
Age > 30
Age > 33
Age > 40
Age >45

[Link]

Q (s|t)

(s|t)

0.48

0.53

0.2544

0.48

0.34

0.1632

0.32

1.00

0.32

10

11

0.4

0.6

0.2

0.4

0.6

0.71

0.6

0.4

0.8

0.6

0.4

0.29

0.5

0.333

0.67

0.333

0.667

0.5

0.5

0.5

0.5

0.67

0.5

0.33

0.5

0.5

0.5

0.48

1.34

0.64176

0.48

1.33

0.64032

0.32

1.00

0.32

0.48

1.00

0.48

0.48

0.34

0.1632

0.4118

1.00

0.4118

Iterasi 5
No.

Occupation

Gander

Age

Service

Female

45

Sales

Female

40

10

Staff

Female

50

CANDIDATE SPLITE
No.
1
2
3
5
8
9

Left Child

PL

Pr

0.33

0.67

0.33

0.67

P(J|Pl)
0
0
1
0
0

Level
3
3
2

Right Child
Occupation {Sales,Staff}
Occupation {Service,Staff}
Occupation {Service,Sales}
Gender {Male}
Age > 40
Age >45

Occupation = Service
Occupation = Sales
Occupation = Staff
Gender = Female
Age 40
Age 45

Splite

Salary
$
48.000
$
50.000
$
40.000

P(J|Pr)
0
1
0
0
0

(s|t)

[Link]
0.4422

Q (s|t)
2.00

0.8844

0.4422

2.00

0.8844

0.33

0.67

0
1
0
0
1
0
0
0
0.33
0.67
0
0
0
1
0
0
0
0
1

1
0
0
0
0
1
0
0
0.333
0.67
0
0
0.5
0.5
0
0
1
0
0

0.4422

2.00

0.8844

0.00

1.00

2.00

2. C45
Candidate Split
1
2
3
4
5
6
7

Level 1
Level 2
Level 3
Level 4

Child Notes
Occupation=Service Occupation=Management Occupation=Sales Occupation=Staff
Gender=Male Gender=Female
Age<=25
Age>25
Age<=30
Age>30
Age<=33
Age>33
Age<=40
Age>40
Age<=45
Age>45

Less than $35,000


$35,000 to less than
$45,000
$45,000 to less than
$55,000
Above $55,000

H(T)= Sigma Pj Log2(Pj)


PLevel1=2/11
PLevel2=3/11
PLevel3=4/11
PLevel4=2/11
Terdapat 11 Record dengan 4 Level
Level 1 terdapat 2 record
Level 2 Terdapat 3 record
Level 3 Terdapat 4 record
Level 4 terdapat 2 record
H(T)=1.9345

Iterasi 1
Candidate
Split
1 Occupation Splitting Candidate
Entrophy
Level 1
Level 2
Level 3
Level 4
Service
0.53
0.53
0.53
0
Managemen
0
0
0.5
0.5
Sales
0
0.5
0.5
0
Staff
0.5
0.5
0
0

1 H Occupation (T)=
IG Occupation=

0.432
1.5025

2 Gender Splitting Candidate


Entrophy
Level 1
Level 2
Level 3
Level 4
Male
0.53
0.53
0.53
0
Female
0
0.561
0.53
0.53

2 H Gender (T)=
IG Gender=

1.5993
0.3352

3 Age Splitting Candidate


Entrophy
Level 1
Level 2
Level 3
Level 4
Age<=25
0.39
0
0.528
0
0
0.531
0.531
0.5

3 H Age<=25(T)=
IG Age<=25=

1.386
0.5485

4 Entrophy
Age<=30

Level 1
Level 2
Level 3
Level 4
0.5284
0.5284
0.4642
0
0
0.4308
0.5
0.5283

4 H Age<=30(T)=
IG Age<=30=

1.48727
0.447227

5 Entrophy
Age<=33

Level 1
Level 2
Level 3
Level 4
0.528
0.5
0.4308
0
0
0
0.4422 0.52877

5 H Age<=33(T)=
IG Age<=33=

1.23715
0.69735

6 Entrophy
Age<=40

Level 1
Level 2
Level 3
Level 4
0.5
0.5306
0.5
0.375
0
0 0.389975
0.5283

6 H Age<=40(T)=
IG Age<=40=

1.6363
0.298

7 Entrophy
Age<=45

Level 1
Level 2
Level 3
Level 4
0.4643
0.5211
0.5211
0.4643
0
0
0
0

7 H Age<=45(T)=
IG Age<=45=

1.7916
0.14286

Service

Managemen

Sales

Staff

Iterasi 2 untuk record 1,2,3


Occupation Gender
Service
Female
Male
Male

Age

Salary
45 $48,000
25 $25,000
33 $35,000

H(T)=

2 Gender Splitting Candidate


Entrophy Level 1
Level 2
Level 3
Level 4
Male
0.5
0.5
0
0
Female
0
0
0
0

1.584

2 H Gender (T)=
IG Gender=

0.66
0.924

3 Age Splitting Candidate


Entrophy Level 1
Level 2
Level 3
Level 4
Age<=25
0
0
0
0
0
0.5
0.5
0

3 H Age<=25(T)=
IG Age<=25=

0.66
0.924

4 Entrophy Level 1
Level 2
Level 3
Level 4
Age<=30
0
0
0
0
0
0.5
0.5
0

4 H Age<=30(T)=
IG Age<=30=

0.66
0.924

5 Entrophy Level 1
Level 2
Level 3
Level 4
Age<=33
0.5
0.5
0
0
0
0
0
0

5 H Age<=33(T)=
IG Age<=33=

0.66
0.924

6 Entrophy Level 1
Level 2
Level 3
Level 4
Age<=40
0.5
0.5
0
0
0
0
0
0

6 H Age<=40(T)=
IG Age<=40=

0.66
0.924

7 Entrophy Level 1
Level 2
Level 3
Level 4
Age<=45
0.528
0.528
0.528
0
0
0
0
0

7 H Age<=45(T)=
IG Age<=45=

1.584
0

Iterasi 2 untuk record 4,5,6,7


Occupation
Management

Gender
Male
Female
Male
Female

Age
25
35
26
45

Salary
$45,000
$65,000
$45,000
$70,000

2 Gender Splitting Candidate


Entrophy Level 1
Level 2

H(T)=

Level 3

Level 4

2 H Gender (T)=

Male
Female

0
0

0
0

0
0

0
0

IG Gender=

3 Age Splitting Candidate


Entrophy Level 1
Level 2
Level 3
Level 4
Age<=25
0
0
0.5
0
0
0
0.5
0

3 H Age<=25(T)=
IG Age<=25=

0.125
0.875

4 Entrophy Level 1
Level 2
Level 3
Level 4
Age<=30
0
0
0
0
0
0
0
0

4 H Age<=30(T)=
IG Age<=30=

0
1

5 Entrophy Level 1
Level 2
Level 3
Level 4
Age<=33
0
0
0
0
0
0
0
0

5 H Age<=33(T)=
IG Age<=33=

0
1

6 Entrophy Level 1
Level 2
Level 3
Level 4
Age<=40
0
0
0
0.5
0
0
0
0.5

6 H Age<=40(T)=
IG Age<=40=

0.5
0.5

7 Entrophy Level 1
Level 2
Level 3
Level 4
Age<=45
0
0
0
0
0
0
0
0

7 H Age<=45(T)=
IG Age<=45=

0
1

Iterasi 2 untuk record 8,9


Occupation Gender
Sales
Female
Male

Age

Salary
40 $50,000
30 $40,000

H(T)=1

2 Gender Splitting Candidate


Entrophy Level 1
Level 2
Level 3
Level 4
Male
0
0
0
0
Female
0
0
0
0

3 Age Splitting Candidate


Entrophy Level 1
Level 2
Level 3
Level 4
Age<=25
0
0
0
0
0
0.5
0.5
0
4 Entrophy Level 1
Level 2
Level 3
Level 4
Age<=30
0
0.5
0
0

2 H Gender (T)= 0
IG Gender=1-0=1

H Age<=25(T)=0+1(0.5+0.5)=
3 1
IG Age<=25=1-1=0

4 H Age<=30(T)=0.5(0.5)+0.5(0.5)=0.5
IG Age<=30=1-0.5=0.5

0.5

5 Entrophy Level 1
Level 2
Level 3
Level 4
Age<=33
0
0.5
0.5
0
0
0
0
0

5 H Age<=33(T)=0.5+0.5=1
IG Age<=33=1-1=0

6 Entrophy Level 1
Level 2
Level 3
Level 4
Age<=40
0
0.5
0.5
0
0
0
0
0

6 H Age<=40(T)=
IG Age<=40=

7 Entrophy Level 1
Level 2
Level 3
Level 4
Age<=45
0
0.5
0.5
0
0
0
0
0

7 H Age<=45(T)=
IG Age<=45=

Iterasi 2 untuk record 10,11


Occupation Gender
Staff
Female
Male

Age

Salary
50 $40,000
25 $25,000

2 Gender Splitting Candidate


Entrophy Level 1
Level 2
Level 3
Level 4
Male
0
0
0
0
Female
0
0
0
0

3 Age Splitting Candidate


Entrophy Level 1
Level 2
Level 3
Level 4
Age<=25
0
0
0
0
0
0
0
0

H(T)=1

2 H Gender (T)=0
IG Gender=1-0=1

H
3 Age<=25(T)=0.5(0)+0.5(0)=0
IG Age<=25=1-0=1

4 Entrophy Level 1
Level 2
Level 3
Level 4
Age<=30
0
0
0
0
0
0
0
0

4 H Age<=30(T)=0
IG Age<=30=1

5 Entrophy Level 1
Level 2
Level 3
Level 4
Age<=33
0
0
0
0
0
0
0
0

5 H Age<=33(T)=0
IG Age<=33=1

6 Entrophy Level 1
Level 2
Level 3
Level 4
Age<=40
0
0
0
0
0
0
0
0

6 H Age<=40(T)=0
IG Age<=40=1

7 Entrophy Level 1
Level 2
Level 3
Level 4
Age<=45
0
0
0
0
0
0
0
0

7 H Age<=45(T)=0
IG Age<=45=1

Root Node
Occupation

1,2,3

2,3

5,7

10,11

8,9

4,5,6,7

4,6

10

11

Iterasi 3 untuk record 2,3


Occupation Gender
Service
Male
Male

Age
25
33

Salary
$25,000
$35,000

H(T)=1

2 Gender Splitting Candidate


Entrophy Level 1
Level 2
Level 3
Level 4
Male
0.5
0.5
0
0
Female
0
0
0
0

2 H Gender (T)=
IG Gender=

0
0

3 Age Splitting Candidate


Entrophy Level 1
Level 2
Level 3
Level 4
Age<=25
0
0
0
0
0
0
0
0

3 H Age<=25(T)=
IG Age<=25=

0
1

4 Entrophy Level 1
Level 2
Level 3
Level 4
Age<=30
0
0
0
0
0
0
0
0

4 H Age<=30(T)=
IG Age<=30=

0
0

5 Entrophy Level 1
Level 2
Level 3
Level 4
Age<=33
0.5
0.5
0
0
0
0
0
0

5 H Age<=33(T)=
IG Age<=33=

0
0

6 Entrophy Level 1
Level 2
Level 3
Level 4
Age<=40
0.5
0.5
0
0
0
0
0
0

6 H Age<=40(T)=
IG Age<=40=

0
0

7 Entrophy Level 1
Level 2
Level 3
Level 4
Age<=45
0.5
0.5
0
0
0
0
0
0

7 H Age<=45(T)=
IG Age<=45=

0
0

Root Node
Occupation

1,2,3

2,3

5,7

10,11

8,9

4,5,6,7

4,6

10

11

TUGAS II
Data Mining
Chart dan C45

Oleh:

Ria Kurnianti

(0810963065)

ROGRAM STUDI ILMU KOMPUTER


JURUSAN MATEMATIKA FAKULTAS MIPA
UNIVERSITAS BRAWIJAYA
MALANG
2011

You might also like