寻找最影响预测结果的特征

最新推荐文章于 2021-02-09 10:27:38 发布

聪少少灬

最新推荐文章于 2021-02-09 10:27:38 发布

阅读量513

点赞数

CC 4.0 BY-SA版权

分类专栏：机器学习数据分析 Python 文章标签：深度学习数据挖掘机器学习

本文链接：https://blog.csdn.net/sGDUTBMW/article/details/110929266

Python 同时被 3 个专栏收录

52 篇文章

订阅专栏

数据分析

11 篇文章

订阅专栏

机器学习

6 篇文章

订阅专栏

导入相关的包

import pandas as pd
import numpy as np

# 特征最影响结果的K个特征
from sklearn.feature_selection import SelectKBest

# 卡方检验，作为SelectKBest的参数
from sklearn.feature_selection import chi2

导入数据

df = pd.read_csv("./datas/titanic/titanic_train.csv")
df = df[["PassengerId", "Survived", "Pclass", "Sex", "Age", "SibSp", "Parch", "Fare", "Embarked"]].copy()
df.head()

数据清理和转换

# 查看是否有空值列
df.info()
# 给Age列填充平均值
df["Age"] = df["Age"].fillna(df["Age"].median())
# 将性别列变成数字
df.Sex.unique()
df.loc[df["Sex"] == "male", "Sex"] = 0
df.loc[df["Sex"] == "female", "Sex"] = 1
# 给Embarked列填充空值，字符串转换成数字
# Embarked
df.Embarked.unique()
# 填充空值
df["Embarked"] = df["Embarked"].fillna(0)
# 字符串变成数字
df.loc[df["Embarked"] == "S", "Embarked"] = 1
df.loc[df["Embarked"] == "C", "Embarked"] = 2
df.loc[df["Embarked"] == "Q", "Embarked"] = 3
df.head()

将特征列和结果列拆分开

y = df.pop("Survived")
X = df
X.head()
y.head()

使用卡方检验选择topK的特征

# 选择所有的特征，目的是看到特征重要性排序
bestfeatures = SelectKBest(score_func=chi2, k=len(X.columns))
fit = bestfeatures.fit(X, y)

按照重要性顺序打印特征列表

df_scores = pd.DataFrame(fit.scores_)
df_scores
df_columns = pd.DataFrame(X.columns)
df_columns
# 合并两个df
df_feature_scores = pd.concat([df_columns,df_scores],axis=1)
# 列名
df_feature_scores.columns = ['feature_name','Score']  #naming the dataframe columns

# 排序后查看
df_feature_scores.sort_values(by="Score", ascending=False)
df_feature_scores