创新点
1.支付宝沙箱支付
2.支付邮箱通知(JavaMail)
3.短信验证码修改密码
4.知识图谱
5.四种推荐算法(协同过滤基于用户、物品、SVD混合神经网络、MLP深度学习模型)
6.线性回归算法预测房价
7.Python爬虫采集大众点评美食数据
8.AI短信识别
9.百度地图API
10.lstm情感分析
11.spark大屏可视化
开发技术
springboot vue.js python echarts spark mysql element-ui
代码实现
爬虫代码实现如下:
create external table ods_yaodian_begin(
`name` string COMMENT '店名',
`service_score` DOUBLE COMMENT '服务评分',
`delivery_score` DOUBLE COMMENT '发货评分',
`logistics_score` DOUBLE COMMENT '物流评分',
`packaging_score` DOUBLE COMMENT '包装评分',
`score` DOUBLE COMMENT '总评',
`chargeback` string COMMENT '退单率',
`delivery_time` DOUBLE COMMENT '发货时长',
`opening_hours` string COMMENT '营业时间',
`store_address` string COMMENT '商铺地址',
`join_date` string COMMENT '入驻时间'
)
row format delimited fields terminated by ','
location '/yaodain/ods/';
select * from ods_yaodian_begin limit 2;
数据分析实现代码如下:
## 启动hadoop
/data/hadoop/sbin
start-all.sh
## 启动hive
cd /data/hive
nohup hive --service metastore &
nohup hive --service hiveserver2 &
hadoop fs -mkdir -p /yiyuan/data
hadoop fs -mkdir -p /yiyuan/specialized_in
hadoop fs -mkdir -p /yiyuan/equipment
hadoop fs -put /data/yiyuan/part-r-00000 /yiyuan/data
hadoop fs -put /data/yiyuan/specialized_in.csv /yiyuan/specialized_in
hadoop fs -put /data/yiyuan/equipment.csv /yiyuan/equipment
运行截图