一点一滴

“大数据”

大数据-分类

hive join优化

https://blog.csdn.net/myproudcodelife/article/details/45378957 hive优化实践https://www.cnblogs.com/ju...

spark报错

19/03/31 17:37:15 WARN TaskSetManager: Lost task 672.0 in stage 12.0 (TID 12473, hadoop2709.jd.16...

kill job 报错

hadoop_portal@bjdw-portal-client1:~$ hadoop job -kill job_1552892484595_325531DEPRECATED: Use of ...

Hive优化

https://blog.csdn.net/maizi1045/article/details/53142975一、map阶段优化map端: spill(100M,80%)-->mege...

hadoop 动态调整mapred参数

bin/hadoop job -set-reduce-capacity job_20151126032920_1142443 1000 调成map数bin/hadoop job -...