- yarn参数设置
- 参考资料
- https://blog.csdn.net/chenjunshi123/article/details/122456706?spm=1001.2101.3001.6650.1&utm_medium=distribute.pc_relevant.none-task-blog-2%7Edefault%7EBlogCommendFromBaidu%7ERate-1-122456706-blog-122004078.235%5Ev43%5Epc_blog_bottom_relevance_base3&depth_1-utm_source=distribute.pc_relevant.none-task-blog-2%7Edefault%7EBlogCommendFromBaidu%7ERate-1-122456706-blog-122004078.235%5Ev43%5Epc_blog_bottom_relevance_base3&utm_relevant_index=2
- https://blog.csdn.net/qq_43688472/article/details/92796141?spm=1001.2101.3001.6650.2&utm_medium=distribute.pc_relevant.none-task-blog-2%7Edefault%7EBlogCommendFromBaidu%7ERate-2-92796141-blog-122456706.235%5Ev43%5Epc_blog_bottom_relevance_base3&depth_1-utm_source=distribute.pc_relevant.none-task-blog-2%7Edefault%7EBlogCommendFromBaidu%7ERate-2-92796141-blog-122456706.235%5Ev43%5Epc_blog_bottom_relevance_base3&utm_relevant_index=3
- 关于yarn的参数设置：
- 方案1：
- python yarn-utils.py -c 32 -m 128 -d 7 -k False 每台机器32核128G挂载了7块磁盘。通过yarn-utils.py自动计算返回合适的yarn参数配置值
- 方案2：
- 关于 内存 相关的配置可以参考hortonwork公司的文档 Determine HDP Memory Configuration Settings 来配置你的集群
- https://blog.csdn.net/weixin_43214644/article/details/126839064
- https://docs.cloudera.com/HDPDocuments/HDP2/HDP-2.4.3/bk_installing_manually_book/content/determine-hdp-memory-config.html#ref-cb07873e-edba-4c77-bd34-edbcefcbfc16
- https://docs.cloudera.com/HDPDocuments/HDP2/HDP-2.1.1/bk_installing_manually_book/content/rpm-chap1-9.html
作者 admin
张宴银，大数据开发工程师