用于HDP2沙箱的Tez开发设置
To set up hive-tez on an HDP2 Sandbox VM, log in as root and in this repo, do
# make dist install
That should pull tez, hive-tez, build it and install it locally in ./dist/hive.
Starting LLAP, requires you to have a working install of Apache Slider and a Zookeeper instance used by the YARN registry for co-ordination between nodes.
edit slider-gen.sh to fix your JAVA_HOME, pick your Xmx, container and cache sizing (basic rule = container size > (Xmx + cache)).
Run
# ./slider-gen.sh
it generates a run.sh script in the local dir with the configuration for running (including date).
./llap-yarn-<date>/run.sh
Confirm application is running with
yarn top
Alternatively, hive llap status tool can be used to check if all nodes are running llap daemons
./dist/hive/bin/hive --service llapstatus -w
If that fails to startup, check whether you have JDK8 in the right location specified in JAVA_HOME.
Finally, to test this out, you can do
# ./dist/hive/bin/beeline -u jdbc://localhost:<port>/beeline> select count(1) from sample_07;
and it should use LLAP. Switch in and out with hive.llap.execution.mode, the execution will switch between container and llap.
And for anything you want to override in local settings (like HIVE_CONF_DIR), create a file named local.mk and add the Makefile variables to that file.