CLI hang in HDFS shutdown hook
Description
I can reproduce this consistently by running
after launching that command, the shell becomes frozen for over a minute, not even responding to Ctrl-C. Looking at the jstack, it seems like the metrics heartbeat is to blame. We need to set a short time limit on the final heartbeat (e.g. 500ms), and ideally also make it interruptible.
Environment
None
Activity
Show:
Bin Fan
September 17, 2018, 4:45 PM
why this affects 1.8.0? do you mean 1.9.0-SNAPSHOT?
Andrew Audibert
September 17, 2018, 5:19 PM
The issue is the metrics final heartbeat, which was added in 1.8.0. If alluxio or zookeeper are not running, or the connect details are incorrect the hdfs shell performs retries and does not respond to Ctrl-C
Bin Fan
September 17, 2018, 5:30 PM
thanks for the explanation. we should resolve this for 1.8.1 release
Assignee
Unassigned
Reporter
Andrew Audibert
Labels
None
Components
Affects versions
Priority
Configure