CLI hang in HDFS shutdown hook

Description

I can reproduce this consistently by running

after launching that command, the shell becomes frozen for over a minute, not even responding to Ctrl-C. Looking at the jstack, it seems like the metrics heartbeat is to blame. We need to set a short time limit on the final heartbeat (e.g. 500ms), and ideally also make it interruptible.

Environment

None

Activity

Show:
Bin Fan
September 17, 2018, 4:45 PM

why this affects 1.8.0? do you mean 1.9.0-SNAPSHOT?

Andrew Audibert
September 17, 2018, 5:19 PM

The issue is the metrics final heartbeat, which was added in 1.8.0. If alluxio or zookeeper are not running, or the connect details are incorrect the hdfs shell performs retries and does not respond to Ctrl-C

Bin Fan
September 17, 2018, 5:30 PM

thanks for the explanation. we should resolve this for 1.8.1 release

Assignee

Unassigned

Reporter

Andrew Audibert

Labels

None

Components

Affects versions

Priority

Blocker
Configure