Fix journaling in createFile and createDirectory in AlluxioFileSystemMaster

Description

In createDirectory and createFile, journaling happens only when the creation succeeds, so if only a part of the paths are created/persisted successfully, the changed states will not be journaled, and inconsistency will occur after restarting the master.

Environment

None

Activity

Show:
Cheng Chang
October 31, 2017, 7:50 AM

What's your thought on this?

Andrew Audibert
November 1, 2017, 10:03 PM

Alluxio journaling only addresses Alluxio metadata consistency. There are no guarantees about consistency between the Alluxio and the UFS; if the master is killed mid-operation between UFS modification and journal write, Alluxio<->UFS inconsistency is possible. To address this, we would need to implement a transaction/rollback mechanism.

Assignee

Gene Pang

Reporter

Cheng Chang

Labels

Components

Affects versions

Priority

Major
Configure