RE: DFSClient/DistriburedFileSystem fault injection?

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

RE: DFSClient/DistriburedFileSystem fault injection?

Sergey Shelukhin
Adding the user list :)

-----Original Message-----
From: Sergey Shelukhin
Sent: Monday, February 11, 2019 3:42 PM
To: [hidden email]
Subject: DFSClient/DistriburedFileSystem fault injection?

Hi.
I've been looking for a client-side solution for fault injection in HDFS.
We had a naturally unstable HDFS cluster that helped uncover a lot of issues in HBase; now that it has been stabilized, we miss it already :)

To keep testing without actually disrupting others' use of HDFS or having to deploy a new version, I was thinking about having a client-side schema (e.g. fhdfs) map to a wrapper over the standard DFS that would inject failures and delays according to some configs, similar to https://hadoop.apache.org/docs/r2.7.2/hadoop-project-dist/hadoop-hdfs/FaultInjectFramework.html 

However I wonder if something like this exists already?

---------------------------------------------------------------------
To unsubscribe, e-mail: [hidden email]
For additional commands, e-mail: [hidden email]