Score:0

Enable read-only HDFS filesystem in hostile cluster

gh flag

Scenario

A company's platform team maintains Spark clusters for data science teams to perform big data analysis on their data. The cluster comes with a pre-configured file system that allows read/write access. The platform team now want to allow user teams to plug-in their own HDFS file systems on the condition that they are read-only.

The platform team has single control over cluster configurations. Data Science teams can only submit Spark jobs.

Risk

A malicious or careless user may actually grant the cluster read/write access to their private storage and therefore allow data to be exfiltrated.

Question

Does HDFS have any configuration on core-site or somewhere else that allows the platform team to enforce which file systems are writable and which ones are read-only?

mangohost

Post an answer

Most people don’t grasp that asking a lot of questions unlocks learning and improves interpersonal bonding. In Alison’s studies, for example, though people could accurately recall how many questions had been asked in their conversations, they didn’t intuit the link between questions and liking. Across four studies, in which participants were engaged in conversations themselves or read transcripts of others’ conversations, people tended not to realize that question asking would influence—or had influenced—the level of amity between the conversationalists.