Score:0

hdfs + why not remove the corrupted blocks by automatic approach as cron job

gb flag

we have Hadoop cluster with 376 data-node machines ( based on HDP version - 2.6.4 )

from time to time we can see XX number of corrupted blocks

and to fix it we are performing the following:

su hdfs
hdfs fsck / -delete

since this happened from time to time

we are thinking to perform the hdfs fsck / -delete by Cron job , for example cron job can run every 00:00 , and delete the corrupted blocks

but the Question is - what are the risks when doing this?

mangohost

Post an answer

Most people don’t grasp that asking a lot of questions unlocks learning and improves interpersonal bonding. In Alison’s studies, for example, though people could accurately recall how many questions had been asked in their conversations, they didn’t intuit the link between questions and liking. Across four studies, in which participants were engaged in conversations themselves or read transcripts of others’ conversations, people tended not to realize that question asking would influence—or had influenced—the level of amity between the conversationalists.