Apache Hadoop: What is that & how to install and use it? (Part 2)

Part 2: How to install a standalone Hadoop

Now, we are going to install a standalone Hadoop. The easiest way is to use VM sandbox provided by vendors such as Hortonworks/Cloudera and MapR. However, since the sandbox has many components (not only Hadoop, but also HBase, Spark, Hive, Oozie, etc.), it requires substantial resources (4 CPUs, at least 8 GB RAMs, and at least 20 GB free space) to run. Moreover, the sandbox is created for testing/trial purposes. It is not recommended to use it for production use, but better to install Hadoop directly on the native OS.

However, I do not have an idle server to try. As a proof-of-concept, I install it using a VM running Centos 7 to represent a physical server in a real-life scenario. Centos 7, which is used in many enterprise premises, could be replaced with any OS you want such as other Linux variants (Ubuntu/Debian, SunOS, etc.), Windows, and MacOS.

Installing a standalone Hadoop could be done in two ways, i.e.,
1. using the binary installation file. It is the easiest way and from my experience, the installed Hadoop runs perfectly all the times, with or without root (or sudo) access, in the machine. Regularly, Hadoop developer team pre-built latest stable version of Hadoop.
2. building from the source installation file. It is appropriate if you would like to test the current development and look for a resolved feature that has not yet included in the stable version.
For the sake of simplicity, I will cover installing a standalone Hadoop from the binary installation file (maybe I will discuss building from the source in another article, but for now it is sufficient).

Here are the sequential steps.
1) Download the binary file from Hadoop website (https://hadoop.apache.org/releases.html). Select the mirrored site nearest to our location. The latest stable version is 3.2.0 which will be used in this article.

cd ~
wget http://ftp.tudelft.nl/apache/hadoop/common/stable/hadoop-3.2.0.tar.gz

2) Extract the file, change the name to a familiar one, and perhaps move to a regular location (if you have sudo access). I use the worst case (no sudo access), but if so, you can easily move the folder to a regular application location such as /opt or /usr/local.

tar -xvzf hadoop-3.2.0.tar.gz
mv hadoop-3.2.0 hadoop

3) Update the configuration of the Hadoop cluster. There are two types of configuration files, i.e., .xml and .sh extension. .sh is the file when we would like to set environment variables for the entire cluster, whereas .xml is the file that contains the configuration of nodes (HDFS, YARN, and MapReduce). .xml files include core-site.xml, hdfs-site.xml, mapred-site.xml and yarn-site.xml. We need to put the following lines below between <configuration> and </configuration>) in the corresponding file. Note that the configuration files are stored in $HADOOP_CONF_DIR.

  • $HADOOP_CONF_DIR/core-site.xml. We add file system default name.
<property>
  <name>fs.defaultFS</name>
  <value>hdfs://localhost:9000</value>
</property>
  • $HADOOP_CONF_DIR/hdfs-site.xml. We add the replication factor and permission setting in the configuration.
<property>
  <name>dfs.replication</name>
  <value>1</value>
</property>
<property>
  <name>dfs.permission</name>
  <value>false</value>
</property>
  • $HADOOP_CONF_DIR/mapred-site.xml. If you don’t find any, create the file from the template by executing: cp $HADOOP_CONF_DIR/mapred-site.xml.template HADOOP_CONF_DIR/mapred-site.xml. We configure that MapReduce job will be managed by YARN.
<property>
  <name>mapreduce.framework.name</name>
  <value>yarn</value>
</property>
<property>
  <name>yarn.app.mapreduce.am.env</name>
  <value>HADOOP_MAPRED_HOME=/user/osboxes/hadoop</value>
</property>
<property>
  <name>mapreduce.map.env</name>
  <value>HADOOP_MAPRED_HOME=/user/osboxes/hadoop</value>
</property>
<property>
  <name>mapreduce.reduce.env</name>
  <value>HADOOP_MAPRED_HOME=/user/osboxes/hadoop</value>
</property>
  • $HADOOP_CONF_DIR/yarn-site.xml. We configure YARN to shuffle MapReduce task and the associated shuffle class.
<property>
  <name>yarn.nodemanager.aux-services</name>
  <value>mapreduce_shuffle</value>
</property>
<property>
  <name>yarn.nodemanager.auxservices.mapreduce.shuffle.class</name>
  <value>org.apache.hadoop.mapred.ShuffleHandler</value>
</property>

4) Java is required. Hadoop 3.X needs Java 8 to be installed in the machine. Installing Java requires sudo access. If you don’t have one, contact your system administrator. The following command should be run with sudo privilege.

sudo yum install -y java-1.8.0-openjdk-1.8.0.212.b04-0.el7_6 java-1.8.0-openjdk-devel-1.8.0.212.b04-0.el7_6

5) Set the required environment variables in the system, i.e., JAVA_HOME, HADOOP_HOME, HADOOP_CONF, YARN_CONF, PATH. To keep the variables permanent, we put them in the ~/.bashrc, so every time we log in the variables are automatically loaded.

export JAVA_HOME="/usr/lib/jvm/java"
export HADOOP_HOME="/home/osboxes/hadoop"
export HADOOP_CONF_DIR=$HADOOP_HOME/etc/hadoop
export YARN_CONF_DIR=$HADOOP_HOME/etc/hadoop
export PATH=$HADOOP_HOME/bin:$HADOOP_HOME/sbin:$PATH

6) In order Hadoop understands where Java resides, we should mention the location of JAVA_HOME in $HADOOP_CONF_DIR/hadoop-env.sh.

export JAVA_HOME="/usr/lib/jvm/java"

7) The Hadoop components need ssh-less environment to communicate each other. First, we need to create RSA key by command ssh-keygen. Leave everything to the default values. After copy the new key to authorized_keys by command ssh-copy-id [user]@localhost. Verify that we can log in the machine without inputting a password by command ssh localhost.

ssh-keygen
ssh-copy-id osboxes@localhost

8) Format the namenode by the following command.

hdfs namenode -format
The messages indicate namenode is successfully formatted

9) Now we can start HDFS & YARN daemons (background processes) by executing the following commands.

start-dfs.sh
start-yarn.sh
Starting Hadoop daemons: HDFS & YARN

Make sure that all daemons are running, i.e., namenode, secondary name node, datanode, nodemanager, and resourcemanager. If either namenode or datanode is not running, restart the HDFS daemons by stop first stop-dfs.sh and start again start-dfs.sh. If one of YARN processes is not running, either nodemanager or resourcemanager, restart YARN (stop-yarn.sh followed by start-yarn.sh).

All required java processes are running

10) Let us test whether Hadoop works properly. We will cover operation of Hadoop in detail later on.

First, create a new directory on HDFS and put some files to that directory by executing the following command.

hdfs dfs -mkdir -p /user/hadoop/input
hdfs dfs -put $HADOOP_HOME/LICENSE.txt /user/hadoop/input/

Now, try to run a MapReduce program from the example, i.e., wordcount.

hadoop jar $HADOOP_HOME/share/hadoop/mapreduce/hadoop-mapreduce-examples-3.2.0.jar wordcount /user/hadoop/input /user/hadoop/output
Successful operation of a MapReduce program

Read the output of the program directly from HDFS by executing the following command.

hdfs dfs -ls /user/hadoop/output/
hdfs dfs -cat /user/hadoop/output/part*
The result of the MapReduce program

Other configuration

The above configuration is enough to deploy a standalone Hadoop. However, there are many parameters to configure Hadoop that you might be interested in. We list all the parameters in the following list.

core-site.xml (https://hadoop.apache.org/docs/r3.2.0/hadoop-project-dist/hadoop-common/core-default.xml)

hadoop.common.configuration.version
hadoop.tmp.dir
hadoop.http.filter.initializers
hadoop.security.authorization
hadoop.security.instrumentation.requires.admin
hadoop.security.authentication
hadoop.security.group.mapping
hadoop.security.dns.interface
hadoop.security.dns.nameserver
hadoop.security.dns.log-slow-lookups.enabled
hadoop.security.dns.log-slow-lookups.threshold.ms
hadoop.security.groups.cache.secs
hadoop.security.groups.negative-cache.secs
hadoop.security.groups.cache.warn.after.ms
hadoop.security.groups.cache.background.reload
hadoop.security.groups.cache.background.reload.threads
hadoop.security.groups.shell.command.timeout
hadoop.security.group.mapping.ldap.connection.timeout.ms
hadoop.security.group.mapping.ldap.read.timeout.ms
hadoop.security.group.mapping.ldap.url
hadoop.security.group.mapping.ldap.ssl
hadoop.security.group.mapping.ldap.ssl.keystore
hadoop.security.group.mapping.ldap.ssl.keystore.password.file
hadoop.security.group.mapping.ldap.ssl.keystore.password
hadoop.security.group.mapping.ldap.conversion.rule
hadoop.security.credential.clear-text-fallback
hadoop.security.credential.provider.path
hadoop.security.credstore.java-keystore-provider.password-file
hadoop.security.group.mapping.ldap.ssl.truststore
hadoop.security.group.mapping.ldap.ssl.truststore.password.file
hadoop.security.group.mapping.ldap.bind.user
hadoop.security.group.mapping.ldap.bind.password.file
hadoop.security.group.mapping.ldap.bind.password
hadoop.security.group.mapping.ldap.base
hadoop.security.group.mapping.ldap.userbase
hadoop.security.group.mapping.ldap.groupbase
hadoop.security.group.mapping.ldap.search.filter.user
hadoop.security.group.mapping.ldap.search.filter.group
hadoop.security.group.mapping.ldap.search.attr.memberof
hadoop.security.group.mapping.ldap.search.attr.member
hadoop.security.group.mapping.ldap.search.attr.group.name
hadoop.security.group.mapping.ldap.search.group.hierarchy.levels
hadoop.security.group.mapping.ldap.posix.attr.uid.name
hadoop.security.group.mapping.ldap.posix.attr.gid.name
hadoop.security.group.mapping.ldap.directory.search.timeout
hadoop.security.group.mapping.providers
hadoop.security.group.mapping.providers.combined
hadoop.security.service.user.name.key
fs.azure.user.agent.prefix
hadoop.security.uid.cache.secs
hadoop.service.shutdown.timeout
hadoop.rpc.protection
hadoop.security.saslproperties.resolver.class
hadoop.security.sensitive-config-keys
hadoop.workaround.non.threadsafe.getpwuid
hadoop.kerberos.kinit.command
hadoop.kerberos.min.seconds.before.relogin
hadoop.security.auth_to_local
hadoop.security.auth_to_local.mechanism
hadoop.token.files
io.file.buffer.size
io.bytes.per.checksum
io.skip.checksum.errors
io.compression.codecs
io.compression.codec.bzip2.library
io.serializations
io.seqfile.local.dir
io.map.index.skip
io.map.index.interval
io.erasurecode.codec.rs.rawcoders
io.erasurecode.codec.rs-legacy.rawcoders
io.erasurecode.codec.xor.rawcoders
fs.defaultFS
fs.default.name
fs.trash.interval
fs.trash.checkpoint.interval
fs.protected.directories
fs.AbstractFileSystem.file.impl
fs.AbstractFileSystem.har.impl
fs.AbstractFileSystem.hdfs.impl
fs.AbstractFileSystem.viewfs.impl
fs.viewfs.rename.strategy
fs.AbstractFileSystem.ftp.impl
fs.ftp.impl
fs.AbstractFileSystem.webhdfs.impl
fs.AbstractFileSystem.swebhdfs.impl
fs.ftp.host
fs.ftp.host.port
fs.ftp.data.connection.mode
fs.ftp.transfer.mode
fs.df.interval
fs.du.interval
fs.swift.impl
fs.automatic.close
fs.s3a.access.key
fs.s3a.secret.key
fs.s3a.aws.credentials.provider
fs.s3a.session.token
fs.s3a.security.credential.provider.path
fs.s3a.assumed.role.arn
fs.s3a.assumed.role.session.name
fs.s3a.assumed.role.policy
fs.s3a.assumed.role.session.duration
fs.s3a.assumed.role.sts.endpoint
fs.s3a.assumed.role.sts.endpoint.region
fs.s3a.assumed.role.credentials.provider
fs.s3a.connection.maximum
fs.s3a.connection.ssl.enabled
fs.s3a.endpoint
fs.s3a.path.style.access
fs.s3a.proxy.host
fs.s3a.proxy.port
fs.s3a.proxy.username
fs.s3a.proxy.password
fs.s3a.proxy.domain
fs.s3a.proxy.workstation
fs.s3a.attempts.maximum
fs.s3a.connection.establish.timeout
fs.s3a.connection.timeout
fs.s3a.socket.send.buffer
fs.s3a.socket.recv.buffer
fs.s3a.paging.maximum
fs.s3a.threads.max
fs.s3a.threads.keepalivetime
fs.s3a.max.total.tasks
fs.s3a.multipart.size
fs.s3a.multipart.threshold
fs.s3a.multiobjectdelete.enable
fs.s3a.acl.default
fs.s3a.multipart.purge
fs.s3a.multipart.purge.age
fs.s3a.server-side-encryption-algorithm
fs.s3a.server-side-encryption.key
fs.s3a.signing-algorithm
fs.s3a.block.size
fs.s3a.buffer.dir
fs.s3a.fast.upload.buffer
fs.s3a.fast.upload.active.blocks
fs.s3a.readahead.range
fs.s3a.user.agent.prefix
fs.s3a.metadatastore.authoritative
fs.s3a.metadatastore.impl
fs.s3a.s3guard.cli.prune.age
fs.s3a.impl
fs.s3a.s3guard.ddb.region
fs.s3a.s3guard.ddb.table
fs.s3a.s3guard.ddb.table.create
fs.s3a.s3guard.ddb.table.capacity.read
fs.s3a.s3guard.ddb.table.capacity.write
fs.s3a.s3guard.ddb.max.retries
fs.s3a.s3guard.ddb.throttle.retry.interval
fs.s3a.s3guard.ddb.background.sleep
fs.s3a.retry.limit
fs.s3a.retry.interval
fs.s3a.retry.throttle.limit
fs.s3a.retry.throttle.interval
fs.s3a.committer.name
fs.s3a.committer.magic.enabled
fs.s3a.committer.threads
fs.s3a.committer.staging.tmp.path
fs.s3a.committer.staging.unique-filenames
fs.s3a.committer.staging.conflict-mode
fs.s3a.committer.staging.abort.pending.uploads
fs.AbstractFileSystem.s3a.impl
fs.s3a.list.version
fs.s3a.etag.checksum.enabled

fs.AbstractFileSystem.wasb.impl
fs.AbstractFileSystem.wasbs.impl
fs.wasb.impl
fs.wasbs.impl
fs.azure.secure.mode
fs.abfs.impl
fs.abfss.impl
fs.AbstractFileSystem.abfs.impl
fs.AbstractFileSystem.abfss.impl
fs.azure.local.sas.key.mode
fs.azure.sas.expiry.period
fs.azure.authorization
fs.azure.authorization.caching.enable
fs.azure.saskey.usecontainersaskeyforallaccess
io.seqfile.compress.blocksize
io.mapfile.bloom.size
io.mapfile.bloom.error.rate
hadoop.util.hash.type
ipc.client.idlethreshold
ipc.client.kill.max
ipc.client.connection.maxidletime
ipc.client.connect.max.retries
ipc.client.connect.retry.interval
ipc.client.connect.timeout
ipc.client.connect.max.retries.on.timeouts
ipc.client.tcpnodelay
ipc.client.low-latency
ipc.client.ping
ipc.ping.interval
ipc.client.rpc-timeout.ms
ipc.server.listen.queue.size
ipc.server.log.slow.rpc
ipc.maximum.data.length
ipc.maximum.response.length
hadoop.security.impersonation.provider.class
hadoop.rpc.socket.factory.class.default
hadoop.rpc.socket.factory.class.ClientProtocol
hadoop.socks.server
net.topology.node.switch.mapping.impl
net.topology.impl
net.topology.script.file.name
net.topology.script.number.args
net.topology.table.file.name
file.stream-buffer-size
file.bytes-per-checksum
file.client-write-packet-size
file.blocksize
file.replication
ftp.stream-buffer-size
ftp.bytes-per-checksum
ftp.client-write-packet-size
ftp.blocksize
ftp.replication
tfile.io.chunk.size
tfile.fs.output.buffer.size
tfile.fs.input.buffer.size
hadoop.http.authentication.type
hadoop.http.authentication.token.validity
hadoop.http.authentication.signature.secret.file
hadoop.http.authentication.cookie.domain
hadoop.http.authentication.simple.anonymous.allowed
hadoop.http.authentication.kerberos.principal
hadoop.http.authentication.kerberos.keytab
hadoop.http.cross-origin.enabled
hadoop.http.cross-origin.allowed-origins
hadoop.http.cross-origin.allowed-methods
hadoop.http.cross-origin.allowed-headers
hadoop.http.cross-origin.max-age
dfs.ha.fencing.methods
dfs.ha.fencing.ssh.connect-timeout
dfs.ha.fencing.ssh.private-key-files
ha.zookeeper.quorum
ha.zookeeper.session-timeout.ms
ha.zookeeper.parent-znode
ha.zookeeper.acl
ha.zookeeper.auth
hadoop.http.staticuser.user
hadoop.ssl.keystores.factory.class
hadoop.ssl.require.client.cert
hadoop.ssl.hostname.verifier
hadoop.ssl.server.conf
hadoop.ssl.client.conf
hadoop.ssl.enabled
hadoop.ssl.enabled.protocols
hadoop.jetty.logs.serve.aliases
fs.permissions.umask-mode
ha.health-monitor.connect-retry-interval.ms
ha.health-monitor.check-interval.ms
ha.health-monitor.sleep-after-disconnect.ms
ha.health-monitor.rpc-timeout.ms
ha.failover-controller.new-active.rpc-timeout.ms
ha.failover-controller.graceful-fence.rpc-timeout.ms
ha.failover-controller.graceful-fence.connection.retries
ha.failover-controller.cli-check.rpc-timeout.ms
ipc.client.fallback-to-simple-auth-allowed
fs.client.resolve.remote.symlinks
nfs.exports.allowed.hosts
hadoop.user.group.static.mapping.overrides
rpc.metrics.quantile.enable
rpc.metrics.percentiles.intervals
hadoop.security.crypto.codec.classes.EXAMPLECIPHERSUITE
hadoop.security.crypto.codec.classes.aes.ctr.nopadding
hadoop.security.crypto.cipher.suite
hadoop.security.crypto.jce.provider
hadoop.security.crypto.jceks.key.serialfilter
hadoop.security.crypto.buffer.size
hadoop.security.java.secure.random.algorithm
hadoop.security.secure.random.impl
hadoop.security.random.device.file.path
hadoop.security.key.provider.path
hadoop.security.key.default.bitlength
hadoop.security.key.default.cipher
fs.har.impl.disable.cache
hadoop.security.kms.client.authentication.retry-count
hadoop.security.kms.client.encrypted.key.cache.size
hadoop.security.kms.client.encrypted.key.cache.low-watermark
hadoop.security.kms.client.encrypted.key.cache.num.refill.threads
hadoop.security.kms.client.encrypted.key.cache.expiry
hadoop.security.kms.client.timeout
hadoop.security.kms.client.failover.sleep.base.millis
hadoop.security.kms.client.failover.sleep.max.millis
ipc.server.max.connections
hadoop.registry.zk.root
hadoop.registry.zk.session.timeout.ms
hadoop.registry.zk.connection.timeout.ms
hadoop.registry.zk.retry.times
hadoop.registry.zk.retry.interval.ms
hadoop.registry.zk.retry.ceiling.ms
hadoop.registry.zk.quorum
hadoop.registry.secure
hadoop.registry.system.acls
hadoop.registry.kerberos.realm
hadoop.registry.jaas.context
hadoop.shell.missing.defaultFs.warning
hadoop.shell.safely.delete.limit.num.files
fs.client.htrace.sampler.classes
hadoop.htrace.span.receiver.classes
hadoop.http.logs.enabled
fs.client.resolve.topology.enabled
fs.adl.impl
fs.AbstractFileSystem.adl.impl
adl.feature.ownerandgroup.enableupn
fs.adl.oauth2.access.token.provider.type
fs.adl.oauth2.client.id
fs.adl.oauth2.credential
fs.adl.oauth2.refresh.url
fs.adl.oauth2.refresh.token
fs.adl.oauth2.access.token.provider
fs.adl.oauth2.msi.port
fs.adl.oauth2.devicecode.clientapp.id
adl.http.timeout
hadoop.caller.context.enabled
hadoop.caller.context.max.size
hadoop.caller.context.signature.max.size
seq.io.sort.mb
seq.io.sort.factor
hadoop.zk.address
hadoop.zk.num-retries
hadoop.zk.retry-interval-ms
hadoop.zk.timeout-ms
hadoop.zk.acl
hadoop.zk.auth
hadoop.system.tags
hadoop.tags.system
ipc.client.bind.wildcard.addr

hdfs-site.xml (https://hadoop.apache.org/docs/r3.2.0/hadoop-project-dist/hadoop-hdfs/hdfs-default.xml)

hadoop.hdfs.configuration.version
dfs.namenode.rpc-address
dfs.namenode.rpc-bind-host
dfs.namenode.servicerpc-address
dfs.namenode.servicerpc-bind-host
dfs.namenode.lifeline.rpc-address
dfs.namenode.lifeline.rpc-bind-host
dfs.namenode.secondary.http-address
dfs.namenode.secondary.https-address
dfs.datanode.address
dfs.datanode.http.address
dfs.datanode.ipc.address
dfs.datanode.http.internal-proxy.port
dfs.datanode.handler.count
dfs.namenode.http-address
dfs.namenode.http-bind-host
dfs.namenode.heartbeat.recheck-interval
dfs.http.policy
dfs.client.https.need-auth
dfs.client.cached.conn.retry
dfs.https.server.keystore.resource
dfs.client.https.keystore.resource
dfs.datanode.https.address
dfs.namenode.https-address
dfs.namenode.https-bind-host
dfs.datanode.dns.interface
dfs.datanode.dns.nameserver
dfs.namenode.backup.address
dfs.namenode.backup.http-address
dfs.namenode.redundancy.considerLoad
dfs.namenode.redundancy.considerLoad.factor
dfs.default.chunk.view.size
dfs.datanode.du.reserved.calculator
dfs.datanode.du.reserved
dfs.datanode.du.reserved.pct
dfs.namenode.name.dir
dfs.namenode.name.dir.restore
dfs.namenode.fs-limits.max-component-length
dfs.namenode.fs-limits.max-directory-items
dfs.namenode.fs-limits.min-block-size
dfs.namenode.fs-limits.max-blocks-per-file
dfs.namenode.edits.dir
dfs.namenode.edits.dir.required
dfs.namenode.shared.edits.dir
dfs.namenode.edits.journal-plugin.qjournal
dfs.permissions.enabled
dfs.permissions.superusergroup
dfs.cluster.administrators
dfs.namenode.acls.enabled
dfs.namenode.posix.acl.inheritance.enabled
dfs.namenode.lazypersist.file.scrub.interval.sec
dfs.block.access.token.enable
dfs.block.access.key.update.interval
dfs.block.access.token.lifetime
dfs.block.access.token.protobuf.enable
dfs.datanode.data.dir
dfs.datanode.data.dir.perm
dfs.replication
dfs.replication.max
dfs.namenode.replication.min
dfs.namenode.maintenance.replication.min
dfs.namenode.safemode.replication.min
dfs.namenode.max-corrupt-file-blocks-returned
dfs.blocksize
dfs.client.block.write.retries
dfs.client.block.write.replace-datanode-on-failure.enable
dfs.client.block.write.replace-datanode-on-failure.policy
dfs.client.block.write.replace-datanode-on-failure.best-effort
dfs.client.block.write.replace-datanode-on-failure.min-replication
dfs.blockreport.intervalMsec
dfs.blockreport.initialDelay
dfs.blockreport.split.threshold
dfs.namenode.max.full.block.report.leases
dfs.namenode.full.block.report.lease.length.ms
dfs.datanode.directoryscan.interval
dfs.datanode.directoryscan.threads
dfs.datanode.directoryscan.throttle.limit.ms.per.sec
dfs.heartbeat.interval
dfs.datanode.lifeline.interval.seconds
dfs.namenode.handler.count
dfs.namenode.service.handler.count
dfs.namenode.lifeline.handler.ratio
dfs.namenode.lifeline.handler.count
dfs.namenode.safemode.threshold-pct
dfs.namenode.safemode.min.datanodes
dfs.namenode.safemode.extension
dfs.namenode.resource.check.interval
dfs.namenode.resource.du.reserved
dfs.namenode.resource.checked.volumes
dfs.namenode.resource.checked.volumes.minimum
dfs.datanode.balance.bandwidthPerSec
dfs.hosts
dfs.hosts.exclude
dfs.namenode.max.objects
dfs.namenode.datanode.registration.ip-hostname-check
dfs.namenode.decommission.interval
dfs.namenode.decommission.blocks.per.interval
dfs.namenode.decommission.max.concurrent.tracked.nodes
dfs.namenode.redundancy.interval.seconds
dfs.namenode.accesstime.precision
dfs.datanode.plugins
dfs.namenode.plugins
dfs.namenode.block-placement-policy.default.prefer-local-node
dfs.stream-buffer-size
dfs.bytes-per-checksum
dfs.client-write-packet-size
dfs.client.write.exclude.nodes.cache.expiry.interval.millis
dfs.namenode.checkpoint.dir
dfs.namenode.checkpoint.edits.dir
dfs.namenode.checkpoint.period
dfs.namenode.checkpoint.txns
dfs.namenode.checkpoint.check.period
dfs.namenode.checkpoint.max-retries
dfs.namenode.checkpoint.check.quiet-multiplier
dfs.namenode.num.checkpoints.retained
dfs.namenode.num.extra.edits.retained
dfs.namenode.max.extra.edits.segments.retained
dfs.namenode.delegation.key.update-interval
dfs.namenode.delegation.token.max-lifetime
dfs.namenode.delegation.token.renew-interval
dfs.datanode.failed.volumes.tolerated
dfs.datanode.volumes.replica-add.threadpool.size
dfs.image.compress
dfs.image.compression.codec
dfs.image.transfer.timeout
dfs.image.transfer.bandwidthPerSec
dfs.image.transfer-bootstrap-standby.bandwidthPerSec
dfs.image.transfer.chunksize
dfs.edit.log.transfer.timeout
dfs.edit.log.transfer.bandwidthPerSec
dfs.namenode.support.allow.format
dfs.datanode.max.transfer.threads
dfs.datanode.scan.period.hours
dfs.block.scanner.volume.bytes.per.second
dfs.datanode.readahead.bytes
dfs.datanode.drop.cache.behind.reads
dfs.datanode.drop.cache.behind.writes
dfs.datanode.sync.behind.writes
dfs.client.failover.max.attempts
dfs.client.failover.sleep.base.millis
dfs.client.failover.sleep.max.millis
dfs.client.failover.connection.retries
dfs.client.failover.connection.retries.on.timeouts
dfs.client.datanode-restart.timeout
dfs.nameservices
dfs.nameservice.id
dfs.internal.nameservices
dfs.ha.namenodes.EXAMPLENAMESERVICE
dfs.ha.namenode.id
dfs.ha.log-roll.period
dfs.ha.tail-edits.period
dfs.ha.tail-edits.namenode-retries
dfs.ha.tail-edits.rolledits.timeout
dfs.ha.automatic-failover.enabled
dfs.client.use.datanode.hostname
dfs.datanode.use.datanode.hostname
dfs.client.local.interfaces
dfs.datanode.shared.file.descriptor.paths
dfs.short.circuit.shared.memory.watcher.interrupt.check.ms
dfs.namenode.kerberos.principal
dfs.namenode.keytab.file
dfs.datanode.kerberos.principal
dfs.datanode.keytab.file
dfs.journalnode.kerberos.principal
dfs.journalnode.keytab.file
dfs.namenode.kerberos.internal.spnego.principal
dfs.journalnode.kerberos.internal.spnego.principal
dfs.secondary.namenode.kerberos.internal.spnego.principal
dfs.web.authentication.kerberos.principal
dfs.web.authentication.kerberos.keytab
dfs.namenode.kerberos.principal.pattern
dfs.namenode.avoid.read.stale.datanode
dfs.namenode.avoid.write.stale.datanode
dfs.namenode.stale.datanode.interval
dfs.namenode.write.stale.datanode.ratio
dfs.namenode.invalidate.work.pct.per.iteration
dfs.namenode.replication.work.multiplier.per.iteration
nfs.server.port
nfs.mountd.port
nfs.dump.dir
nfs.rtmax
nfs.wtmax
nfs.keytab.file
nfs.kerberos.principal
nfs.allow.insecure.ports
hadoop.fuse.connection.timeout
hadoop.fuse.timer.period
dfs.namenode.metrics.logger.period.seconds
dfs.datanode.metrics.logger.period.seconds
dfs.metrics.percentiles.intervals
dfs.datanode.peer.stats.enabled
dfs.datanode.outliers.report.interval
dfs.datanode.fileio.profiling.sampling.percentage
hadoop.user.group.metrics.percentiles.intervals
dfs.encrypt.data.transfer
dfs.encrypt.data.transfer.algorithm
dfs.encrypt.data.transfer.cipher.suites
dfs.encrypt.data.transfer.cipher.key.bitlength
dfs.trustedchannel.resolver.class
dfs.data.transfer.protection
dfs.data.transfer.saslproperties.resolver.class
dfs.journalnode.rpc-address
dfs.journalnode.rpc-bind-host
dfs.journalnode.http-address
dfs.journalnode.http-bind-host
dfs.journalnode.https-address
dfs.journalnode.https-bind-host
dfs.namenode.audit.loggers
dfs.datanode.available-space-volume-choosing-policy.balanced-space-threshold
dfs.datanode.available-space-volume-choosing-policy.balanced-space-preference-fraction
dfs.namenode.edits.noeditlogchannelflush
dfs.client.cache.drop.behind.writes
dfs.client.cache.drop.behind.reads
dfs.client.cache.readahead
dfs.client.server-defaults.validity.period.ms
dfs.namenode.enable.retrycache
dfs.namenode.retrycache.expirytime.millis
dfs.namenode.retrycache.heap.percent
dfs.client.mmap.enabled
dfs.client.mmap.cache.size
dfs.client.mmap.cache.timeout.ms
dfs.client.mmap.retry.timeout.ms
dfs.client.short.circuit.replica.stale.threshold.ms
dfs.namenode.caching.enabled
dfs.namenode.path.based.cache.block.map.allocation.percent
dfs.datanode.max.locked.memory
dfs.namenode.list.cache.directives.num.responses
dfs.namenode.list.cache.pools.num.responses
dfs.namenode.path.based.cache.refresh.interval.ms
dfs.namenode.path.based.cache.retry.interval.ms
dfs.datanode.fsdatasetcache.max.threads.per.volume
dfs.cachereport.intervalMsec
dfs.namenode.edit.log.autoroll.multiplier.threshold
dfs.namenode.edit.log.autoroll.check.interval.ms
dfs.webhdfs.user.provider.user.pattern
dfs.webhdfs.acl.provider.permission.pattern
dfs.webhdfs.socket.connect-timeout
dfs.webhdfs.socket.read-timeout
dfs.client.context
dfs.client.read.shortcircuit
dfs.client.socket.send.buffer.size
dfs.domain.socket.path
dfs.domain.socket.disable.interval.seconds
dfs.client.read.shortcircuit.skip.checksum
dfs.client.read.shortcircuit.streams.cache.size
dfs.client.read.shortcircuit.streams.cache.expiry.ms
dfs.datanode.shared.file.descriptor.paths
dfs.namenode.audit.log.debug.cmdlist
dfs.client.use.legacy.blockreader.local
dfs.block.local-path-access.user

dfs.client.domain.socket.data.traffic
dfs.namenode.reject-unresolved-dn-topology-mapping
dfs.namenode.xattrs.enabled
dfs.namenode.fs-limits.max-xattrs-per-inode
dfs.namenode.fs-limits.max-xattr-size
dfs.client.slow.io.warning.threshold.ms
dfs.datanode.slow.io.warning.threshold.ms
dfs.namenode.lease-recheck-interval-ms
dfs.namenode.max-lock-hold-to-release-lease-ms
dfs.namenode.write-lock-reporting-threshold-ms
dfs.namenode.read-lock-reporting-threshold-ms
dfs.namenode.lock.detailed-metrics.enabled
dfs.namenode.fslock.fair
dfs.namenode.startup.delay.block.deletion.sec
dfs.datanode.block.id.layout.upgrade.threads
dfs.namenode.list.encryption.zones.num.responses
dfs.namenode.list.reencryption.status.num.responses
dfs.namenode.list.openfiles.num.responses
dfs.namenode.edekcacheloader.interval.ms
dfs.namenode.edekcacheloader.initial.delay.ms
dfs.namenode.reencrypt.sleep.interval
dfs.namenode.reencrypt.batch.size
dfs.namenode.reencrypt.throttle.limit.handler.ratio
dfs.namenode.reencrypt.throttle.limit.updater.ratio
dfs.namenode.reencrypt.edek.threads
dfs.namenode.inotify.max.events.per.rpc
dfs.user.home.dir.prefix
dfs.datanode.cache.revocation.timeout.ms
dfs.datanode.cache.revocation.polling.ms
dfs.storage.policy.enabled
dfs.namenode.legacy-oiv-image.dir
dfs.namenode.top.enabled
dfs.namenode.top.window.num.buckets
dfs.namenode.top.num.users
dfs.namenode.top.windows.minutes
dfs.webhdfs.ugi.expire.after.access
dfs.namenode.blocks.per.postponedblocks.rescan
dfs.datanode.block-pinning.enabled
dfs.client.block.write.locateFollowingBlock.initial.delay.ms
dfs.ha.zkfc.nn.http.timeout.ms
dfs.ha.tail-edits.in-progress
dfs.namenode.ec.system.default.policy
dfs.namenode.ec.policies.max.cellsize
dfs.datanode.ec.reconstruction.stripedread.timeout.millis
dfs.datanode.ec.reconstruction.stripedread.buffer.size
dfs.datanode.ec.reconstruction.threads
dfs.datanode.ec.reconstruction.xmits.weight
dfs.namenode.quota.init-threads
dfs.datanode.transfer.socket.send.buffer.size
dfs.datanode.transfer.socket.recv.buffer.size
dfs.namenode.upgrade.domain.factor
dfs.ha.zkfc.port
dfs.datanode.bp-ready.timeout
dfs.datanode.cached-dfsused.check.interval.ms
dfs.webhdfs.rest-csrf.enabled
dfs.webhdfs.rest-csrf.custom-header
dfs.webhdfs.rest-csrf.methods-to-ignore
dfs.webhdfs.rest-csrf.browser-useragents-regex
dfs.xframe.enabled
dfs.xframe.value
dfs.balancer.keytab.enabled
dfs.balancer.address
dfs.balancer.keytab.file
dfs.balancer.kerberos.principal
dfs.http.client.retry.policy.enabled
dfs.http.client.retry.policy.spec
dfs.http.client.failover.max.attempts
dfs.http.client.retry.max.attempts
dfs.http.client.failover.sleep.base.millis
dfs.http.client.failover.sleep.max.millis
dfs.namenode.hosts.provider.classname
datanode.https.port
dfs.balancer.dispatcherThreads
dfs.balancer.movedWinWidth
dfs.balancer.moverThreads
dfs.balancer.max-size-to-move
dfs.balancer.getBlocks.min-block-size
dfs.balancer.getBlocks.size
dfs.balancer.block-move.timeout
dfs.balancer.max-no-move-interval
dfs.balancer.max-iteration-time
dfs.block.invalidate.limit
dfs.block.misreplication.processing.limit
dfs.block.placement.ec.classname
dfs.block.replicator.classname
dfs.blockreport.incremental.intervalMsec
dfs.checksum.type
dfs.checksum.combine.mode
dfs.client.block.write.locateFollowingBlock.retries
dfs.client.failover.proxy.provider
dfs.client.failover.random.order
dfs.client.key.provider.cache.expiry
dfs.client.max.block.acquire.failures
dfs.client.read.prefetch.size
dfs.client.read.short.circuit.replica.stale.threshold.ms
dfs.client.read.shortcircuit.buffer.size
dfs.client.read.striped.threadpool.size
dfs.client.replica.accessor.builder.classes
dfs.client.retry.interval-ms.get-last-block-length
dfs.client.retry.max.attempts
dfs.client.retry.policy.enabled
dfs.client.retry.policy.spec
dfs.client.retry.times.get-last-block-length
dfs.client.retry.window.base
dfs.client.socket-timeout
dfs.client.socketcache.capacity
dfs.client.socketcache.expiryMsec
dfs.client.test.drop.namenode.response.number
dfs.client.hedged.read.threadpool.size
dfs.client.hedged.read.threshold.millis
dfs.client.write.byte-array-manager.count-limit
dfs.client.write.byte-array-manager.count-reset-time-period-ms
dfs.client.write.byte-array-manager.count-threshold
dfs.client.write.byte-array-manager.enabled
dfs.client.write.max-packets-in-flight
dfs.content-summary.limit
dfs.content-summary.sleep-microsec
dfs.data.transfer.client.tcpnodelay
dfs.data.transfer.server.tcpnodelay
dfs.datanode.balance.max.concurrent.moves
dfs.datanode.fsdataset.factory
dfs.datanode.fsdataset.volume.choosing.policy
dfs.datanode.hostname
dfs.datanode.lazywriter.interval.sec
dfs.datanode.network.counts.cache.max.size
dfs.datanode.oob.timeout-ms
dfs.datanode.parallel.volumes.load.threads.num
dfs.datanode.ram.disk.replica.tracker
dfs.datanode.restart.replica.expiration
dfs.datanode.socket.reuse.keepalive
dfs.datanode.socket.write.timeout
dfs.datanode.sync.behind.writes.in.background
dfs.datanode.transferTo.allowed
dfs.ha.fencing.methods
dfs.ha.standby.checkpoints
dfs.ha.zkfc.port
dfs.journalnode.edits.dir
dfs.journalnode.enable.sync
dfs.journalnode.sync.interval
dfs.journalnode.kerberos.internal.spnego.principal
dfs.journalnode.kerberos.principal
dfs.journalnode.keytab.file
dfs.ls.limit
dfs.mover.movedWinWidth
dfs.mover.moverThreads
dfs.mover.retry.max.attempts
dfs.mover.keytab.enabled
dfs.mover.address
dfs.mover.keytab.file
dfs.mover.kerberos.principal
dfs.mover.max-no-move-interval
dfs.namenode.audit.log.async
dfs.namenode.audit.log.token.tracking.id
dfs.namenode.available-space-block-placement-policy.balanced-space-preference-fraction
dfs.namenode.backup.dnrpc-address
dfs.namenode.delegation.token.always-use
dfs.namenode.edits.asynclogging
dfs.namenode.edits.dir.minimum
dfs.namenode.edits.journal-plugin
dfs.namenode.file.close.num-committed-allowed
dfs.namenode.inode.attributes.provider.class
dfs.namenode.inode.attributes.provider.bypass.users
dfs.namenode.max-num-blocks-to-log
dfs.namenode.max.op.size
dfs.namenode.missing.checkpoint.periods.before.shutdown
dfs.namenode.name.cache.threshold
dfs.namenode.replication.max-streams
dfs.namenode.replication.max-streams-hard-limit
dfs.namenode.reconstruction.pending.timeout-sec
dfs.namenode.stale.datanode.minimum.interval
dfs.namenode.storageinfo.defragment.timeout.ms
dfs.namenode.storageinfo.defragment.interval.ms
dfs.namenode.storageinfo.defragment.ratio
dfs.namenode.snapshot.capture.openfiles
dfs.namenode.snapshot.skip.capture.accesstime-only-change
dfs.namenode.snapshotdiff.allow.snap-root-descendant
dfs.namenode.snapshotdiff.listing.limit
dfs.namenode.snapshot.max.limit
dfs.namenode.snapshot.skiplist.max.levels
dfs.namenode.snapshot.skiplist.interval
dfs.storage.policy.satisfier.enabled
dfs.storage.policy.satisfier.queue.limit
dfs.storage.policy.satisfier.work.multiplier.per.iteration
dfs.storage.policy.satisfier.recheck.timeout.millis
dfs.storage.policy.satisfier.self.retry.timeout.millis
dfs.storage.policy.satisfier.retry.max.attempts
dfs.storage.policy.satisfier.datanode.cache.refresh.interval.ms
dfs.storage.policy.satisfier.max.outstanding.paths
dfs.storage.policy.satisfier.address
dfs.storage.policy.satisfier.keytab.file
dfs.storage.policy.satisfier.kerberos.principal
dfs.pipeline.ecn
dfs.qjournal.accept-recovery.timeout.ms
dfs.qjournal.finalize-segment.timeout.ms
dfs.qjournal.get-journal-state.timeout.ms
dfs.qjournal.new-epoch.timeout.ms
dfs.qjournal.prepare-recovery.timeout.ms
dfs.qjournal.queued-edits.limit.mb
dfs.qjournal.select-input-streams.timeout.ms
dfs.qjournal.start-segment.timeout.ms
dfs.qjournal.write-txns.timeout.ms
dfs.qjournal.http.open.timeout.ms
dfs.qjournal.http.read.timeout.ms
dfs.quota.by.storage.type.enabled
dfs.secondary.namenode.kerberos.principal
dfs.secondary.namenode.keytab.file
dfs.web.authentication.filter
dfs.web.authentication.simple.anonymous.allowed
dfs.web.ugi
dfs.webhdfs.netty.high.watermark
dfs.webhdfs.netty.low.watermark
dfs.webhdfs.oauth2.access.token.provider
dfs.webhdfs.oauth2.client.id
dfs.webhdfs.oauth2.enabled
dfs.webhdfs.oauth2.refresh.url
ssl.server.keystore.keypassword
ssl.server.keystore.location
ssl.server.keystore.password
ssl.server.truststore.location
ssl.server.truststore.password
dfs.disk.balancer.max.disk.throughputInMBperSec
dfs.disk.balancer.block.tolerance.percent
dfs.disk.balancer.max.disk.errors
dfs.disk.balancer.plan.valid.interval
dfs.disk.balancer.enabled
dfs.disk.balancer.plan.threshold.percent
dfs.namenode.provided.enabled
dfs.provided.storage.id
dfs.provided.aliasmap.class
dfs.provided.aliasmap.inmemory.batch-size
dfs.provided.aliasmap.inmemory.dnrpc-address
dfs.provided.aliasmap.inmemory.rpc.bind-host
dfs.provided.aliasmap.inmemory.leveldb.dir
dfs.provided.aliasmap.inmemory.enabled
dfs.provided.aliasmap.inmemory.server.log
dfs.provided.aliasmap.text.delimiter
dfs.provided.aliasmap.text.read.file
dfs.provided.aliasmap.text.codec
dfs.provided.aliasmap.text.write.dir
dfs.provided.aliasmap.leveldb.path
dfs.provided.aliasmap.load.retries
dfs.lock.suppress.warning.interval
httpfs.buffer.size
dfs.webhdfs.use.ipc.callq
dfs.datanode.disk.check.min.gap
dfs.datanode.disk.check.timeout
dfs.use.dfs.network.topology
dfs.net.topology.impl
dfs.qjm.operations.timeout
dfs.reformat.disabled
dfs.namenode.block.deletion.increment

mapred-site.xml (https://hadoop.apache.org/docs/r3.2.0/hadoop-mapreduce-client/hadoop-mapreduce-client-core/mapred-default.xml)

mapreduce.job.hdfs-servers
mapreduce.job.committer.setup.cleanup.needed
mapreduce.task.io.sort.factor
mapreduce.task.io.sort.mb
mapreduce.map.sort.spill.percent
mapreduce.job.local-fs.single-disk-limit.bytes
mapreduce.job.local-fs.single-disk-limit.check.interval-ms
mapreduce.job.local-fs.single-disk-limit.check.kill-limit-exceed
mapreduce.job.maps
mapreduce.job.reduces
mapreduce.job.running.map.limit
mapreduce.job.running.reduce.limit
mapreduce.job.max.map
mapreduce.job.reducer.preempt.delay.sec
mapreduce.job.reducer.unconditional-preempt.delay.sec
mapreduce.job.max.split.locations
mapreduce.job.split.metainfo.maxsize
mapreduce.map.maxattempts
mapreduce.reduce.maxattempts
mapreduce.reduce.shuffle.fetch.retry.enabled
mapreduce.reduce.shuffle.fetch.retry.interval-ms
mapreduce.reduce.shuffle.fetch.retry.timeout-ms
mapreduce.reduce.shuffle.retry-delay.max.ms
mapreduce.reduce.shuffle.parallelcopies
mapreduce.reduce.shuffle.connect.timeout
mapreduce.reduce.shuffle.read.timeout
mapreduce.shuffle.listen.queue.size
mapreduce.shuffle.connection-keep-alive.enable
mapreduce.shuffle.connection-keep-alive.timeout
mapreduce.task.timeout
mapreduce.map.memory.mb
mapreduce.map.cpu.vcores
mapreduce.reduce.memory.mb
mapreduce.reduce.cpu.vcores
mapred.child.java.opts
mapred.child.env
mapreduce.admin.user.env
yarn.app.mapreduce.am.log.level
mapreduce.map.log.level
mapreduce.reduce.log.level
mapreduce.reduce.merge.inmem.threshold
mapreduce.reduce.shuffle.merge.percent
mapreduce.reduce.shuffle.input.buffer.percent
mapreduce.reduce.input.buffer.percent
mapreduce.reduce.shuffle.memory.limit.percent
mapreduce.shuffle.ssl.enabled
mapreduce.shuffle.ssl.file.buffer.size
mapreduce.shuffle.max.connections
mapreduce.shuffle.max.threads
mapreduce.shuffle.transferTo.allowed
mapreduce.shuffle.transfer.buffer.size
mapreduce.reduce.markreset.buffer.percent
mapreduce.map.speculative
mapreduce.reduce.speculative
mapreduce.job.speculative.speculative-cap-running-tasks
mapreduce.job.speculative.speculative-cap-total-tasks
mapreduce.job.speculative.minimum-allowed-tasks
mapreduce.job.speculative.retry-after-no-speculate
mapreduce.job.speculative.retry-after-speculate
mapreduce.job.map.output.collector.class
mapreduce.job.speculative.slowtaskthreshold
mapreduce.job.ubertask.enable
mapreduce.job.ubertask.maxmaps
mapreduce.job.ubertask.maxreduces
mapreduce.job.ubertask.maxbytes
mapreduce.job.emit-timeline-data
mapreduce.job.sharedcache.mode
mapreduce.input.fileinputformat.split.minsize
mapreduce.input.fileinputformat.list-status.num-threads
mapreduce.input.lineinputformat.linespermap
mapreduce.client.submit.file.replication
mapreduce.task.files.preserve.failedtasks
mapreduce.output.fileoutputformat.compress
mapreduce.output.fileoutputformat.compress.type
mapreduce.output.fileoutputformat.compress.codec
mapreduce.map.output.compress
mapreduce.map.output.compress.codec
map.sort.class
mapreduce.task.userlog.limit.kb
yarn.app.mapreduce.am.container.log.limit.kb
yarn.app.mapreduce.task.container.log.backups
yarn.app.mapreduce.am.container.log.backups
yarn.app.mapreduce.shuffle.log.separate
yarn.app.mapreduce.shuffle.log.limit.kb
yarn.app.mapreduce.shuffle.log.backups
mapreduce.job.maxtaskfailures.per.tracker
mapreduce.client.output.filter
mapreduce.client.completion.pollinterval
mapreduce.client.progressmonitor.pollinterval
mapreduce.client.libjars.wildcard
mapreduce.task.profile
mapreduce.task.profile.maps
mapreduce.task.profile.reduces
mapreduce.task.profile.params
mapreduce.task.profile.map.params
mapreduce.task.profile.reduce.params
mapreduce.task.skip.start.attempts
mapreduce.job.skip.outdir
mapreduce.map.skip.maxrecords
mapreduce.map.skip.proc-count.auto-incr
mapreduce.reduce.skip.maxgroups
mapreduce.reduce.skip.proc-count.auto-incr
mapreduce.ifile.readahead
mapreduce.ifile.readahead.bytes
mapreduce.job.queuename

mapreduce.job.tags
mapreduce.cluster.local.dir
mapreduce.cluster.acls.enabled
mapreduce.job.acl-modify-job
mapreduce.job.acl-view-job
mapreduce.job.finish-when-all-reducers-done
mapreduce.job.token.tracking.ids.enabled
mapreduce.job.token.tracking.ids
mapreduce.task.merge.progress.records
mapreduce.task.combine.progress.records
mapreduce.job.reduce.slowstart.completedmaps
mapreduce.job.complete.cancel.delegation.tokens
mapreduce.shuffle.port
mapreduce.job.reduce.shuffle.consumer.plugin.class
mapreduce.job.node-label-expression
mapreduce.job.am.node-label-expression
mapreduce.map.node-label-expression
mapreduce.reduce.node-label-expression
mapreduce.job.counters.limit
mapreduce.framework.name
yarn.app.mapreduce.am.staging-dir
yarn.app.mapreduce.am.staging-dir.erasurecoding.enabled
mapreduce.am.max-attempts
mapreduce.job.end-notification.url
mapreduce.job.end-notification.retry.attempts
mapreduce.job.end-notification.retry.interval
mapreduce.job.end-notification.max.attempts
mapreduce.job.log4j-properties-file
mapreduce.job.end-notification.max.retry.interval
yarn.app.mapreduce.am.env
yarn.app.mapreduce.am.admin.user.env
yarn.app.mapreduce.am.command-opts
yarn.app.mapreduce.am.admin-command-opts
yarn.app.mapreduce.am.job.task.listener.thread-count
yarn.app.mapreduce.am.job.client.port-range
yarn.app.mapreduce.am.webapp.port-range
yarn.app.mapreduce.am.job.committer.cancel-timeout
yarn.app.mapreduce.am.job.committer.commit-window
mapreduce.fileoutputcommitter.algorithm.version
mapreduce.fileoutputcommitter.task.cleanup.enabled
yarn.app.mapreduce.am.scheduler.heartbeat.interval-ms
yarn.app.mapreduce.client-am.ipc.max-retries
yarn.app.mapreduce.client-am.ipc.max-retries-on-timeouts
yarn.app.mapreduce.client.max-retries
yarn.app.mapreduce.am.resource.mb
yarn.app.mapreduce.am.resource.cpu-vcores
yarn.app.mapreduce.am.hard-kill-timeout-ms
yarn.app.mapreduce.client.job.max-retries
yarn.app.mapreduce.client.job.retry-interval
mapreduce.application.classpath
mapreduce.app-submission.cross-platform
mapreduce.application.framework.path
mapreduce.job.classloader
mapreduce.job.classloader.system.classes
mapreduce.jvm.system-properties-to-log
mapreduce.jobhistory.address
mapreduce.jobhistory.webapp.address
mapreduce.jobhistory.webapp.https.address
mapreduce.jobhistory.keytab
mapreduce.jobhistory.principal
mapreduce.jobhistory.intermediate-done-dir
mapreduce.jobhistory.intermediate-user-done-dir.permissions
mapreduce.jobhistory.always-scan-user-dir
mapreduce.jobhistory.done-dir
mapreduce.jobhistory.cleaner.enable
mapreduce.jobhistory.cleaner.interval-ms
mapreduce.jobhistory.max-age-ms
mapreduce.jobhistory.client.thread-count
mapreduce.jobhistory.datestring.cache.size
mapreduce.jobhistory.joblist.cache.size
mapreduce.jobhistory.loadedjobs.cache.size
mapreduce.jobhistory.loadedtasks.cache.size
mapreduce.jobhistory.move.interval-ms
mapreduce.jobhistory.move.thread-count
mapreduce.jobhistory.store.class
mapreduce.jobhistory.minicluster.fixed.ports
mapreduce.jobhistory.admin.address
mapreduce.jobhistory.admin.acl
mapreduce.jobhistory.recovery.enable
mapreduce.jobhistory.recovery.store.class
mapreduce.jobhistory.recovery.store.fs.uri
mapreduce.jobhistory.recovery.store.leveldb.path
mapreduce.jobhistory.http.policy
mapreduce.jobhistory.jobname.limit
mapreduce.jobhistory.jhist.format
mapreduce.job.heap.memory-mb.ratio
yarn.app.mapreduce.am.containerlauncher.threadpool-initial-size
mapreduce.task.exit.timeout
mapreduce.task.exit.timeout.check-interval-ms
mapreduce.job.encrypted-intermediate-data
mapreduce.job.encrypted-intermediate-data-key-size-bits
mapreduce.job.encrypted-intermediate-data.buffer.kb
mapreduce.task.local-fs.write-limit.bytes
mapreduce.jobhistory.webapp.rest-csrf.enabled
mapreduce.jobhistory.webapp.rest-csrf.custom-header
mapreduce.jobhistory.webapp.rest-csrf.methods-to-ignore
mapreduce.job.cache.limit.max-resources
mapreduce.job.cache.limit.max-resources-mb
mapreduce.job.cache.limit.max-single-resource-mb
mapreduce.jobhistory.webapp.xfs-filter.xframe-options
mapreduce.jobhistory.loadedjob.tasks.max
mapreduce.job.redacted-properties
mapreduce.job.send-token-conf
mapreduce.outputcommitter.factory.class
mapreduce.outputcommitter.factory.scheme.s3a

yarn-site.xml (https://hadoop.apache.org/docs/r3.2.0/hadoop-yarn/hadoop-yarn-common/yarn-default.xml)

yarn.ipc.client.factory.class
yarn.ipc.server.factory.class
yarn.ipc.record.factory.class
yarn.ipc.rpc.class
yarn.resourcemanager.hostname
yarn.resourcemanager.address
yarn.resourcemanager.bind-host
yarn.resourcemanager.auto-update.containers
yarn.resourcemanager.client.thread-count
yarn.resourcemanager.amlauncher.thread-count
yarn.resourcemanager.nodemanager-connect-retries
yarn.dispatcher.drain-events.timeout
yarn.am.liveness-monitor.expiry-interval-ms
yarn.resourcemanager.principal
yarn.resourcemanager.scheduler.address
yarn.resourcemanager.scheduler.client.thread-count
yarn.resourcemanager.placement-constraints.handler
yarn.resourcemanager.placement-constraints.retry-attempts
yarn.resourcemanager.placement-constraints.algorithm.class
yarn.resourcemanager.placement-constraints.algorithm.iterator
yarn.resourcemanager.placement-constraints.algorithm.pool-size
yarn.resourcemanager.placement-constraints.scheduler.pool-size
yarn.resourcemanager.application-master-service.processors
yarn.http.policy
yarn.resourcemanager.webapp.address
yarn.resourcemanager.webapp.https.address
yarn.resourcemanager.webapp.spnego-keytab-file
yarn.resourcemanager.webapp.spnego-principal
yarn.resourcemanager.webapp.ui-actions.enabled
yarn.webapp.ui2.enable
yarn.webapp.ui2.war-file-path
yarn.webapp.api-service.enable
yarn.resourcemanager.resource-tracker.address
yarn.acl.enable
yarn.acl.reservation-enable
yarn.admin.acl
yarn.resourcemanager.admin.address
yarn.resourcemanager.admin.client.thread-count
yarn.resourcemanager.connect.max-wait.ms
yarn.resourcemanager.connect.retry-interval.ms
yarn.resourcemanager.am.max-attempts
yarn.resourcemanager.container.liveness-monitor.interval-ms
yarn.resourcemanager.keytab
yarn.resourcemanager.webapp.delegation-token-auth-filter.enabled
yarn.resourcemanager.webapp.cross-origin.enabled
yarn.nm.liveness-monitor.expiry-interval-ms
yarn.resourcemanager.nodes.include-path
yarn.resourcemanager.nodes.exclude-path
yarn.resourcemanager.node-ip-cache.expiry-interval-secs
yarn.resourcemanager.resource-tracker.client.thread-count
yarn.resourcemanager.scheduler.class
yarn.scheduler.minimum-allocation-mb
yarn.scheduler.maximum-allocation-mb
yarn.scheduler.minimum-allocation-vcores
yarn.scheduler.maximum-allocation-vcores
yarn.scheduler.include-port-in-node-name
yarn.resourcemanager.recovery.enabled
yarn.resourcemanager.fail-fast
yarn.fail-fast
yarn.resourcemanager.work-preserving-recovery.enabled
yarn.resourcemanager.work-preserving-recovery.scheduling-wait-ms
yarn.resourcemanager.store.class
yarn.resourcemanager.ha.failover-controller.active-standby-elector.zk.retries
yarn.resourcemanager.state-store.max-completed-applications
yarn.resourcemanager.zk-state-store.parent-path
yarn.resourcemanager.zk-state-store.root-node.acl
yarn.resourcemanager.fs.state-store.uri
yarn.resourcemanager.fs.state-store.num-retries
yarn.resourcemanager.fs.state-store.retry-interval-ms
yarn.resourcemanager.leveldb-state-store.path
yarn.resourcemanager.leveldb-state-store.compaction-interval-secs
yarn.resourcemanager.ha.enabled
yarn.resourcemanager.ha.automatic-failover.enabled
yarn.resourcemanager.ha.automatic-failover.embedded
yarn.resourcemanager.ha.automatic-failover.zk-base-path
yarn.resourcemanager.zk-appid-node.split-index
yarn.resourcemanager.zk-delegation-token-node.split-index
yarn.resourcemanager.zk-max-znode-size.bytes
yarn.resourcemanager.cluster-id
yarn.resourcemanager.epoch.range
yarn.resourcemanager.ha.rm-ids
yarn.resourcemanager.ha.id
yarn.client.failover-proxy-provider
yarn.client.failover-max-attempts
yarn.client.failover-sleep-base-ms
yarn.client.failover-sleep-max-ms
yarn.client.failover-retries
yarn.client.failover-retries-on-socket-timeouts
yarn.resourcemanager.max-completed-applications
yarn.resourcemanager.delayed.delegation-token.removal-interval-ms
yarn.resourcemanager.delegation-token.max-conf-size-bytes
yarn.resourcemanager.proxy-user-privileges.enabled
yarn.resourcemanager.am-rm-tokens.master-key-rolling-interval-secs
yarn.resourcemanager.container-tokens.master-key-rolling-interval-secs
yarn.resourcemanager.nodemanagers.heartbeat-interval-ms
yarn.resourcemanager.nodemanager.minimum.version
yarn.resourcemanager.scheduler.monitor.enable
yarn.resourcemanager.scheduler.monitor.policies
yarn.resourcemanager.configuration.provider-class
yarn.resourcemanager.configuration.file-system-based-store
yarn.resourcemanager.system-metrics-publisher.enabled
yarn.system-metrics-publisher.enabled
yarn.rm.system-metrics-publisher.emit-container-events
yarn.resourcemanager.system-metrics-publisher.dispatcher.pool-size
yarn.resourcemanager.max-log-aggregation-diagnostics-in-memory
yarn.resourcemanager.delegation-token-renewer.thread-count
yarn.resourcemanager.delegation.key.update-interval
yarn.resourcemanager.delegation.token.max-lifetime
yarn.resourcemanager.delegation.token.renew-interval
yarn.resourcemanager.history-writer.multi-threaded-dispatcher.pool-size
yarn.resourcemanager.metrics.runtime.buckets
yarn.resourcemanager.nm-tokens.master-key-rolling-interval-secs
yarn.resourcemanager.reservation-system.enable
yarn.resourcemanager.reservation-system.class
yarn.resourcemanager.reservation-system.plan.follower
yarn.resourcemanager.reservation-system.planfollower.time-step
yarn.resourcemanager.rm.container-allocation.expiry-interval-ms
yarn.resourcemanager.resource-profiles.enabled
yarn.resourcemanager.resource-profiles.source-file
yarn.nodemanager.hostname
yarn.nodemanager.address
yarn.nodemanager.bind-host
yarn.nodemanager.admin-env
yarn.nodemanager.env-whitelist
yarn.nodemanager.container-executor.class
yarn.nodemanager.container-state-transition-listener.classes
yarn.nodemanager.container-manager.thread-count
yarn.nodemanager.collector-service.thread-count
yarn.nodemanager.delete.thread-count
yarn.nodemanager.opportunistic-containers-max-queue-length
yarn.nodemanager.delete.debug-delay-sec
yarn.nodemanager.keytab
yarn.nodemanager.local-dirs
yarn.nodemanager.local-cache.max-files-per-directory
yarn.nodemanager.localizer.address
yarn.nodemanager.collector-service.address
yarn.nodemanager.localizer.cache.cleanup.interval-ms
yarn.nodemanager.localizer.cache.target-size-mb
yarn.nodemanager.localizer.client.thread-count
yarn.nodemanager.localizer.fetch.thread-count
yarn.nodemanager.container-localizer.java.opts
yarn.nodemanager.container-localizer.log.level
yarn.nodemanager.log-dirs
yarn.nodemanager.default-container-executor.log-dirs.permissions
yarn.log-aggregation-enable
yarn.log-aggregation.retain-seconds
yarn.log-aggregation.retain-check-interval-seconds
yarn.log-aggregation.file-formats
yarn.log-aggregation.file-controller.TFile.class
yarn.log-aggregation-status.time-out.ms
yarn.nodemanager.log.retain-seconds
yarn.nodemanager.remote-app-log-dir
yarn.nodemanager.remote-app-log-dir-suffix
yarn.nodemanager.log-container-debug-info.enabled
yarn.nodemanager.resource.memory-mb
yarn.nodemanager.resource.system-reserved-memory-mb
yarn.nodemanager.resource.memory.enabled
yarn.nodemanager.resource.memory.enforced
yarn.nodemanager.resource.memory.cgroups.soft-limit-percentage
yarn.nodemanager.resource.memory.cgroups.swappiness
yarn.nodemanager.pmem-check-enabled
yarn.nodemanager.vmem-check-enabled
yarn.nodemanager.vmem-pmem-ratio
yarn.nodemanager.resource.cpu-vcores
yarn.nodemanager.resource.count-logical-processors-as-cores
yarn.nodemanager.resource.pcores-vcores-multiplier
yarn.nodemanager.logaggregation.threadpool-size-max
yarn.nodemanager.resource.percentage-physical-cpu-limit
yarn.nodemanager.resource.detect-hardware-capabilities
yarn.nodemanager.webapp.address
yarn.nodemanager.webapp.https.address
yarn.nodemanager.webapp.spnego-keytab-file
yarn.nodemanager.webapp.spnego-principal
yarn.nodemanager.resource-monitor.interval-ms
yarn.nodemanager.resource-calculator.class
yarn.nodemanager.container-monitor.enabled
yarn.nodemanager.container-monitor.interval-ms
yarn.nodemanager.container-monitor.resource-calculator.class
yarn.nodemanager.health-checker.interval-ms
yarn.nodemanager.health-checker.script.timeout-ms
yarn.nodemanager.health-checker.script.path
yarn.nodemanager.health-checker.script.opts
yarn.nodemanager.disk-health-checker.interval-ms
yarn.nodemanager.disk-health-checker.min-healthy-disks
yarn.nodemanager.disk-health-checker.max-disk-utilization-per-disk-percentage
yarn.nodemanager.disk-health-checker.disk-utilization-watermark-low-per-disk-percentage
yarn.nodemanager.disk-health-checker.min-free-space-per-disk-mb
yarn.nodemanager.linux-container-executor.path
yarn.nodemanager.linux-container-executor.resources-handler.class
yarn.nodemanager.linux-container-executor.cgroups.hierarchy
yarn.nodemanager.linux-container-executor.cgroups.mount
yarn.nodemanager.linux-container-executor.cgroups.mount-path
yarn.nodemanager.linux-container-executor.cgroups.delete-delay-ms
yarn.nodemanager.linux-container-executor.nonsecure-mode.limit-users
yarn.nodemanager.linux-container-executor.nonsecure-mode.local-user
yarn.nodemanager.linux-container-executor.nonsecure-mode.user-pattern
yarn.nodemanager.linux-container-executor.cgroups.strict-resource-usage
yarn.nodemanager.runtime.linux.allowed-runtimes
yarn.nodemanager.runtime.linux.type
yarn.nodemanager.runtime.linux.docker.capabilities
yarn.nodemanager.runtime.linux.docker.image-name
yarn.nodemanager.runtime.linux.docker.privileged-containers.allowed
yarn.nodemanager.runtime.linux.docker.privileged-containers.acl
yarn.nodemanager.runtime.linux.docker.allowed-container-networks
yarn.nodemanager.runtime.linux.docker.default-container-network
yarn.nodemanager.runtime.linux.docker.host-pid-namespace.allowed
yarn.nodemanager.runtime.linux.docker.enable-userremapping.allowed
yarn.nodemanager.runtime.linux.docker.userremapping-uid-threshold
yarn.nodemanager.runtime.linux.docker.userremapping-gid-threshold
yarn.nodemanager.runtime.linux.docker.delayed-removal.allowed
yarn.nodemanager.runtime.linux.docker.stop.grace-period
yarn.nodemanager.runtime.linux.docker.default-ro-mounts
yarn.nodemanager.runtime.linux.docker.default-rw-mounts
yarn.nodemanager.runtime.linux.docker.default-tmpfs-mounts
yarn.nodemanager.runtime.linux.sandbox-mode
yarn.nodemanager.runtime.linux.sandbox-mode.local-dirs.permissions
yarn.nodemanager.runtime.linux.sandbox-mode.policy
yarn.nodemanager.runtime.linux.sandbox-mode.whitelist-group
yarn.nodemanager.windows-container.memory-limit.enabled
yarn.nodemanager.windows-container.cpu-limit.enabled
yarn.nodemanager.linux-container-executor.cgroups.delete-timeout-ms
yarn.nodemanager.log-aggregation.compression-type
yarn.nodemanager.principal
yarn.nodemanager.aux-services
yarn.nodemanager.sleep-delay-before-sigkill.ms
yarn.nodemanager.process-kill-wait.ms
yarn.nodemanager.resourcemanager.minimum.version

yarn.nodemanager.container-diagnostics-maximum-size
yarn.nodemanager.container-retry-minimum-interval-ms
yarn.client.nodemanager-client-async.thread-pool-max-size
yarn.client.nodemanager-connect.max-wait-ms
yarn.client.nodemanager-connect.retry-interval-ms
yarn.nodemanager.resourcemanager.connect.max-wait.ms
yarn.nodemanager.resourcemanager.connect.retry-interval.ms
yarn.client.max-cached-nodemanagers-proxies
yarn.nodemanager.recovery.enabled
yarn.nodemanager.recovery.dir
yarn.nodemanager.recovery.compaction-interval-secs
yarn.nodemanager.recovery.supervised
yarn.nodemanager.container-executor.os.sched.priority.adjustment
yarn.nodemanager.container-metrics.enable
yarn.nodemanager.container-metrics.period-ms
yarn.nodemanager.container-metrics.unregister-delay-ms
yarn.nodemanager.container-monitor.process-tree.class
yarn.nodemanager.disk-health-checker.enable
yarn.nodemanager.log.deletion-threads-count
yarn.nodemanager.windows-secure-container-executor.group
yarn.nodemanager.aux-services.mapreduce_shuffle.class
yarn.web-proxy.principal
yarn.web-proxy.keytab
yarn.web-proxy.address
yarn.application.classpath
yarn.timeline-service.version
yarn.timeline-service.enabled
yarn.timeline-service.hostname
yarn.timeline-service.address
yarn.timeline-service.webapp.address
yarn.timeline-service.webapp.https.address
yarn.timeline-service.bind-host
yarn.timeline-service.generic-application-history.max-applications
yarn.timeline-service.store-class
yarn.timeline-service.ttl-enable
yarn.timeline-service.ttl-ms
yarn.timeline-service.leveldb-timeline-store.path
yarn.timeline-service.leveldb-timeline-store.ttl-interval-ms
yarn.timeline-service.leveldb-timeline-store.read-cache-size
yarn.timeline-service.leveldb-timeline-store.start-time-read-cache-size
yarn.timeline-service.leveldb-timeline-store.start-time-write-cache-size
yarn.timeline-service.handler-thread-count
yarn.timeline-service.http-authentication.type
yarn.timeline-service.http-authentication.simple.anonymous.allowed
yarn.timeline-service.principal
yarn.timeline-service.keytab
yarn.timeline-service.ui-names
yarn.timeline-service.client.max-retries
yarn.timeline-service.client.best-effort
yarn.timeline-service.client.retry-interval-ms
yarn.timeline-service.client.drain-entities.timeout.ms
yarn.timeline-service.recovery.enabled
yarn.timeline-service.state-store-class
yarn.timeline-service.leveldb-state-store.path
yarn.timeline-service.entity-group-fs-store.cache-store-class
yarn.timeline-service.entity-group-fs-store.active-dir
yarn.timeline-service.entity-group-fs-store.done-dir
yarn.timeline-service.entity-group-fs-store.group-id-plugin-classes
yarn.timeline-service.entity-group-fs-store.group-id-plugin-classpath
yarn.timeline-service.entity-group-fs-store.summary-store
yarn.timeline-service.entity-group-fs-store.scan-interval-seconds
yarn.timeline-service.entity-group-fs-store.cleaner-interval-seconds
yarn.timeline-service.entity-group-fs-store.retain-seconds
yarn.timeline-service.entity-group-fs-store.leveldb-cache-read-cache-size
yarn.timeline-service.entity-group-fs-store.app-cache-size
yarn.timeline-service.client.fd-flush-interval-secs
yarn.timeline-service.client.fd-clean-interval-secs
yarn.timeline-service.client.fd-retain-secs
yarn.timeline-service.writer.class
yarn.timeline-service.reader.class
yarn.timeline-service.client.internal-timers-ttl-secs
yarn.timeline-service.writer.flush-interval-seconds
yarn.timeline-service.app-collector.linger-period.ms
yarn.timeline-service.timeline-client.number-of-async-entities-to-merge
yarn.timeline-service.hbase.coprocessor.app-final-value-retention-milliseconds
yarn.timeline-service.app-aggregation-interval-secs
yarn.timeline-service.hbase.coprocessor.jar.hdfs.location
yarn.timeline-service.hbase-schema.prefix
yarn.timeline-service.hbase.configuration.file
yarn.sharedcache.enabled
yarn.sharedcache.root-dir
yarn.sharedcache.nested-level
yarn.sharedcache.store.class
yarn.sharedcache.app-checker.class
yarn.sharedcache.store.in-memory.staleness-period-mins
yarn.sharedcache.store.in-memory.initial-delay-mins
yarn.sharedcache.store.in-memory.check-period-mins
yarn.sharedcache.admin.address
yarn.sharedcache.admin.thread-count
yarn.sharedcache.webapp.address
yarn.sharedcache.cleaner.period-mins
yarn.sharedcache.cleaner.initial-delay-mins
yarn.sharedcache.cleaner.resource-sleep-ms
yarn.sharedcache.uploader.server.address
yarn.sharedcache.uploader.server.thread-count
yarn.sharedcache.client-server.address
yarn.sharedcache.client-server.thread-count
yarn.sharedcache.checksum.algo.impl
yarn.sharedcache.nm.uploader.replication.factor
yarn.sharedcache.nm.uploader.thread-count
security.applicationhistory.protocol.acl
yarn.is.minicluster
yarn.minicluster.control-resource-monitoring
yarn.minicluster.fixed.ports
yarn.minicluster.use-rpc
yarn.minicluster.yarn.nodemanager.resource.memory-mb
yarn.node-labels.enabled
yarn.node-labels.fs-store.root-dir
yarn.node-labels.configuration-type
yarn.nodemanager.node-labels.provider
yarn.nodemanager.node-labels.provider.fetch-interval-ms
yarn.nodemanager.node-labels.resync-interval-ms
yarn.nodemanager.node-labels.provider.configured-node-partition
yarn.nodemanager.node-labels.provider.fetch-timeout-ms
yarn.resourcemanager.node-labels.provider
yarn.resourcemanager.node-labels.provider.fetch-interval-ms
yarn.nodemanager.node-attributes.provider
yarn.nodemanager.node-attributes.provider.script.path
yarn.nodemanager.node-attributes.provider.script.opts
yarn.nodemanager.node-attributes.provider.fetch-interval-ms
yarn.nodemanager.node-attributes.provider.fetch-timeout-ms
yarn.nodemanager.node-attributes.provider.configured-node-attributes
yarn.resourcemanager.nodemanager-graceful-decommission-timeout-secs
yarn.resourcemanager.decommissioning-nodes-watcher.poll-interval-secs
yarn.nodemanager.node-labels.provider.script.path
yarn.nodemanager.node-labels.provider.script.opts
yarn.federation.enabled
yarn.federation.machine-list
yarn.federation.subcluster-resolver.class
yarn.federation.state-store.class
yarn.federation.cache-ttl.secs
yarn.federation.registry.base-dir
yarn.registry.class
yarn.client.application-client-protocol.poll-interval-ms
yarn.client.application-client-protocol.poll-timeout-ms
yarn.nodemanager.container-monitor.procfs-tree.smaps-based-rss.enabled
yarn.log.server.url
yarn.log.server.web-service.url
yarn.tracking.url.generator
yarn.authorization-provider
yarn.nodemanager.log-aggregation.roll-monitoring-interval-seconds
yarn.nodemanager.log-aggregation.num-log-files-per-app
yarn.intermediate-data-encryption.enable
yarn.nodemanager.webapp.cross-origin.enabled
yarn.cluster.max-application-priority
yarn.nodemanager.log-aggregation.policy.class
yarn.nodemanager.log-aggregation.policy.parameters
yarn.nodemanager.amrmproxy.enabled
yarn.nodemanager.amrmproxy.address
yarn.nodemanager.amrmproxy.client.thread-count
yarn.nodemanager.amrmproxy.interceptor-class.pipeline
yarn.nodemanager.amrmproxy.ha.enable
yarn.nodemanager.distributed-scheduling.enabled
yarn.resourcemanager.opportunistic-container-allocation.enabled
yarn.resourcemanager.opportunistic-container-allocation.nodes-used
yarn.resourcemanager.nm-container-queuing.sorting-nodes-interval-ms
yarn.resourcemanager.nm-container-queuing.load-comparator
yarn.resourcemanager.nm-container-queuing.queue-limit-stdev
yarn.resourcemanager.nm-container-queuing.min-queue-length
yarn.resourcemanager.nm-container-queuing.max-queue-length
yarn.resourcemanager.nm-container-queuing.min-queue-wait-time-ms
yarn.resourcemanager.nm-container-queuing.max-queue-wait-time-ms
yarn.nodemanager.opportunistic-containers-use-pause-for-preemption
yarn.nodemanager.container.stderr.pattern
yarn.nodemanager.container.stderr.tail.bytes
yarn.node-labels.fs-store.impl.class
yarn.resourcemanager.webapp.rest-csrf.enabled
yarn.resourcemanager.webapp.rest-csrf.custom-header
yarn.resourcemanager.webapp.rest-csrf.methods-to-ignore
yarn.nodemanager.webapp.rest-csrf.enabled
yarn.nodemanager.webapp.rest-csrf.custom-header
yarn.nodemanager.webapp.rest-csrf.methods-to-ignore
yarn.nodemanager.disk-validator
yarn.timeline-service.webapp.rest-csrf.enabled
yarn.timeline-service.webapp.rest-csrf.custom-header
yarn.timeline-service.webapp.rest-csrf.methods-to-ignore
yarn.webapp.xfs-filter.enabled
yarn.resourcemanager.webapp.xfs-filter.xframe-options
yarn.nodemanager.webapp.xfs-filter.xframe-options
yarn.timeline-service.webapp.xfs-filter.xframe-options
yarn.resourcemanager.node-removal-untracked.timeout-ms
yarn.resourcemanager.application-timeouts.monitor.interval-ms
yarn.app.attempt.diagnostics.limit.kc
yarn.timeline-service.http-cross-origin.enabled
yarn.timeline-service.http-cross-origin.enabled
yarn.router.clientrm.interceptor-class.pipeline
yarn.router.interceptor.user.threadpool-size
yarn.router.pipeline.cache-max-size
yarn.router.rmadmin.interceptor-class.pipeline
yarn.router.bind-host
yarn.scheduler.queue-placement-rules
yarn.router.webapp.interceptor-class.pipeline
yarn.router.webapp.address
yarn.router.webapp.https.address
yarn.timeline-service.entity-group-fs-store.with-user-dir
yarn.resource-types
yarn.webapp.filter-entity-list-by-user
yarn.scheduler.configuration.store.class
yarn.scheduler.configuration.mutation.acl-policy.class
yarn.scheduler.configuration.leveldb-store.path
yarn.scheduler.configuration.leveldb-store.compaction-interval-secs
yarn.scheduler.configuration.store.max-logs
yarn.scheduler.configuration.fs.path
yarn.scheduler.configuration.max.version
yarn.scheduler.configuration.zk-store.parent-path
yarn.client.load.resource-types.from-server
yarn.nodemanager.resource-plugins.gpu.path-to-discovery-executables
yarn.nodemanager.resource-plugins
yarn.nodemanager.resource-plugins.gpu.allowed-gpu-devices
yarn.nodemanager.resource-plugins.gpu.docker-plugin
yarn.nodemanager.resource-plugins.gpu.docker-plugin.nvidia-docker-v1.endpoint
yarn.nodemanager.resource-plugins.fpga.vendor-plugin.class
yarn.nodemanager.resource-plugins.fpga.path-to-discovery-executables
yarn.nodemanager.resource-plugins.fpga.allowed-fpga-devices
yarn.timeline-service.reader.webapp.address
yarn.timeline-service.reader.webapp.https.address
yarn.timeline-service.reader.bind-host
yarn.nodemanager.numa-awareness.enabled
yarn.nodemanager.numa-awareness.read-topology
yarn.nodemanager.numa-awareness.node-ids
yarn.nodemanager.numa-awareness.numactl.cmd
yarn.nodemanager.elastic-memory-control.enabled
yarn.nodemanager.elastic-memory-control.oom-handler
yarn.nodemanager.elastic-memory-control.oom-listener.path
yarn.nodemanager.elastic-memory-control.timeout-sec
yarn.node-attribute.fs-store.root-dir
yarn.node-attribute.fs-store.impl.class

Next: How to install Hadoop in a cluster

Comments

Leave a Reply

Your email address will not be published. Required fields are marked *