Hadoop on Win 10, Exception checking StorageLocation

  datanode, hadoop, windows

I have set up a local hadoop, set up a proper JAVA_HOME, HADOOP_HOME, updated PATH, and also filled in hadoop config files with:

hdfs-site.xml:

<configuration>
    <property>
        <name>dfs.replication</name>
        <value>1</value>
    </property>
    <property>
        <name>dfs.namenode.name.dir</name>
        <value>/hadoop-3.2.1/data/namenode</value>
    </property>
    <property>
        <name>dfs.datanode.data.dir</name>
        <value>file:///e:/hadoop-3.2.1/data/datanode</value>
    </property>
</configuration>

but, after formatting namenode, once I start with env/start-dfs.cmd (hadoop 3.2.1), datanode gives me an error:

2020-09-28 12:38:29,909 INFO checker.ThrottledAsyncChecker: Scheduling a check for [DISK]file:/e:/hadoop-3.2.1/data/datanode
2020-09-28 12:38:29,975 WARN checker.StorageLocationChecker: Exception checking StorageLocation [DISK]file:/e:/hadoop-3.2.1/data/datanode
java.lang.UnsatisfiedLinkError: org.apache.hadoop.io.nativeio.NativeIO$POSIX.stat(Ljava/lang/String;)Lorg/apache/hadoop/io/nativeio/NativeIO$POSIX$Stat;
        at org.apache.hadoop.io.nativeio.NativeIO$POSIX.stat(Native Method)
        at org.apache.hadoop.io.nativeio.NativeIO$POSIX.getStat(NativeIO.java:460)
        at org.apache.hadoop.fs.RawLocalFileSystem$DeprecatedRawLocalFileStatus.loadPermissionInfoByNativeIO(RawLocalFileSystem.java:821)

datanode folder is created, not read-only, and I am running it all under Admin privileges.
What might be wrong?

Source: Windows Questions

One Reply to “Hadoop on Win 10, Exception checking StorageLocation”

LEAVE A COMMENT