Last active
February 8, 2024 16:46
-
-
Save d4rkc0de/0fe1307fc70178398a9d55c0fb2c91df to your computer and use it in GitHub Desktop.
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| // Hadoop | |
| Download winutils.exe and hadoop.dll: https://github.com/kontext-tech/winutils | |
| add them inside older C:\hadoop\bin | |
| add env varible hadoop.home.dir and HADOOP_HOME, with value = C:\hadoop | |
| add %HADOOP_HOME%\bin to the path | |
| add hadoop.dll to C:\Windows\system32 | |
| Make sure your JVM is 64 bit. | |
| // Spark | |
| download spark from https://spark.apache.org/downloads.html | |
| extract to C:\spark | |
| add env variable SPARK_HOME = C:\spark, and add to path %SPARK_HOME%\bin | |
| Restarted pc. |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment