#INSTALL SPARK ON WINDOWS WITHOUT HADOOP INSTALL#

# See the License for the specific language governing permissions and # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. # distributed under the License is distributed on an 'AS IS' BASIS, # Unless required by applicable law or agreed to in writing, software # (the 'License') you may not use this file except in compliance with # The ASF licenses this file to You under the Apache License, Version 2.0 # this work for additional information regarding copyright ownership.

# Licensed to the Apache Software Foundation (ASF) under one or more Navigate to the Apache SparkвЂ™s folder with cd /path/to/spark/folder.Д®dit conf/nf file with the following configuration: 1 These commands are valid only for the current session, meaning as soon as you close the terminal they will be discarded in order to save these commands for every WSL session you need to append them to ~/.bashrc.Д¬reate a tmp log folder for Spark with mkdir -p /tmp/spark-events. Open WSL either by Start>wsl.exe or using your desired terminal. Apache SparkДownload Apache-Spark here and choose your desired version.Д®xtract the folder whenever you want, I suggest placing into a WSL folder or a Windows folder CONTAINING NO SPACES INTO THE PATH (see the image below).

#INSTALL SPARK ON WINDOWS WITHOUT HADOOP INSTALL#

Install maven with your OSвЂ™ package manger, I have Ubuntu so I use sudo apt install maven. Install JDK following my other guideвЂ™s section under Linux, here.

Latest Java Development Kit (JDK) version.

Windows Subystem Linux (I strongly recommend using version 1, because WSL2 is incompatible with Spark).

Apache Spark 3.0.1 (or latest version).

Install spark on windows without hadoop