如何修复22:错误:找不到:Scala中的值SparkSession?

问题描述 投票:0回答:1

我是Spark的新手,我想将CSV文件读取到数据框。

Spark 1.3.0 / Scala 2.3.0

这是我到目前为止所拥有的:

# Start Scala with CSV Package Module
spark-shell --packages com.databricks:spark-csv_2.10:1.3.0

# Import Spark Classes
import org.apache.spark.SparkContext
import org.apache.spark.SparkConf
import org.apache.spark.sql.SQLContext
import sqlCtx ._

# Create SparkConf
val conf = new SparkConf().setAppName("local").setMaster("master")
val sc = new SparkContext(conf)

# Create SQLContext
val sqlCtx = new SQLContext(sc)

# Create SparkSession and use it for all purposes:
val session = SparkSession.builder().appName("local").master("master").getOrCreate()

# Read CSV-File and turn it into Dataframe.
val df_fc = sqlContext.read.format("com.databricks.spark.csv").option("header", "true").load("/home/Desktop/test.csv")

但是在SparkSession.builder()处出现以下错误:

enter image description here^

如何解决此错误?

scala apache-spark spark-dataframe
1个回答
0
投票
© www.soinside.com 2019 - 2024. All rights reserved.