Using Scala version 2.10.5 (Java HotSpot(TM) Server VM, Java 1.8.0_101)
Type in expressions to have them evaluated.
Type :help for more information.
Spark context available as sc.
16/10/18 17:30:24 WARN Connection: BoneCP specified but not present in CLASSPATH (or one of dependencies)
16/10/18 17:30:24 WARN Connection: BoneCP specified but not present in CLASSPATH (or one of dependencies)
16/10/18 17:30:28 WARN ObjectStore: Version information not found in metastore. hive.metastore.schema.verification is not enabled so recording the schema version 1.2.0
16/10/18 17:30:28 WARN ObjectStore: Failed to get database default, returning NoSuchObjectException
Java HotSpot(TM) Server VM warning: You have loaded library /tmp/libnetty-transport-native-epoll1373835871422088641.so which might have disabled stack guard. The VM will try to fix the stack guard now.
It's highly recommended that you fix the library with 'execstack -c <libfile>', or link it with '-z noexecstack'.
16/10/18 17:30:29 WARN Connection: BoneCP specified but not present in CLASSPATH (or one of dependencies)
16/10/18 17:30:29 WARN Connection: BoneCP specified but not present in CLASSPATH (or one of dependencies)
SQL context available as sqlContext.
scala> val textFile = sc.textFile("README.md")
16/10/18 17:30:41 WARN SizeEstimator: Failed to check whether UseCompressedOops is set; assuming yes
textFile: org.apache.spark.rdd.RDD[String] = README.md MapPartitionsRDD[1] at textFile at <console>:27
scala> textFile.count()
res0: Long = 95
scala> textFile.first()
res1: String = # Apache Spark
scala> val linesWithSpark = textFile.filter(line => line.contains("Spark"))
linesWithSpark: org.apache.spark.rdd.RDD[String] = MapPartitionsRDD[2] at filter at <console>:29
