Pinned

1. sparkSession-demo sparkSession-demo Public

   Forked from NashTech-Labs/sparkSession-demo

2. Dataframe and dataset Dataframe and dataset

   1

   scala> val rdd1=sc.parallelize(Seq((1,3.6)))

   2

   rdd1: org.apache.spark.rdd.RDD[(Int, Double)] = ParallelCollectionRDD[0] at parallelize at <console>:24

   3

   4

   scala> val rdd2=sc.parallelize(Seq((1,1.1)))

   5

   rdd2: org.apache.spark.rdd.RDD[(Int, Double)] = ParallelCollectionRDD[1] at parallelize at <console>:24

3. PowerPlant.scala PowerPlant.scala

   1

   package com.knoldus

   2

   3

   import org.apache.spark.sql.{SaveMode, SparkSession}

   4

   import org.apache.spark.sql.functions._

   5

   import org.apache.spark.sql.types._

4. cassandra queries cassandra queries

   1

      Queries==============>

   2

   3

   4

   1. CREATE TABLE assignment.emp_details (

   5

       emp_id bigint,

5. Sample json Sample json

   1

   { "car": "supercar",

   2

    "manufacturer": "Porsche", 

   3

    "model": "911", 

   4

    "price": 135000,

   5

    "wiki": "http://en.wikipedia.org/wiki/Porsche_997" 

6. Spark-asignments Spark-asignments

   1

   val rdd_1 = sc.parallelize(Seq((1, 3.6)))

   2

     val rdd_2 = sc.parallelize(Seq((1, 1.1)))

   3

   4

     println(s"Wanted Result:", findSubOfVAlues(rdd_1, rdd_2))

   5