Several File Formats In spark

How to read and write using spark

1. TEXT File
2. CSV File
3. JSON File
4. PARQUET File
5. ORC File
6. AVRO File
7. SEQUENCE File

Reading and Writing several file formats in spark 2.0

After Rdd and Dataframe another abstraction is introduce in spark 2.0 called Dataset is a super set of Dataframe. 

In earlier version of spark, Spark Context was the entry point. Now from spark 2.0 onward Spark Session is the main entry point for Dataset and Dataframe.

SparkSession internally has spark context and is a combination of HiveContext,SQLContext

and is available with name spark in spark-shell

Creating SparkSession

val spark = SparkSession

                     .builder

                     .master("local")

                     .appName("Spark Job")

                     .getOrCreate()

Reading and Writing several file formats in spark 1.6