Welcome to OStack Knowledge Sharing Community for programmer and developer-Open, Learning and Share
Welcome To Ask or Share your Answers For Others

Categories

0 votes
3.4k views
in Technique[技术] by (71.8m points)

sql - How to create a connection with Oracle using Spark Scala without loading data?

Is there any standard Scala class/Object to create a simple connection with oracle database (using JDBC) but without loading a specific table ? I just want to create a simple connection then pass some query (create/update, etc.) and finally close the connection.

i have seen a code like :

val jdbcDF = spark.read
  .format("jdbc")
  .option("url", "jdbc:postgresql:dbserver")
  .option("dbtable", "schema.tablename")
  .option("user", "username")
  .option("password", "password")
  .load()

But it loads a specific table as mentionned in .option("dbtable", "schema.tablename").


与恶龙缠斗过久,自身亦成为恶龙;凝视深渊过久,深渊将回以凝视…
Welcome To Ask or Share your Answers For Others

1 Answer

0 votes
by (71.8m points)

Here are all the JDBC examples. 'write' creates the table automatically, no need to explicitly create the table, if table already behavior depends on "mode" like overwrite, append, error, no-op.

If you want to update the table like delete selected rows via spark you could create a new DF with desired rows only and write it in overwrite mode, as suggested here


与恶龙缠斗过久,自身亦成为恶龙;凝视深渊过久,深渊将回以凝视…
Welcome to OStack Knowledge Sharing Community for programmer and developer-Open, Learning and Share
Click Here to Ask a Question

...