Apache Flink: How to query a relational database with the Table API?

Question

The following code snippet is taken from this blog post:

val sensorTable = ??? // can be a CSV file, Kafka topic, database, or ...

// register the table source
tEnv.registerTableSource("sensors", sensorTable)

I would like to read data from a relational database. Does Flink have a TableSource for JDBC databases?

Fabian Hueske · Accepted Answer · 2017-12-14 13:43:51Z

5

In its current version (1.4.0, Dec. 2017), Flink does not provide a built-in TableSource to ingest data from a relational database.

However, there is a JDBCInputFormat that can be used. You can either

use it to read the data from the database using the DataSet API and register the DataSet as a Table or
implement a JdbcTableSource that wraps the JdbcInputFormat. A simple implementation of a JdbcTableSource should be easy to achieve. Implementing support for parallel reads, projection or filter push-down, requires more effort.

edited Dec 14, 2017 at 13:43

answered Dec 14, 2017 at 11:11

Fabian Hueske

19k2 gold badges46 silver badges49 bronze badges

Sign up to request clarification or add additional context in comments.

2 Comments

Amit Dass Over a year ago

Please share if any scala reference code for this . I am using Flink 1.3 version .

yokus Over a year ago

Starting with Flink 1.12 the DataSet API has been soft deprecated.

Collectives™ on Stack Overflow

Apache Flink: How to query a relational database with the Table API?

1 Answer 1

2 Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

2 Comments

Your Answer

Sign up or log in

Post as a guest

Related