how to resolve Arithmetic overflow error in Databricks SQL Editor

Question

In Databricks SQL editor , I am trying to get the SUM of few 'Bigint' and 'Double' data type columns of a table. But am getting below error.

Job aborted due to stage failure: Task 0 in stage 29.0 failed 4 times, most recent 
failure: Lost task 0.3 in stage 29.0 (TID 2517) (10.128.2.66 executor 3): 
org.apache.spark.SparkArithmeticException: [ARITHMETIC_OVERFLOW] long overflow. If 
necessary set ansi_mode to "false" to bypass this error.

How to set ansi_mode from Databricks SQL editor?

I tried below in SQL editor

SET spark.sql.ansi.enabled = false

Getting below error

Error running query: org.apache.spark.sql.AnalysisException: Configuration 
spark.sql.ansi.enabled is not available.

How to resolve this Arithmetic overflow error in Databricks?

Alex Ott · Accepted Answer · 2022-09-23 18:39:30Z

4

It should be just:

set ansi_mode = false;

See documentation for supported configurations, and examples for set command.

answered Sep 23, 2022 at 18:39

Alex Ott

88.1k10 gold badges110 silver badges157 bronze badges

Sign up to request clarification or add additional context in comments.

2 Comments

kiruba Over a year ago

Thanks Alex. I updated the ansi_mode value as false through the SET command But the value is not getting updated . It still shows true for ansi_mode. Any suggestions?

Alex Ott Over a year ago

just rechecked - works for me...

Collectives™ on Stack Overflow

how to resolve Arithmetic overflow error in Databricks SQL Editor

1 Answer 1

2 Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

2 Comments

Your Answer

Sign up or log in

Post as a guest

Related