Quantcast
Channel: Desktop topics
Viewing all articles
Browse latest Browse all 219498

Spark+Hdinsight+1 mill rows=ODBC error

$
0
0

Hi,

I am trying to load data from Spark. The csv data file is about 50Mb, and results in a table of one million rows. 

Not a very large data set and I have no problem to load it directly as csv. However I wanted to create PoC on how Power BI works together with Spark on Azure platform.

 

It won't work and the application generates some   ODBC errors(see below). Then I fire up Tableau and it works like a charm. I even test Tableau with much larger data sets and it still works fine. 

 

I've decreased the number of rows in the table to 250K and then Power BI works again and the data gets loaded as expected.

 

Is there any limit on how much data can be loaded into Power BI desktop from Spark? Am I missing any configuration? Any help would be greatly appreciated. 

 

Best Regards

Artur 

 

 

 

Sep 05 14:46:11.594 ERROR 21192 Connection:Smiley FrustratedQLGetInfoW: [Microsoft][ODBC] (11180) SQLGetInfo property not found: 1750
Sep 05 14:46:40.318 ERROR 18192 Connection:Smiley FrustratedQLGetInfoW: [Microsoft][ODBC] (11180) SQLGetInfo property not found: 1750
Sep 05 14:47:01.520 ERROR 18192 QueryExecutor::Execute: [Microsoft][Hardy] (35) Error from server: error code: '0' error message: 'ExecuteStatement finished with operation state: ERROR_STATE'.
Sep 05 14:47:01.520 ERROR 18192 StatementState:Smiley Very HappyoExecDirect: [Microsoft][Hardy] (35) Error from server: error code: '0' error message: 'ExecuteStatement finished with operation state: ERROR_STATE'.
Sep 05 14:47:01.520 ERROR 18192 StatementStateAllocated:Smiley FrustratedQLExecDirectW: [Microsoft][Hardy] (35) Error from server: error code: '0' error message: 'ExecuteStatement finished with operation state: ERROR_STATE'.
Sep 05 14:47:01.520 ERROR 18192 Statement:Smiley FrustratedQLExecDirectW: [Microsoft][Hardy] (35) Error from server: error code: '0' error message: 'ExecuteStatement finished with operation state: ERROR_STATE'.


Viewing all articles
Browse latest Browse all 219498

Latest Images

Trending Articles



Latest Images

<script src="https://jsc.adskeeper.com/r/s/rssing.com.1596347.js" async> </script>