196 questions
-5
votes
0
answers
30
views
How to connect Apache Spark (1.6.0 on Cloudera) with Apache Hive? [closed]
I’m using Cloudera Quickstart VM which includes Apache Spark 1.6.0 and Apache Hive.
I want to connect Spark with Hive so that I can run SQL queries on my Hive tables directly from PySpark.
- 11
1
vote
0
answers
136
views
cloudera/quickstart image running in docker container is not starting and status is exited(139). How to solve it?
I'm using WSL2 with Ubuntu distro, and I was trying create a container in Docker with the Following command:
docker run --hostname=quickstart.cloudera --privileged=true -t -i -p 8888:8888 -p 7180:7180 ...
- 11
0
votes
0
answers
71
views
Permission denied error while importing a table into HDFS using Scoop
I am new to Hadoop. I have connected to Cloudera quickstart VM. I am trying to import the categories table present in MySQL retail_db in HDFS but I am getting permission denied error. Following is the ...
- 662
1
vote
0
answers
51
views
Spark Hive Integration issue with eclipse
i am using cloudera-quickstart-vm-5.12.0-0-virtualbox-disk1 for my BigData practise.
i was trying to integrate spark and hive using a scala code. this scala code is being written in windows eclipse. ...
18
votes
6
answers
8k
views
Accessing Hue on Cloudera Docker QuickStart
I have installed the cloudera quickstart using docker based on the instructions given here.
https://blog.cloudera.com/blog/2015/12/docker-is-the-new-quickstart-option-for-apache-hadoop-and-cloudera/
...
- 31.8k
1
vote
1
answer
1k
views
Installing Cloudera Quick start VM on M1 macOs
Currently I am learning Hadoop. Previously I used lab where I can access the Hadoop ecosystem.
Recently I got M1 Mac and I want to run the same through Cloudera quick start VM.
I do know that it can ...
0
votes
2
answers
1k
views
how to solve the extited code 139, for run the image cloudera/quickstart, in docker with WSL2 Ubuntu?
I'm using WSL2 with Ubuntu 20.04 distribution, and I was trying create a container in Docker with the Following command:
docker run --hostname=quickstart.cloudera --privileged=true -it -v $PWD:/src --...
- 23
0
votes
1
answer
396
views
cloudera sandbox - docker run error mac m1
I am unable to run the docker container on mac m1
Please note i was not able to run the below docker container
Reference
https://hub.docker.com/r/cloudera/sandbox-cdh
my system configuration
ram 16 gb
...
- 452
6
votes
1
answer
6k
views
Which Distribution CDH Vs HDP
I happened to work on CDH longtime back ( around 1 year) and am planning to start again.Now we had CDH , HDP and Hortonwork acquired by Cloudera .
Is HDP being developed actively ? Or Is CDH being ...
- 2,147
0
votes
1
answer
505
views
How to combine two columns on the same table using Hive
Right now I have:
Scorecard
team1
team2
Winner
Margin
Ground
Match Date
Year
ODI # 1
Australia
England
Australia
5 wickets
Melbourne
5-Jan-71
1971
ODI # 2
England
Australia
England
6 wickets
...
0
votes
1
answer
2k
views
How to get hortonworks data platform and cloudera distribution for hadoop latest version
I'm currently working on CDH5.13 (Cloudera Distribution Hadoop), and i have a couple of questions:
1- I want to get the latest version of CDH(6.3.3). When i try to download it, i have this message (...
- 69
0
votes
2
answers
527
views
ERROR Could not find value for key log4j.appender.RFA
I installed Cloudera Quickstart VM 5.13 on virtualbox and I'm trying to start hadoop server with the command sudo service hadoop-hdfs-namenode start but 'm getting this two errors:
log4j:ERROR Could ...
- 69
20
votes
1
answer
54k
views
Attempt to do update or delete using transaction manager that does not support these operations
While trying to update a data in Hive table in Cloudera Quickstart VM, I'm getting this error.
Error while compiling statement: FAILED: SemanticException [Error 10294]: Attempt to do update or ...
- 431
2
votes
2
answers
2k
views
Not able to download Cloudera
I am trying to find a link to download cloudera zip file on VMWare , but unable to get any.
Tried searching on google , on cloudera website , but in vain.
Can somebody share some views on it.
- 21
1
vote
5
answers
2k
views
virtual box installation causes error while launching
The virtual machine 'cloudera-quickstart-vm-5.12.0-0-virtualbox' has terminated unexpectedly during startup with exit code 1 (0x1). More details may be available in 'C:\Users\Sri Dhanasheelan\...
- 36
0
votes
2
answers
715
views
Not able to connect to Hue web UI from Cloudera Manager
I have installed Cloudera Express on Google cloud platform vm instance using Cloudera Manager.All the web services are running but web UI links of all services (Hue, Hbase, Spark etc.) are not loading....
0
votes
0
answers
420
views
How to speed up writing into Impala from Talend
I'm using Talend Open Studio for Big Data (7.3.1), and I write files from various sources to Cloudera Impala (Cloudera QuickStart 5.13) but that takes too much time and writes only ~3300 rows/s (take ...
- 55
8
votes
4
answers
7k
views
Virtual machine "Cloudera quick start" not booting
I have recently download "QuickStart VM" on http://www.cloudera.com
(precisely, the version of virtualbox)
This virtual machine use centOS (and my computer is a macbook air)
I can not fully start this ...
- 363
0
votes
0
answers
559
views
inserting data into partition table Error while processing statement: org.apache.hadoop.hive.ql.exec.mr.MapRedTask
So i am new to this.
I created a partition table and was trying to insert data into it
this is my main table >>>>
CREATE TABLE test1(
FIPS INT, Admin2 STRING, Province_State STRING, ...
- 1
1
vote
1
answer
2k
views
Where is the hive-site.xml in Cloudera distribution?
I would like to know where the hive-site.xml file configuration is in a Cloudera distribution.
Mainly because I would like to know where I can find out properties like:
hive.execution.engine=mr
hive....
- 2,828
2
votes
2
answers
3k
views
Hue configuration error -/etc/hue/conf.empty - Potential misconfiguration detected
Hi Experts,
I'm newbie to Hadoop , linux environment and Cloudera. I installed cloudera vm 5.7 on my machine and imported mysql data to hdfs using SQOOP. I'm trying to execute to some queries against ...
- 65
0
votes
1
answer
3k
views
Hue service error: Could not connect to quickstart.cloudera:21050
I have installed cloudera-quickstart-vm-5.13.0-0-virtualbox in virtual box.
Configuration Details:
CPU: 3 & Memory: 9000MB
Now when I launch cloudera express from terminal using command
sudo /...
- 418
0
votes
1
answer
472
views
Hive error message. Does anyone know how to fix this? [closed]
I am using cloudera for a school project where we have to upload a data set into hive. I have recieved the following error message yesterday and cant seem to find the problem. Please note I am a ...
0
votes
2
answers
645
views
Getting error in Sqoop when Import-all-tables in Cloudera Quickstart VM
I'm getting the following error when I try to import-all-tables via Sqoop:
sqoop import-all-tables -m 12 --connect "jdbc:mysql://quickstart.cloudera:3306/retail_db" --username=retail_dba --...
- 368
0
votes
1
answer
1k
views
How to download quickstart VM 5.x for virtual box for windows 10?
How to download quickstart VM 5.x for virtual box for windows 10? I have installed oracle virtual box. But for cloudera qickstart VM I am not getting any source. I have searched a lot in google and ...
3
votes
7
answers
2k
views
Unable to install spark 2.2 in Cloudera Quickstart VM (5.10)
I have followed the blog (Below mentioned) here and downloaded the parcel and put as per required.
Please let me know if any one has installed and the steps.
(https://www.cloudera.com/documentation/...
- 1,558
3
votes
4
answers
9k
views
Cloudera Hue Web UI Default password
I have downloaded Cloudera CDH 5.3 recently and now i am in need to access the HUE Web UI Portal. When i give the default username and password which belong to Cloudera admin/admin it is not working. ...
- 127
0
votes
2
answers
2k
views
How to set JAVA_HOME Cloudera quickstart for Kafka and Zookeeper
I have added Kafka service to my Cloudera cluster and when i try to start it it fails with the following error
Exception in thread "main" java.lang.UnsupportedClassVersionError: org/apache/kafka/...
- 21
0
votes
1
answer
1k
views
yarn application accepted but not running cloudera despite resource allocation
I am using a Cloudera quickstart VM 5.13.0.0 to run Spark applications in yarn-client mode. I have allocated 10GB and 3 cores to my Cloudera VM. When I submit the application, the application is ...
- 733
4
votes
2
answers
2k
views
Cloudera quickstart docker: unable to run/start the container
I am using windows 10 machine, with Docker on windows, and pulled cloudera-quickstart:latest image. while trying to run it, I am getting into below error.
can someone please suggest.
docker: Error ...
- 233
1
vote
1
answer
776
views
Cloudera manager on docker is not working
I am using cloudera quickstart vm on docker on Ubuntu 18.04LTS . While I launch the vm using run command :
sudo docker run --hostname=quickstart.cloudera --privileged=true -t -i -p 8888:8888 -p 80:80 ...
- 1,397
1
vote
1
answer
961
views
Unable to run HIVE queries
I have a table created using HIVE query in Cloudera VM, below is my DDL to create the table called incremental_tweets.
CREATE EXTERNAL TABLE incremental_tweets (
id BIGINT,
created_at STRING,
...
- 267
-2
votes
1
answer
744
views
Not able to access zeppelin 8080/8180 outside VM
This question might have answered but I am not able to solve. Need some help.
Issues: Not able to see http://127.0.0.1:8080/ outside VM but able to see http://127.0.0.1:8088/ and other ports.
I am ...
- 1,558
1
vote
1
answer
2k
views
Cloudera Manager isn't opening
I have an VM: cloudera-quickstart-vm-5.13.0-0-virtualbox, run now.
But the Cloudera Manager's Page isn't being shown.
The message: 'Attempting to connect to Cloudera Manager...'
is being shown the all ...
user2618529
3
votes
0
answers
459
views
Hadoop: MapReduce job giving java library error
When I am running any MapReduce job in Cloudera VM, below warning is occurring 4-5 times in continues manner. Please let me know how to fix it.
16/11/06 00:47:38 WARN hdfs.DFSClient: Caught ...
- 125
0
votes
1
answer
3k
views
Why impala not showing all tables created by Hive
I have imported all tables using sqoop into a Hive database "sqoop_import" able to see all tables imported successfully as below :-
hive> use sqoop_import;
OK
Time taken: 0.026 seconds
hive> ...
- 1
10
votes
1
answer
3k
views
Sqoop - Import Job failed
I am trying to import a table of 32 Million records from SQL Server to Hive via Sqoop. The connection is SQL Server is successful. But Map/Reduce job does not successfully execute. It gives the ...
- 1,015
6
votes
1
answer
4k
views
Requesting executors because tasks are backlogged
I have a spark streaming application that was running absolutely fine until yesterday and all of a sudden running into these warnings. I have the same environment and using the same code. Here are the ...
- 1,269
0
votes
1
answer
195
views
Unable to download artifactories using mvn on Cloudera VM
I am using Cloudera Quickstart VM in my Virtual Box and I noticed that the maven version was outdated. I was unable to download the artifactories using mvn clean package due to some HTTPS error which ...
- 3,023
0
votes
1
answer
3k
views
Exception in thread "main" java.lang.NoClassDefFoundError: org/apache/hadoop/fs/FSDataInputStrea
I'm pretty new on Cloudera Quick-start so sorry if my explanation will be not so clear. Anyway I'm writing a code in Java which read File from Hdfs. I build a Maven-Project and I set up all the ...
- 77
0
votes
2
answers
206
views
Not able to connect HBase
Hbase running on Cloudera-quickstart-VM also verified that Zookeeper and Hbase running by using the hbase shell but when I am trying to creating a table using java program then I am getting below ...
- 509
1
vote
2
answers
3k
views
Can't access Hbase through Hue
So, I'm trying to access HBase through Hue browser in Cloudera VM, but I'm running into a few problems. First when I open the Hue, I get this error :
Potential misconfiguration detected. Fix and ...
- 103
1
vote
0
answers
730
views
Impala Daemon Not Starting in cloudera-quickstart-vm-5.10
Impala not working in cloudera-quickstart-vm-5.10 as Impala Daemon is not starting.
Following is the status of the three required roles for Impala:
Impala Daemon is down
Impala Catalog Server has ...
- 23
0
votes
3
answers
105
views
How to write multiline in Cloudera QuickStart Terminal?
I want to write multiline using | in the terminal. I am using Cloudera quickstart VM.
val csv = spark.read.option("header",true).option("inferSchema",true).csv("hdfs://...
user14668492
0
votes
1
answer
460
views
hdfs dfs -ls No Display
I installed cloudera quickstart vm on docker. On HDFS Web UI five folders (benchmarks, hbase, tmp, user and var) are listed but when I use
hdfs dfs -ls
or
hadoop fs -ls
commands. It displays any ...
1
vote
2
answers
3k
views
start-all.sh command not found
I have just installed Cloudera VM setup for hadoop. But when I open the command prompt and want to start all daemons for hadoop using command 'start-all.sh' , I get an error stating "bash : start-all....
- 31
3
votes
2
answers
10k
views
How to check status of Spark (Standalone) services on cloudera-quickstart-vm?
I am trying to get the status of the services namely spark-master and spark-slaves running on Spark (standalone) service running on my local vm
However running sudo service spark-master status is not ...
- 3,128
-1
votes
1
answer
958
views
Cloudera quickstart CDH 5.15 cluster is RUNNING slow
I have Cloudera quickstart CDH 5.15 cluster is very slow
when i run a simple hadoop command like "hadoop fs -ls" it takes almost 20 seconds
but when i try runnnig local commands like "ls" it is very ...
3
votes
2
answers
12k
views
Why does dropna() not work?
System: Spark 1.3.0 (Anaconda Python dist.) on Cloudera Quickstart VM 5.4
Here's a Spark DataFrame:
from pyspark.sql import SQLContext
from pyspark.sql.types import *
sqlContext = SQLContext(sc)
...
- 2,934
-2
votes
1
answer
346
views
How to execute linux commands in the shell opened through /bin/bash
I am new to Linux stuff and would like to know how to run command while opening the shell through /bin/bash?
Eg the steps that I want to perform:
Step1: Run the docker exec command to start the ...
- 772