196 questions
-5
votes
0
answers
30
views
How to connect Apache Spark (1.6.0 on Cloudera) with Apache Hive? [closed]
I’m using Cloudera Quickstart VM which includes Apache Spark 1.6.0 and Apache Hive.
I want to connect Spark with Hive so that I can run SQL queries on my Hive tables directly from PySpark.
- 11
1
vote
0
answers
136
views
cloudera/quickstart image running in docker container is not starting and status is exited(139). How to solve it?
I'm using WSL2 with Ubuntu distro, and I was trying create a container in Docker with the Following command:
docker run --hostname=quickstart.cloudera --privileged=true -t -i -p 8888:8888 -p 7180:7180 ...
- 11
0
votes
0
answers
71
views
Permission denied error while importing a table into HDFS using Scoop
I am new to Hadoop. I have connected to Cloudera quickstart VM. I am trying to import the categories table present in MySQL retail_db in HDFS but I am getting permission denied error. Following is the ...
- 662
1
vote
0
answers
51
views
Spark Hive Integration issue with eclipse
i am using cloudera-quickstart-vm-5.12.0-0-virtualbox-disk1 for my BigData practise.
i was trying to integrate spark and hive using a scala code. this scala code is being written in windows eclipse. ...
0
votes
1
answer
396
views
cloudera sandbox - docker run error mac m1
I am unable to run the docker container on mac m1
Please note i was not able to run the below docker container
Reference
https://hub.docker.com/r/cloudera/sandbox-cdh
my system configuration
ram 16 gb
...
- 452
0
votes
1
answer
505
views
How to combine two columns on the same table using Hive
Right now I have:
Scorecard
team1
team2
Winner
Margin
Ground
Match Date
Year
ODI # 1
Australia
England
Australia
5 wickets
Melbourne
5-Jan-71
1971
ODI # 2
England
Australia
England
6 wickets
...
1
vote
1
answer
1k
views
Installing Cloudera Quick start VM on M1 macOs
Currently I am learning Hadoop. Previously I used lab where I can access the Hadoop ecosystem.
Recently I got M1 Mac and I want to run the same through Cloudera quick start VM.
I do know that it can ...
0
votes
0
answers
420
views
How to speed up writing into Impala from Talend
I'm using Talend Open Studio for Big Data (7.3.1), and I write files from various sources to Cloudera Impala (Cloudera QuickStart 5.13) but that takes too much time and writes only ~3300 rows/s (take ...
- 55
0
votes
1
answer
2k
views
How to get hortonworks data platform and cloudera distribution for hadoop latest version
I'm currently working on CDH5.13 (Cloudera Distribution Hadoop), and i have a couple of questions:
1- I want to get the latest version of CDH(6.3.3). When i try to download it, i have this message (...
- 69
0
votes
0
answers
559
views
inserting data into partition table Error while processing statement: org.apache.hadoop.hive.ql.exec.mr.MapRedTask
So i am new to this.
I created a partition table and was trying to insert data into it
this is my main table >>>>
CREATE TABLE test1(
FIPS INT, Admin2 STRING, Province_State STRING, ...
- 1
0
votes
2
answers
1k
views
how to solve the extited code 139, for run the image cloudera/quickstart, in docker with WSL2 Ubuntu?
I'm using WSL2 with Ubuntu 20.04 distribution, and I was trying create a container in Docker with the Following command:
docker run --hostname=quickstart.cloudera --privileged=true -it -v $PWD:/src --...
- 23
0
votes
2
answers
527
views
ERROR Could not find value for key log4j.appender.RFA
I installed Cloudera Quickstart VM 5.13 on virtualbox and I'm trying to start hadoop server with the command sudo service hadoop-hdfs-namenode start but 'm getting this two errors:
log4j:ERROR Could ...
- 69
0
votes
0
answers
20
views
PigStorage() isn't storing the query output
grunt> STORE highest_rated into ‘output1’ USING PigStorage(‘,’);
<line 5, column 25> Unexpected character ''
2020-12-03 00:41:58,877 [main] ERROR org.apache.pig.tools.grunt.Grunt - ERROR ...
0
votes
3
answers
105
views
How to write multiline in Cloudera QuickStart Terminal?
I want to write multiline using | in the terminal. I am using Cloudera quickstart VM.
val csv = spark.read.option("header",true).option("inferSchema",true).csv("hdfs://...
user14668492
0
votes
1
answer
472
views
Hive error message. Does anyone know how to fix this? [closed]
I am using cloudera for a school project where we have to upload a data set into hive. I have recieved the following error message yesterday and cant seem to find the problem. Please note I am a ...
6
votes
1
answer
6k
views
Which Distribution CDH Vs HDP
I happened to work on CDH longtime back ( around 1 year) and am planning to start again.Now we had CDH , HDP and Hortonwork acquired by Cloudera .
Is HDP being developed actively ? Or Is CDH being ...
- 2,147
0
votes
2
answers
206
views
Not able to connect HBase
Hbase running on Cloudera-quickstart-VM also verified that Zookeeper and Hbase running by using the hbase shell but when I am trying to creating a table using java program then I am getting below ...
- 509
2
votes
2
answers
2k
views
Not able to download Cloudera
I am trying to find a link to download cloudera zip file on VMWare , but unable to get any.
Tried searching on google , on cloudera website , but in vain.
Can somebody share some views on it.
- 21
0
votes
1
answer
195
views
Unable to download artifactories using mvn on Cloudera VM
I am using Cloudera Quickstart VM in my Virtual Box and I noticed that the maven version was outdated. I was unable to download the artifactories using mvn clean package due to some HTTPS error which ...
- 3,023
1
vote
1
answer
2k
views
Where is the hive-site.xml in Cloudera distribution?
I would like to know where the hive-site.xml file configuration is in a Cloudera distribution.
Mainly because I would like to know where I can find out properties like:
hive.execution.engine=mr
hive....
- 2,828
0
votes
1
answer
1k
views
How to download quickstart VM 5.x for virtual box for windows 10?
How to download quickstart VM 5.x for virtual box for windows 10? I have installed oracle virtual box. But for cloudera qickstart VM I am not getting any source. I have searched a lot in google and ...
1
vote
1
answer
776
views
Cloudera manager on docker is not working
I am using cloudera quickstart vm on docker on Ubuntu 18.04LTS . While I launch the vm using run command :
sudo docker run --hostname=quickstart.cloudera --privileged=true -t -i -p 8888:8888 -p 80:80 ...
- 1,397
0
votes
1
answer
44
views
Cloudera Metric Template Location or Create Custom
I am trying to create custom metric template to reflect on chart builder. Also i need to know the configuration files where i can make changes for metrics. Is this possible or Cloudera metric ...
- 21
0
votes
0
answers
190
views
Java Consumer for Kafka in Cloudera Quickstart not working
I have a cloudera Quickstart VM. i have installed Kafka parcels using Cloudera Manager and its working fine inside the VM using console based consumer and producer.
But when i try to use java based ...
- 21
0
votes
1
answer
1k
views
yarn application accepted but not running cloudera despite resource allocation
I am using a Cloudera quickstart VM 5.13.0.0 to run Spark applications in yarn-client mode. I have allocated 10GB and 3 cores to my Cloudera VM. When I submit the application, the application is ...
- 733
0
votes
2
answers
2k
views
How to set JAVA_HOME Cloudera quickstart for Kafka and Zookeeper
I have added Kafka service to my Cloudera cluster and when i try to start it it fails with the following error
Exception in thread "main" java.lang.UnsupportedClassVersionError: org/apache/kafka/...
- 21
-2
votes
1
answer
744
views
Not able to access zeppelin 8080/8180 outside VM
This question might have answered but I am not able to solve. Need some help.
Issues: Not able to see http://127.0.0.1:8080/ outside VM but able to see http://127.0.0.1:8088/ and other ports.
I am ...
- 1,558
0
votes
1
answer
3k
views
Hue service error: Could not connect to quickstart.cloudera:21050
I have installed cloudera-quickstart-vm-5.13.0-0-virtualbox in virtual box.
Configuration Details:
CPU: 3 & Memory: 9000MB
Now when I launch cloudera express from terminal using command
sudo /...
- 418
0
votes
1
answer
117
views
I am unable to execute a mapreduce job in a Hadoop cluster
$ hadoop jar /usr/lib/hadoop/hadoop-streaming-2.6.0-cdh5.13.0.jar -file mapper.py -mapper mapper.py -file reducer.py -reducer reducer.py -input /user/cloudera/test.txt -output /user/cloudera/result
I ...
1
vote
0
answers
245
views
Unable to start Cloudera services on Cloudera Quickstart Docker
I'm trying to start up cloudera services on Cloudera's quickstart docker image (5.13.0).
I downloaded the image from Cloudera's website and did the following steps as described here: https://docs....
- 149
0
votes
1
answer
110
views
Error creating database in Cloudera Impala (Virtual machine)
I have downloaded and started the cloudera virtual machine with impala. At the time of executing the database creation statement, an error related to the catalog and state-store service appeared. ...
- 97
0
votes
0
answers
108
views
WARN util.NativeCodeLoader: Unable to load native-hadoop library in clodera-quickstart-vm
Recently installed Cloudera-quickstart-vm, while running simple hadoop commands getting below error.
I tried to check path of libraries which it is complaining for but it does not exist.
Do I need to ...
- 1
0
votes
0
answers
44
views
How to perform set() operations in combineByKey transformation
I am trying to aggregate the data on Order_date & order_status. I have written two combineByKey transformations. One of them works and the other one fails.
Below is the data snapshot of the ...
- 173
1
vote
0
answers
730
views
Impala Daemon Not Starting in cloudera-quickstart-vm-5.10
Impala not working in cloudera-quickstart-vm-5.10 as Impala Daemon is not starting.
Following is the status of the three required roles for Impala:
Impala Daemon is down
Impala Catalog Server has ...
- 23
1
vote
1
answer
2k
views
Cloudera Manager isn't opening
I have an VM: cloudera-quickstart-vm-5.13.0-0-virtualbox, run now.
But the Cloudera Manager's Page isn't being shown.
The message: 'Attempting to connect to Cloudera Manager...'
is being shown the all ...
user2618529
-2
votes
1
answer
346
views
How to execute linux commands in the shell opened through /bin/bash
I am new to Linux stuff and would like to know how to run command while opening the shell through /bin/bash?
Eg the steps that I want to perform:
Step1: Run the docker exec command to start the ...
- 772
1
vote
1
answer
137
views
Cloudera Execution Problem: Problem:Initial job has not accepted any resources
I'm trying to fetch some data from Cloudera's Quick Start Hadoop distribution (a Linux VM for us) on our SAP HANA database using SAP Spark Controller. Every time I trigger the job in HANA, it gets ...
- 486
0
votes
0
answers
340
views
Update JDK on Cloudera Quickstart VM
I just wanted to have a discussion and get some clarification about a problem I am trying to solve. As of now I have followed this documentation in order to update java on my Cloudera Quickstart VM ...
0
votes
1
answer
460
views
hdfs dfs -ls No Display
I installed cloudera quickstart vm on docker. On HDFS Web UI five folders (benchmarks, hbase, tmp, user and var) are listed but when I use
hdfs dfs -ls
or
hadoop fs -ls
commands. It displays any ...
2
votes
0
answers
640
views
Sqoop Fail In Hue Workflow
When the following sqoop import is run in command shell works well.
import --connect "jdbc:mysql://quickstart.cloudera:3306/retail_db" --username retail_dba --password cloudera -m 1 --table ...
- 1,180
0
votes
1
answer
124
views
how to install PHP7 on cloudera quickstart?
i'm trying to install php 7 on cloudera quickstart 5.13.0, i put the same commande for centos 7 but i have this error.
--> Finished Dependency Resolution Error: Package: php-common-7.0.33-2.el7....
- 1
0
votes
1
answer
943
views
Input path does not exist: hdfs://quickstart/user/hive/warehouse/products
Whilst going through the cloudera quickstart tutorial, I ran into this error:
Input path does not exist: hdfs://quickstart/user/hive/warehouse/products
The problem occurred whilst I was executing ...
- 21.6k
1
vote
1
answer
360
views
HBase coprocessor remote debugging
How to remote debug HBase coprocessor - RegionObserver?
I'm using Cloudera Quickstart.
There is a question about it, but there is no information about where to put that exec command.
Also I tried ...
- 444
0
votes
1
answer
640
views
yum update failed "StopIteration" hdr = idx.next()
Just trying a routine yup update
And first got this:
...
Cleanup : ncurses-base-5.7-3.20090208.el6.x86_64 ...
- 1,032
2
votes
0
answers
341
views
Install spark on cloudera vm
I tried to install ipython 1.2.1 using this command:
sudo easy_install ipython==1.2.1
but it failed with:
No local packages or download links found for ipython==1.2.1
error: Could not find ...
- 127
0
votes
1
answer
497
views
Cloudera Quick Start VM lacks Spark 2.0 or greater
In order to test and learn Spark functions, developers require Spark latest version. As the API's and methods earlier to version 2.0 are obsolete and no longer work in the newer version. This throws a ...
- 1,017
-1
votes
1
answer
958
views
Cloudera quickstart CDH 5.15 cluster is RUNNING slow
I have Cloudera quickstart CDH 5.15 cluster is very slow
when i run a simple hadoop command like "hadoop fs -ls" it takes almost 20 seconds
but when i try runnnig local commands like "ls" it is very ...
0
votes
1
answer
134
views
Cloudera quick start unresponsive script
I am having the following error while accessing Hue in Cloudera quick start. I have checked the connectivity and looks fine. I am hoping if anyone can direct me on how to resolve as I am a beginner to ...
- 514
0
votes
1
answer
539
views
From where or How can I download Cloudera Quick start VM 5.12
In the cloudera website I can see only the Cloudera Quick start VM 5.13.But I need Quick start VM 5.12.
From where or How can I download Quick start VM 5.12
- 27
0
votes
1
answer
3k
views
Exception in thread "main" java.lang.NoClassDefFoundError: org/apache/hadoop/fs/FSDataInputStrea
I'm pretty new on Cloudera Quick-start so sorry if my explanation will be not so clear. Anyway I'm writing a code in Java which read File from Hdfs. I build a Maven-Project and I set up all the ...
- 77