Its been a while since last update for T4H. Can you please advise me when can we expect the next release?
Are there are any plans to support Apache Knox in the next version?
As I saw in the forum and Idea Pond, there are quite a few people asking for Knox support.
many thanks
I am not able to use impala,
The connection string generate with
Impala using SSL and LDAP is not good
Bad URL format. Hostname not found in authority part of the url: sirius-test.ubisoft.org:21050;ssl=true;sslTrustStore=C:. Are you missing a '/' after the hostname ?
Missing "/default"
It will be nice to have same feature as hive connection to allow us to set jdbc connection string for impala.
Thnaks
Hello,
We are using toad to connect to a Kerberized CDH cluster. With some work I've managed to get it working by copying the /etc/krb5.conf file from the cluster and saving it to c:\Windows\krb5.ini: without this file, toad fails with generic GSS exceptions.
Is it possibile to customize the location for this file?
According to java documentation the user can specify a JVM parameter (java.security.krb5.conf) but I haven't found a way to pass these to toad on startup. Any suggestion?
Thanks,
Bepi
Hello,
We are using Toad on Windows to connect to a Kerberized CDH 5.8.3.
Since our Windows PC are connected to the same domain of the cluster is it possible to configure Toad to use directly the windows ticket cache? So the user can login to the cluster without typing username/password again?
I know that the access to the windows' ticket cache from java is a grey area (it requires a register key as stated here) but does it works with toad?
Thanks,
bepi
Hi Experts,
I have downloaded Toad for Hadoop 1.5.3 ( for windows). However when adding a new ecosystem ( I use Cloudera manager), I get the error saying my CDH version 5.1 is not supported.
Is there any workaround for the same.
Thanks.
Hello guys,
I am running Toad for Appache Hadoop 1.5.3 , Virtual Box 5.0.12, and Cloudera Quickstart VM 5.8.0. to perfrom data clustering of MYSQL data in Hadoop Hive
However, I am Unable to transfer MYSQL data in Hive Database
1. First, I connect MYSQL DB , its show all tables
2. Select the Required table for execution
3. Perfrom Execution to Hive Data Conversion
4. Finally, I go this error
5. Sqoop command
sqoop export -Dsqoop.throwOnError=true --connect jdbc:mysql://localhost:3306/ twopp?useUnicode=true&characterEncoding=utf8 --username root --password-file hdfs://quickstart.cloudera:8020/user/cloudera/.tfah/SQOOP_EXPORT/20170309_134140_458/.password --num-mappers 1 --table "data" --columns T__,COL,COL_ --export-dir hdfs://quickstart.cloudera:8020/user/hive/warehouse/harendra.db/data --input-fields-terminated-by \0x1 --escaped-by \
6. Console Output
Failed to tranfer the data into hive
Please give me suggestion ASAP
Regards
Gyan
Hi,
I previously had no problem connecting Toad to Hive, but since creating a new large (74 column) table I keep getting the following error
2017-03-29 10:17:33 ERROR HiveDriverHDP2:119 - Unable to create a Hive connection
java.sql.SQLException: Could not open client transport with JDBC Uri: jdbc:hive2://gmcctd05.uk.db.com:10015: java.net.ConnectException: Connection refused: connect
at org.apache.hive.jdbc.HiveConnection.openTransport(HiveConnection.java:217)
at org.apache.hive.jdbc.HiveConnection.<init>(HiveConnection.java:155)
at org.apache.hive.jdbc.HiveDriver.connect(HiveDriver.java:105)
at java.sql.DriverManager.getConnection(Unknown Source)
at java.sql.DriverManager.getConnection(Unknown Source)
at com.dell.tfh.library.hive.hdp2.HiveDriverHDP2.newHiveConnection(HiveDriverHDP2.java:115)
at com.dell.tfh.control.hive.JDBCClient$1.run(JDBCClient.java:373)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Unknown Source)
at com.dell.tfh.control.hive.JDBCClient.createClient(JDBCClient.java:363)
at com.dell.tfh.control.hive.JDBCClient.testConnection(JDBCClient.java:1868)
at com.dell.tfh.control.connection.test.SparkTester.testConnection(SparkTester.java:40)
at com.dell.tfh.control.connection.TestableConfiguration.testConfiguration(TestableConfiguration.java:45)
at com.dell.tfh.control.service.ConnectionTesterCallable.call(ConnectionTesterCallable.java:43)
at com.dell.tfh.control.service.ConnectionTesterCallable.call(ConnectionTesterCallable.java:1)
at java.util.concurrent.FutureTask.run(Unknown Source)
at java.lang.Thread.run(Unknown Source)
Caused by: org.apache.thrift.transport.TTransportException: java.net.ConnectException: Connection refused: connect
at org.apache.thrift.transport.TSocket.open(TSocket.java:226)
at org.apache.thrift.transport.TSaslTransport.open(TSaslTransport.java:266)
at org.apache.thrift.transport.TSaslClientTransport.open(TSaslClientTransport.java:37)
at org.apache.hive.jdbc.HiveConnection.openTransport(HiveConnection.java:193)
... 16 common frames omitted
Caused by: java.net.ConnectException: Connection refused: connect
at java.net.DualStackPlainSocketImpl.connect0(Native Method)
at java.net.DualStackPlainSocketImpl.socketConnect(Unknown Source)
at java.net.AbstractPlainSocketImpl.doConnect(Unknown Source)
at java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source)
at java.net.AbstractPlainSocketImpl.connect(Unknown Source)
at java.net.PlainSocketImpl.connect(Unknown Source)
at java.net.SocksSocketImpl.connect(Unknown Source)
at java.net.Socket.connect(Unknown Source)
at org.apache.thrift.transport.TSocket.open(TSocket.java:221)
... 19 common frames omitted
2017-03-29 10:18:02 ERROR HiveDriverHDP2:119 - Unable to create a Hive connection
org.apache.hive.service.cli.HiveSQLException: Failed to open new session: java.lang.RuntimeException: java.lang.RuntimeException: java.lang.RuntimeException: Unable to instantiate org.apache.hadoop.hive.ql.metadata.SessionHiveMetaStoreClient
at org.apache.hive.jdbc.Utils.verifySuccess(Utils.java:262)
at org.apache.hive.jdbc.Utils.verifySuccess(Utils.java:253)
at org.apache.hive.jdbc.HiveConnection.openSession(HiveConnection.java:555)
at org.apache.hive.jdbc.HiveConnection.<init>(HiveConnection.java:170)
at org.apache.hive.jdbc.HiveDriver.connect(HiveDriver.java:105)
at java.sql.DriverManager.getConnection(Unknown Source)
at java.sql.DriverManager.getConnection(Unknown Source)
at com.dell.tfh.library.hive.hdp2.HiveDriverHDP2.newHiveConnection(HiveDriverHDP2.java:115)
at com.dell.tfh.control.hive.JDBCClient$1.run(JDBCClient.java:373)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Unknown Source)
at com.dell.tfh.control.hive.JDBCClient.createClient(JDBCClient.java:363)
at com.dell.tfh.control.hive.JDBCClient.testConnection(JDBCClient.java:1868)
at com.dell.tfh.control.connection.test.HiveTester.testConnection(HiveTester.java:40)
at com.dell.tfh.control.connection.TestableConfiguration.testConfiguration(TestableConfiguration.java:45)
at com.dell.tfh.control.service.ConnectionTesterCallable.call(ConnectionTesterCallable.java:43)
at com.dell.tfh.control.service.ConnectionTesterCallable.call(ConnectionTesterCallable.java:1)
at java.util.concurrent.FutureTask.run(Unknown Source)
at java.lang.Thread.run(Unknown Source)
Caused by: org.apache.hive.service.cli.HiveSQLException: Failed to open new session: java.lang.RuntimeException: java.lang.RuntimeException: java.lang.RuntimeException: Unable to instantiate org.apache.hadoop.hive.ql.metadata.SessionHiveMetaStoreClient
at org.apache.hive.service.cli.session.SessionManager.openSession(SessionManager.java:266)
at org.apache.hive.service.cli.CLIService.openSessionWithImpersonation(CLIService.java:202)
at org.apache.hive.service.cli.thrift.ThriftCLIService.getSessionHandle(ThriftCLIService.java:402)
at org.apache.hive.service.cli.thrift.ThriftCLIService.OpenSession(ThriftCLIService.java:297)
at org.apache.hive.service.cli.thrift.TCLIService$Processor$OpenSession.getResult(TCLIService.java:1253)
at org.apache.hive.service.cli.thrift.TCLIService$Processor$OpenSession.getResult(TCLIService.java:1238)
at org.apache.thrift.ProcessFunction.process(ProcessFunction.java:39)
at org.apache.thrift.TBaseProcessor.process(TBaseProcessor.java:39)
at org.apache.hive.service.auth.TSetIpAddressProcessor.process(TSetIpAddressProcessor.java:56)
at org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:285)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.RuntimeException: java.lang.RuntimeException: java.lang.RuntimeException: Unable to instantiate org.apache.hadoop.hive.ql.metadata.SessionHiveMetaStoreClient
at org.apache.hive.service.cli.session.HiveSessionProxy.invoke(HiveSessionProxy.java:83)
at org.apache.hive.service.cli.session.HiveSessionProxy.access$000(HiveSessionProxy.java:36)
at org.apache.hive.service.cli.session.HiveSessionProxy$1.run(HiveSessionProxy.java:63)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:415)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1698)
at org.apache.hive.service.cli.session.HiveSessionProxy.invoke(HiveSessionProxy.java:59)
at com.sun.proxy.$Proxy19.open(Unknown Source)
at org.apache.hive.service.cli.session.SessionManager.openSession(SessionManager.java:258)
... 12 common frames omitted
Caused by: java.lang.RuntimeException: java.lang.RuntimeException: Unable to instantiate org.apache.hadoop.hive.ql.metadata.SessionHiveMetaStoreClient
at org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.java:522)
at org.apache.hive.service.cli.session.HiveSessionImpl.open(HiveSessionImpl.java:137)
at sun.reflect.GeneratedMethodAccessor42.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at org.apache.hive.service.cli.session.HiveSessionProxy.invoke(HiveSessionProxy.java:78)
... 20 common frames omitted
Caused by: java.lang.RuntimeException: Unable to instantiate org.apache.hadoop.hive.ql.metadata.SessionHiveMetaStoreClient
at org.apache.hadoop.hive.metastore.MetaStoreUtils.newInstance(MetaStoreUtils.java:1523)
at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.<init>(RetryingMetaStoreClient.java:86)
at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.getProxy(RetryingMetaStoreClient.java:132)
at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.getProxy(RetryingMetaStoreClient.java:104)
at org.apache.hadoop.hive.ql.metadata.Hive.createMetaStoreClient(Hive.java:3005)
at org.apache.hadoop.hive.ql.metadata.Hive.getMSC(Hive.java:3024)
at org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.java:503)
... 25 common frames omitted
Caused by: java.lang.RuntimeException: java.lang.reflect.InvocationTargetException:null
at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57)
at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
at java.lang.reflect.Constructor.newInstance(Constructor.java:526)
at org.apache.hadoop.hive.metastore.MetaStoreUtils.newInstance(MetaStoreUtils.java:1521)
... 31 common frames omitted
Caused by: java.lang.OutOfMemoryError: PermGen space
2017-03-29 10:18:02 INFO DefaultExceptionParser:58 - com.dell.tfh.control.connection.test.TestException
at com.dell.tfh.control.connection.test.HiveTester.testConnection(HiveTester.java:42)
at com.dell.tfh.control.connection.TestableConfiguration.testConfiguration(TestableConfiguration.java:45)
at com.dell.tfh.control.service.ConnectionTesterCallable.call(ConnectionTesterCallable.java:43)
at com.dell.tfh.control.service.ConnectionTesterCallable.call(ConnectionTesterCallable.java:1)
at java.util.concurrent.FutureTask.run(Unknown Source)
at java.lang.Thread.run(Unknown Source)
Caused by: java.security.PrivilegedActionException: com.dell.tfh.library.hadoop.exception.HadoopDriverException: org.apache.hive.service.cli.HiveSQLException: Failed to open new session: java.lang.RuntimeException: java.lang.RuntimeException: java.lang.RuntimeException: Unable to instantiate org.apache.hadoop.hive.ql.metadata.SessionHiveMetaStoreClient
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Unknown Source)
at com.dell.tfh.control.hive.JDBCClient.createClient(JDBCClient.java:363)
at com.dell.tfh.control.hive.JDBCClient.testConnection(JDBCClient.java:1868)
at com.dell.tfh.control.connection.test.HiveTester.testConnection(HiveTester.java:40)
... 5 more
Caused by: com.dell.tfh.library.hadoop.exception.HadoopDriverException: org.apache.hive.service.cli.HiveSQLException: Failed to open new session: java.lang.RuntimeException: java.lang.RuntimeException: java.lang.RuntimeException: Unable to instantiate org.apache.hadoop.hive.ql.metadata.SessionHiveMetaStoreClient
at com.dell.tfh.library.hive.hdp2.HiveDriverHDP2.newHiveConnection(HiveDriverHDP2.java:120)
at com.dell.tfh.control.hive.JDBCClient$1.run(JDBCClient.java:373)
... 10 more
Caused by: org.apache.hive.service.cli.HiveSQLException: Failed to open new session: java.lang.RuntimeException: java.lang.RuntimeException: java.lang.RuntimeException: Unable to instantiate org.apache.hadoop.hive.ql.metadata.SessionHiveMetaStoreClient
at org.apache.hive.jdbc.Utils.verifySuccess(Utils.java:262)
at org.apache.hive.jdbc.Utils.verifySuccess(Utils.java:253)
at org.apache.hive.jdbc.HiveConnection.openSession(HiveConnection.java:555)
at org.apache.hive.jdbc.HiveConnection.<init>(HiveConnection.java:170)
at org.apache.hive.jdbc.HiveDriver.connect(HiveDriver.java:105)
at java.sql.DriverManager.getConnection(Unknown Source)
at java.sql.DriverManager.getConnection(Unknown Source)
at com.dell.tfh.library.hive.hdp2.HiveDriverHDP2.newHiveConnection(HiveDriverHDP2.java:115)
... 11 more
Caused by: org.apache.hive.service.cli.HiveSQLException: Failed to open new session: java.lang.RuntimeException: java.lang.RuntimeException: java.lang.RuntimeException: Unable to instantiate org.apache.hadoop.hive.ql.metadata.SessionHiveMetaStoreClient
at org.apache.hive.service.cli.session.SessionManager.openSession(SessionManager.java:266)
at org.apache.hive.service.cli.CLIService.openSessionWithImpersonation(CLIService.java:202)
at org.apache.hive.service.cli.thrift.ThriftCLIService.getSessionHandle(ThriftCLIService.java:402)
at org.apache.hive.service.cli.thrift.ThriftCLIService.OpenSession(ThriftCLIService.java:297)
at org.apache.hive.service.cli.thrift.TCLIService$Processor$OpenSession.getResult(TCLIService.java:1253)
at org.apache.hive.service.cli.thrift.TCLIService$Processor$OpenSession.getResult(TCLIService.java:1238)
at org.apache.thrift.ProcessFunction.process(ProcessFunction.java:39)
at org.apache.thrift.TBaseProcessor.process(TBaseProcessor.java:39)
at org.apache.hive.service.auth.TSetIpAddressProcessor.process(TSetIpAddressProcessor.java:56)
at org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:285)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.RuntimeException: java.lang.RuntimeException: java.lang.RuntimeException: Unable to instantiate org.apache.hadoop.hive.ql.metadata.SessionHiveMetaStoreClient
at org.apache.hive.service.cli.session.HiveSessionProxy.invoke(HiveSessionProxy.java:83)
at org.apache.hive.service.cli.session.HiveSessionProxy.access$000(HiveSessionProxy.java:36)
at org.apache.hive.service.cli.session.HiveSessionProxy$1.run(HiveSessionProxy.java:63)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:415)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1698)
at org.apache.hive.service.cli.session.HiveSessionProxy.invoke(HiveSessionProxy.java:59)
at com.sun.proxy.$Proxy19.open(Unknown Source)
at org.apache.hive.service.cli.session.SessionManager.openSession(SessionManager.java:258)
... 12 more
Caused by: java.lang.RuntimeException: java.lang.RuntimeException: Unable to instantiate org.apache.hadoop.hive.ql.metadata.SessionHiveMetaStoreClient
at org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.java:522)
at org.apache.hive.service.cli.session.HiveSessionImpl.open(HiveSessionImpl.java:137)
at sun.reflect.GeneratedMethodAccessor42.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at org.apache.hive.service.cli.session.HiveSessionProxy.invoke(HiveSessionProxy.java:78)
... 20 more
Caused by: java.lang.RuntimeException: Unable to instantiate org.apache.hadoop.hive.ql.metadata.SessionHiveMetaStoreClient
at org.apache.hadoop.hive.metastore.MetaStoreUtils.newInstance(MetaStoreUtils.java:1523)
at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.<init>(RetryingMetaStoreClient.java:86)
at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.getProxy(RetryingMetaStoreClient.java:132)
at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.getProxy(RetryingMetaStoreClient.java:104)
at org.apache.hadoop.hive.ql.metadata.Hive.createMetaStoreClient(Hive.java:3005)
at org.apache.hadoop.hive.ql.metadata.Hive.getMSC(Hive.java:3024)
at org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.java:503)
... 25 more
Caused by: java.lang.RuntimeException: java.lang.reflect.InvocationTargetException:null
at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57)
at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
at java.lang.reflect.Constructor.newInstance(Constructor.java:526)
at org.apache.hadoop.hive.metastore.MetaStoreUtils.newInstance(MetaStoreUtils.java:1521)
... 31 more
Caused by: java.lang.OutOfMemoryError: PermGen space
I can connect to Hive via the shell and query the table no problem.
Thanks in advance for your help,
Oliver
Toad for Hadoop is taking High CPU usage and Memory which is causing to not return data after few queries executed.
Looks like there is some background process is taking lot of CPU & RAM
Only work around I'm using is restarting Toad after few queries executed!
when query ,the state alway is submitting and not progress,but can return result
I just install Toad for Hadoop. How to connect to HUE browser in Microsoft Azure cloud
We have HUE browser URL, username, and password
Thanks
Running Toad for Apache Hadoop version 1.5.3 on Mac OSX Sierra
connecting to Cloudera 5.8 environment with 5 virtual data nodes
I have tried using FQDN and IP addresses
Quick configuration works as expected
Ecosystem Configuration works, check credentials works
use keytab option
password blank
Username and realm will be overridden by keytab, continue YES
JCE is active
When I get to the screen to the next screen
SQL, Charts, and Logs are Green
HDFS and Transfer are Red the following errors are thrown
HDFS fails:
A problem has occured. Server has invalid Kerberos principal: hdfs/c01nhvu123.nh.corp@HADOOP.NANTHEALTH.COM
when I retry
A problem has occured. Server has invalid Kerberos principal: hdfs/c01nhvu121.nh.corp@HADOOP.NANTHEALTH.COM
these are name nodes
In the toad logs I see errors like this:
!ENTRY com.dell.tfh.library.hadoop.cdh5.8 4 0 2017-06-26 10:34:44.179
!MESSAGE FrameworkEvent ERROR
!STACK 0
java.io.IOException: Exception in opening zip file: /Users/teds/Library/Containers/com.dell.ToadForApacheHadoop/Data/.eclipse/415756717_macosx_cocoa_x86_64/configuration/org.eclipse.osgi/20/0/.cp/lib/sqoop-1.4.6-cdh5.8.0.jar
Caused by: java.io.FileNotFoundException: /Users/teds/Library/Containers/com.dell.ToadForApacheHadoop/Data/.eclipse/415756717_macosx_cocoa_x86_64/configuration/org.eclipse.osgi/20/0/.cp/lib/sqoop-1.4.6-cdh5.8.0.jar (No such file or directory)
Hi
My system configurations
Toad Data point version : 4.2
system Ram : 6 GB
Harddisk : 256 GB
OS : windows 7
I am trying to compare Hive table with XSD file with Data Diff Viewer
I have connected to hive database and Drag Drop employee table to Data Diff Viewer and From other side I have loaded XSD file
The source is Hive table and target is XSD file.
In the above screen, Target Columns are not viewing ?
This my XSD Format
<?xml version="1.0" encoding="UTF-8"?>
<xs:schema attributeFormDefault="unqualified" elementFormDefault="qualified" xmlns:xs="www.w3.org/.../XMLSchema">
<xs:element name="DataTable" type="DataTableType"/>
<xs:complexType name="DataTableType">
<xs:sequence>
<xs:element type="employeeType" name="employee" maxOccurs="unbounded" minOccurs="0"/>
</xs:sequence>
</xs:complexType>
<xs:complexType name="employeeType">
<xs:sequence>
<xs:element name="eid">
<xs:simpleType>
<xs:restriction base="xs:string">
<xs:enumeration value="1201"/>
<xs:enumeration value="1202"/>
<xs:enumeration value=""/>
</xs:restriction>
</xs:simpleType>
</xs:element>
<xs:element name="name">
<xs:simpleType>
<xs:restriction base="xs:string">
<xs:enumeration value="Gopal1"/>
<xs:enumeration value="Manish2"/>
</xs:restriction>
</xs:simpleType>
</xs:element>
<xs:element name="salary">
<xs:simpleType>
<xs:restriction base="xs:string">
<xs:enumeration value="45000"/>
<xs:enumeration value="40000"/>
</xs:restriction>
</xs:simpleType>
</xs:element>
<xs:element name="destination">
<xs:simpleType>
<xs:restriction base="xs:string">
<xs:enumeration value="Technical manager"/>
<xs:enumeration value="Proof reader"/>
</xs:restriction>
</xs:simpleType>
</xs:element>
<xs:element type="xs:string" name="address1"/>
<xs:element type="xs:string" name="address2"/>
</xs:sequence>
</xs:complexType>
</xs:schema>
Is there any alternative to compare data between hive table and XSD file ?
Regards
Narendra k
select * from t;
returns over 100000 rows. i click save as csv, waiting... waiting... wait...
then, i use wireshark to capture network traffic to see what's happening.
i am totally shocked! can you guess what i have seen? there is many many thrift request "FetchResults". fetching result one row by one row!
YOU ARE DELL INC. so i thinging it is not just a trivial performance issue for you big company, but a big bug! can you fix it?
Am using 32 bit Windows OS can i have Toad for this version.
I love this tool but before I suggest it to my organization I wanted to ask if it is still in development. I noticed the last version came out last year.
This tool really stands out from a crowd of other SQL client. I was specifically looking for a client that can access logs and could not find one. Then I stumbled upon SO post and gave it a try. It is almost perfect as I can see map reduce logs but it looks like they are shown only once query is finished.
I love that I can check on jobs running and finished right from the tool. HDFS files capability and copy from oracle is pretty neat too.
thanks for such a great little tool!
I am getting below error while transferring data from HIVE to Oracle.
The table CYCLE_STATE has not been transfered:
An exception was caught.
org.apache.hadoop.ipc.RemoteException(java.io.IOException): File /user/admin/.tfah/SQOOP_EXPORT/20170821_173943_587/lib/ToadManager.jar could only be replicated to 0 nodes instead of minReplication (=1). There are 3 datanode(s) running and 3 node(s) are excluded in this operation.
I am getting below error while transferring data from Oracle to Hive
The table ban_errors has not been transfered:
Cannot start transfer execution.
UnknownHostException: HDFSNS
Hi Guys,
While connecting to CDH server using Toad I am getting this error.
HDFS configuration:
An exception was caught.
Class com.wandisco.fs.client.FusionHdfs not found
I am using CDH5.5 driver version and tried same with 5.8 both gives the same error.
All the details for Namenode and Kerberos are entered correctly. Please let us know if this is known defect.
Hi,
I am new to using Toad for Hadoop. I have installed Toad for Hadoop 1.5.3 and Hadoop 2.6 is installed on my Ubuntu VM. I am trying to create a new ecosystem by manually doing the configuration. However, not able to proceed with this and getting stuck at the first step itself and it is not able to identify the namenode FQDN.
I have attached the error screenshots for reference.
Any help is highly appreciated.
Thanks in Advance!!
Hi,
I have installed Horton Works VM.
I downloaded the toad for hadoop plugin and I try to configure.
It is not connecting, and failing at Hive host. It is telling host is not reachable.
Where as Iam able to run the queries from Hive view from Ambari page.
Please help me. and also find the attached file.
Thanks in advance.(Please visit the site to view this file)
Not able to upload/download file to/from an encrypted area on hdfs. Please suggest a resolution.
We are getting the following error message while uploading a file via toad.
We are getting the following error message
ERROR HDFSUploadHandler:288 - Error uploading HDFS file java.security.PrivilegedActionException: java.io.IOException: No KeyProvider is configured, cannot access an encrypted file
2017-10-09 18:58:54 ERROR HDFSUploadHandler:288 - Error uploading HDFS file
java.security.PrivilegedActionException: java.io.IOException: No KeyProvider is configured, cannot access an encrypted file
2017-10-09 18:58:54 INFO DefaultExceptionParser:58 - java.security.PrivilegedActionException: java.io.IOException: No KeyProvider is configured, cannot access an encrypted file
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Unknown Source)
at com.dell.tfh.control.service.HDFSService.copy(HDFSService.java:977)
at com.dell.tfh.control.service.HDFSService.uploadFile(HDFSService.java:840)
at com.dell.tfh.control.service.HDFSService.upload(HDFSService.java:893)
at com.dell.tfh.gui.hdfs.handler.HDFSUploadHandler$1.runJob(HDFSUploadHandler.java:277)
at com.dell.tfh.gui.commons.jobs.AbstractToadJob.run(AbstractToadJob.java:163)
at org.eclipse.core.internal.jobs.Worker.run(Worker.java:55)
Caused by: java.io.IOException: No KeyProvider is configured, cannot access an encrypted file
at org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(DFSClient.java:1411)
at org.apache.hadoop.hdfs.DFSClient.createWrappedOutputStream(DFSClient.java:1522)
at org.apache.hadoop.hdfs.DFSClient.createWrappedOutputStream(DFSClient.java:1507)
at org.apache.hadoop.hdfs.DistributedFileSystem$6.doCall(DistributedFileSystem.java:408)
at org.apache.hadoop.hdfs.DistributedFileSystem$6.doCall(DistributedFileSystem.java:401)
at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81)
at org.apache.hadoop.hdfs.DistributedFileSystem.create(DistributedFileSystem.java:401)
at org.apache.hadoop.hdfs.DistributedFileSystem.create(DistributedFileSystem.java:344)
at org.apache.hadoop.fs.FileSystem.create(FileSystem.java:920)
at org.apache.hadoop.fs.FileSystem.create(FileSystem.java:901)
at org.apache.hadoop.fs.FileSystem.create(FileSystem.java:798)
at com.dell.tfh.library.hadoop.cdh5.FileSystemCDH5.create(FileSystemCDH5.java:60)
at com.dell.tfh.control.service.HDFSService$22.run(HDFSService.java:980)
at com.dell.tfh.control.service.HDFSService$22.run(HDFSService.java:1)
... 8 more
Hello.
I'm a student who study data science.
Lately, I heard that Toad for Hadoop is one of the best tools when I use Impala.
So I try to download Toad for Hadoop. but It's impossible.
So, Is there anyone who can send me the install file or the URL where I can download?
I'm looking for Toad for Hadoop (Windows version.). My computer OS is Windows 7.
If there is, Please share your install file,
My Email address is lupin2000 at gmail.com
Thank you.