Recent questions tagged hive

0 votes

726 views

1 answer

hive - Multiple Spark applications with HiveContext

Having two separate pyspark applications that instantiate a HiveContext in place of a SQLContext lets one of the two ... know why that is? See Question&Answers more detail:os...

asked Oct 17, 2021 in Technique[技术] by 深蓝 (71.8m points)

0 votes

962 views

1 answer

hive - HiveQL: Using query results as variables

in Hive I'd like to dynamically extract information from a table, save it in a variable and further use it. ... "select max(var) from table" though. Best Question&Answers:os...

asked Oct 17, 2021 in Technique[技术] by 深蓝 (71.8m points)

0 votes

1.0k views

1 answer

hive - How to control partition size in Spark SQL

I have a requirement to load data from an Hive table using Spark SQL HiveContext and load into HDFS. By ... increase the partitions size of the SQL output. Question&Answers:os...

asked Oct 17, 2021 in Technique[技术] by 深蓝 (71.8m points)

0 votes

682 views

1 answer

hive - I am trying to write a query but it is not working with lag function

I need to do partition on aa bb cc columns order by date and need results like if the difference is more than 60 days ... -to-write-a-query-but-it-is-not-working-with-lag-function...

asked Oct 7, 2021 in Technique[技术] by 深蓝 (71.8m points)

0 votes

886 views

1 answer

hive - REPLACE() function for HiveSQL, REGEXP_REPLACE() not working as intended

I run the following statement to replace the characters of ".." to ".": CREATE TABLE TableA AS SELECT ... /replace-function-for-hivesql-regexp-replace-not-working-as-intended...

asked Oct 7, 2021 in Technique[技术] by 深蓝 (71.8m points)

0 votes

1.0k views

1 answer

hive - Percentile vs percentile_approx in SparkSQL

I am using percentile in one of my sql's but due to large data skewness, the query is failing ... /stackoverflow.com/questions/66067352/percentile-vs-percentile-approx-in-sparksql...

asked Oct 6, 2021 in Technique[技术] by 深蓝 (71.8m points)

0 votes

843 views

1 answer

hive - oozie workflow triggering a spark action failing for local scratch dir not found error

I am trying to execute a spark action from an oozie workflow. The spark action reads a Hive table data and loads ... /localscratchdir") exists in local FS. Please help on this....

asked Feb 19, 2021 in Technique[技术] by 深蓝 (71.8m points)

0 votes

961 views

1 answer

hive metastore - MinIO Cluster Integration with Spark

I have installed MinIO on three nodes cluster. I am trying to install Spark and Hive Metastore on top of it. In ... node3:8081. How to set this to fs.s3a.endpoint properties?...

asked Feb 17, 2021 in Technique[技术] by 深蓝 (71.8m points)

0 votes

2.8k views

1 answer

hive sql - how to select the first n elements in hive array column and return the selected array

Please consider a hive table - Table as mentioned below. user_id interest_array tom [a,b,c,d,g,w] bob [e,d,s,d,g ... are just corner case, I can just set them null if necessary....

asked Jan 27, 2021 in Technique[技术] by 深蓝 (71.8m points)

0 votes

1.3k views

1 answer

hive - Adding partiitons to a table in GLue Catalog

I have an external partitioned table defined in Glue catalog, with data stored in S3. When I run MSCK REPAIR ... ( 'bucketing_version'='2', 'transient_lastDdlTime'='1610446119')...

asked Jan 27, 2021 in Technique[技术] by 深蓝 (71.8m points)

0 votes

1.2k views

1 answer

hive - Transpose and add new record in SQL

SELECT COUNT(DISTINCT CASE WHEN customer_name = 'Alex' THEN item END) AS by_Alex, COUNT(DISTINCT CASE WHEN customer_name = 'Bob' ... "by_Alex" (3) and add 5 under "Count" column?...

asked Jan 27, 2021 in Technique[技术] by 深蓝 (71.8m points)

0 votes

1.7k views

1 answer

hive - Transpose and add new record in SQL

SELECT COUNT(DISTINCT CASE WHEN customer_name = 'Alex' THEN item END) AS by_Alex, COUNT(DISTINCT CASE WHEN customer_name = 'Bob' ... "by_Alex" (3) and add 5 under "Count" column?...

asked Jan 27, 2021 in Technique[技术] by 深蓝 (71.8m points)

Categories

Just Browsing Browsing

Most popular tags