ISSUES . APACHE . ORG {}

Analyzed Page
Matching Content Categories
CMS
Monthly Traffic Estimate
How Does Issues.apache.org Make Money
Keywords
Topics
Questions
External Links
Analytics And Tracking
Libraries
CDN Services

We are analyzing https://issues.apache.org/jira/browse/hive-2206.

Title:
[HIVE-2206] add a new optimizer for query correlation discovery and optimization - ASF JIRA
Description:
No description found...
Website Age:
30 years and 2 months (reg. 1995-04-11).

Matching Content Categories {📚}

Social Networks
Video & Online Content
Education

Content Management System {📝}

What CMS is issues.apache.org built with?

Custom-built

No common CMS systems were detected on Issues.apache.org, and no known web development framework was identified.

Traffic Estimate {📈}

What is the average monthly size of issues.apache.org audience?

🚀 Good Traffic: 50k - 100k visitors per month

Based on our best estimate, this website will receive around 50,143 visitors per month in the current month.

check SE Ranking
check Ahrefs
check Similarweb
check Ubersuggest
check Semrush

How Does Issues.apache.org Make Money? {💸}

We can't figure out the monetization strategy.

Some websites aren't about earning revenue; they're built to connect communities or raise awareness. There are numerous motivations behind creating websites. This might be one of them. Issues.apache.org could be getting rich in stealth mode, or the way it's monetizing isn't detectable.

Keywords {🔍}

comment, added, qlsrctestqueriesclientpositivecorrelationoptimizerq, qlsrctestresultsclientpositivecorrelationoptimizerqout, optimizer, correlation, hive, jira, yin, revision, query, precreation, patch, jobs, yhuai, join, huai, add, optimization, job, hivetrunkqlsrctestqueriesclientpositivecorrelationoptimizerq, hivetrunkqlsrctestresultsclientpositivecorrelationoptimizerqout, updated, input, sep, jul, queries, qlsrcjavaorgapachehadoophiveqloptimizercorrelationcorrelationoptimizerjava, discovery, jun, comments, diff, httpsreviewsfacebooknetd, brock, mapreduce, change, detail, tables, operator, test, tests, phabricator, qlsrctestresultscompilerplangroupbyqxml, correlated, key, ashutoshc, current, code, qlsrcjavaorgapachehadoophiveqlexecdemuxoperatorjava, qlsrcjavaorgapachehadoophiveqlexecmuxoperatorjava,

Topics {✒️}

java /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/optimizer/correlation /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/optimizer/correlation/abstractcorrelationprocctx thrift /hive/trunk/ql/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/ql/plan/api/operatortype template /hive/trunk/ql/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/ql/plan/api/operatortype java 1173271 trunk/ql/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/ql/plan/api/operatortype thrift ql/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/ql/plan/api/operatortype java pre-creation trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/correlationdispatchoperator java pre-creation trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/correlationmanualforwardoperator java pre-creation trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/correlationreducerdispatchoperator java pre-creation trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/correlationdispatchdesc java pre-creation trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/correlationfakereducesinkdesc java pre-creation trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/correlationmanualforwarddesc java pre-creation trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/correlationreducesinkdesc java pre-creation trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/mapredwork java pre-creation trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/correlationcompositedesc java pre-creation trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/correlationreducerdispatchdesc java pre-creation trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/correlationlocalsimulativereducesinkdesc java pre-creation trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/execreducer java pre-creation trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/correlationlocalsimulativereducesinkoperator java pre-creation trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/correlationcompositeoperator java pre-creation trunk/ql/src/java/org/apache/hadoop/hive/ql/optimizer/genmapredutils java pre-creation trunk/ql/src/test/org/apache/hadoop/hive/ql/exec/testexecdriver java pre-creation trunk/ql/src/java/org/apache/hadoop/hive/ql/optimizer/correlationoptimizer java pre-creation trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/correlationreducesinkoperator java pre-creation trunk/ql/src/java/org/apache/hadoop/hive/ql/optimizer/correlationoptimizerutils java pre-creation trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/correlationfakereducesinkoperator java /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/optimizer/physical/commonjointaskdispatcher java /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/optimizer/correlation/correlationutilities java /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/optimizer/correlation/intraquerycorrelation java /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/optimizer/correlation/reducesinkdeduplication java /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/optimizer/correlation/queryplantreetransformation java /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/optimizer/correlation/correlationoptimizer java /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/mr/execreducer java /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/correlationreducerdispatchoperator java /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/mapredwork java 1173271 trunk/ql/src/java/org/apache/hadoop/hive/ql/udf/generic/genericudafcountdistinct java /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/basereducesinkoperator java /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/correlationcompositedesc java /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/correlationreducerdispatchdesc java /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/correlationlocalsimulativereducesinkdesc java /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/execreducer java /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/operatorfactory java /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/commonjoinoperator java /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/utilities java /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/basereducesinkdesc java /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/tablescandesc java /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/correlationlocalsimulativereducesinkoperator java /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/demuxoperator java /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/groupbyoperator java /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/muxoperator java /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/uniondesc

Questions {❓}

> Could this be relaxed?
> Does this commented out code need to be kept?
> Does this have to default to false, does anything break if it's true?
> Similarly, have you tried running the tests with this set to true?
> findNextChildReduceSinkOperator can return null, do you need to check for this?
@Yongqiang: Can you have a look at my patch and give me some suggestions on how to fix it?
@Yongqiang: Can you please hold off on committing while I take another look?
Also, can this work enable or facilitate implementation of optimization which is getting discussed on HIVE-3773 ?
Any suggestion on how to address this issue?
Any thoughts on how this could be achieved ?
Can we commit now?
Can you improve it?
Could this be relaxed?
Did this jira have a short version description?
Does overwrite current results with the new results work?
Does this commented out code need to be kept?
Does this have to default to false, does anything break if it's true?
Have you got time to look at current patch?
I did not see a 24 hours waiting on the bylaw page?
I will do it when I find a revision which can pass all unit tests (btw, any suggestion on which revision should I use?
If I enable the correlation optimizer by default, which of the existing CliDriver tests are expected to fail?
If I plan to merge HIVE-2206 into the hive source code, which branch should I use?
Is it a bug or did I miss anything?
Is my understanding correct?
Is that because this optimization doesn't affect the queries in most tests, or because we don't consistently call EXPLAIN in the tests?
Is that correct?
Is there any better solution for optimizing this kind of queries?
Similarly, have you tried running the tests with this set to true?
This is a pretty big feature - can you give me sometime to review this as well ?
WHY DID I GET THIS EMAIL?
What is preventing us from enabling this by default right now?
What mappings they are tracking?
Where should I request the permission?
Would you mind removing that one as well?
Ashutoshc have you got a time to look at the patch?
Ashutoshc yhuai do you guys want to update it?
Can you help me test a few cases which the trunk on my machine cannot pass?
FindNextChildReduceSinkOperator can return null, do you need to check for this?
How about just "correlation"?
In which cases is it expected not to work, and what are the failure scenarios?
Java:1088 If we are throwing the exception do we need to print the exception?
Java:182 Why is it called NumOriginalParents?
Java:229 It will be good to add javadoc for this explaining why we should leave it as it is?
Java:250 What does this function do?
Java:334 Does this patch makes this necessary?
Java:590 Do we really need hasBeenRemoved() check?
Java:61 We should be returning list of collection not arraylist no?
Java:630 Do we still need this?
Java:710 Is this necessary?
Navis can you take a look at it and see if my changes make sense?
Net/D11097?
Org/r/2001/diff/4/?
Work is it ?
Yhuai, can you file follow-up jiras for the cases that dont work with this optimization ?

External Links {🔗}(68)

Analytics and Tracking {📊}

Facebook Pixel

Libraries {📚}

Fancybox
Foundation
jQuery
Moment.js
Raphael

CDN Services {📦}

Static

8.18s.