datos - left semi join hive

Hive Query: unión de dos tablas en tres condiciones de unión con el operador OR

Question

Estoy enfrentando un error

" FAILED: Error in semantic analysis: Line 1:101 OR not supported in JOIN currently dob "

mientras ejecuta la consulta mencionada a continuación ..

Insert Overwrite Local Directory ''./Insurance_Risk/Merged_Data'' Select f.name,s.age,f.gender,f.loc,f.marital_status,f.habits1,f.habits2,s.employement_status,s.occupation_class,s.occupation_subclass,s.occupation from sample_member_detail s Join fb_member_detail f 
On s.email=f.email or 
s.dob=f.dob 
or (f.name=s.name and f.loc = s.loc and f.occupation=s.occupation)
where s.email is not null and f.email is not null;

¿Alguien puede decirme que, en la colmena " OR " el operador puede ser utilizado o no? si no, entonces ¿cuál debería ser la consulta que dará el mismo resultado que la consulta mencionada anteriormente? Tengo 2 tablas y quiero unirme a las dos tablas en cualquiera de las tres condiciones con o operador. Por favor ayuda..

Answer 1

Sorry Hive solo admite equi-join. Siempre puede intentar seleccionar entre producto cartesiano completo de esas tablas (debe estar en modo no estricto):

Select f.name,s.age,f.gender,f.loc,f.marital_status,f.habits1,f.habits2,s.employement_status,s.occupation_class,s.occupation_subclass,s.occupation 
from sample_member_detail s join fb_member_detail f 
where (s.email=f.email 
or s.dob=f.dob 
or (f.name=s.name and f.loc = s.loc and f.occupation=s.occupation))
and s.email is not null and f.email is not null;

Answer 2

También podría usar UNION para obtener los mismos resultados:

INSERT OVERWRITE LOCAL DIRECTORY ''./Insurance_Risk/Merged_Data'' 
-- You can only UNION on subqueries
SELECT * FROM (
    SELECT f.name,
        s.age,
        f.gender,
        f.loc,
        f.marital_status,
        f.habits1,
        f.habits2,
        s.employement_status,
        s.occupation_class,
        s.occupation_subclass,
        s.occupation 
    FROM sample_member_detail s 
    JOIN fb_member_detail f 
    ON s.email=f.email 
    WHERE s.email IS NOT NULL AND f.email IS NOT NULL;

    UNION

    SELECT f.name,
        s.age,
        f.gender,
        f.loc,
        f.marital_status,
        f.habits1,
        f.habits2,
        s.employement_status,
        s.occupation_class,
        s.occupation_subclass,
        s.occupation 
    FROM sample_member_detail s 
    JOIN fb_member_detail f 
    ON s.dob=f.dob
    WHERE s.email IS NOT NULL AND f.email IS NOT NULL;

    UNION

    SELECT f.name,
        s.age,
        f.gender,
        f.loc,
        f.marital_status,
        f.habits1,
        f.habits2,
        s.employement_status,
        s.occupation_class,
        s.occupation_subclass,
        s.occupation 
    FROM sample_member_detail s 
    JOIN fb_member_detail f 
    ON f.name=s.name AND f.loc = s.loc AND f.occupation=s.occupation
    WHERE s.email IS NOT NULL AND f.email IS NOT NULL;

) subquery;