elastic / elasticsearch-hadoop

:elephant: Elasticsearch real-time search and analytics natively integrated with Hadoop

Website Github
< d i v c l a s s = " a n n o u n c e i n s t a p a p e r _ b o d y m d " d a t a - p a t h = " R E A D M E . m d " i d = " r e a d m e " > < a r t i c l e c l a s s = " m a r k d o w n - b o d y e n t r y - c o n t e n t " i t e m p r o p = " t e x t " > < h 1 > < a i d = " u s e r - c o n t e n t - e l a s t i c s e a r c h - h a d o o p - " c l a s s = " a n c h o r " h r e f = " h t t p s : / / g i t h u b . c o m / e l a s t i c / e l a s t i c s e a r c h - h a d o o p # e l a s t i c s e a r c h - h a d o o p - " a r i a - h i d d e n = " t r u e " t a r g e t = " _ b l a n k " > < s v g a r i a - h i d d e n = " t r u e " c l a s s = " o c t i c o n o c t i c o n - l i n k " h e i g h t = " 1 6 " v e r s i o n = " 1 . 1 " v i e w b o x = " 0 0 1 6 1 6 " w i d t h = " 1 6 " > < p a t h f i l l - r u l e = " e v e n o d d " d = " M 4 9 h 1 v 1 H 4 c - 1 . 5 0 - 3 - 1 . 6 9 - 3 - 3 . 5 S 2 . 5 5 3 4 3 h 4 c 1 . 4 5 0 3 1 . 6 9 3 3 . 5 0 1 . 4 1 - . 9 1 2 . 7 2 - 2 3 . 2 5 V 8 . 5 9 c . 5 8 - . 4 5 1 - 1 . 2 7 1 - 2 . 0 9 C 1 0 5 . 2 2 8 . 9 8 4 8 4 H 4 c - . 9 8 0 - 2 1 . 2 2 - 2 2 . 5 S 3 9 4 9 z m 9 - 3 h - 1 v 1 h 1 c 1 0 2 1 . 2 2 2 2 . 5 S 1 3 . 9 8 1 2 1 3 1 2 H 9 c - . 9 8 0 - 2 - 1 . 2 2 - 2 - 2 . 5 0 - . 8 3 . 4 2 - 1 . 6 4 1 - 2 . 0 9 V 6 . 2 5 c - 1 . 0 9 . 5 3 - 2 1 . 8 4 - 2 3 . 2 5 C 6 1 1 . 3 1 7 . 5 5 1 3 9 1 3 h 4 c 1 . 4 5 0 3 - 1 . 6 9 3 - 3 . 5 S 1 4 . 5 6 1 3 6 z " > < / p a t h > < / s v g > < / a > E l a s t i c s e a r c h H a d o o p < a h r e f = " h t t p s : / / t r a v i s - c i . o r g / e l a s t i c / e l a s t i c s e a r c h - h a d o o p " t a r g e t = " _ b l a n k " > < i m g s r c = " h t t p s : / / c a m o . g i t h u b u s e r c o n t e n t . c o m / 8 e f 4 c 2 c 1 4 1 0 c 5 f 1 d 7 8 5 e 3 e 1 c 4 3 7 5 9 e 9 2 4 0 9 d d 4 7 f / 6 8 7 4 7 4 7 0 7 3 3 a 2 f 2 f 7 4 7 2 6 1 7 6 6 9 7 3 2 d 6 3 6 9 2 e 6 f 7 2 6 7 2 f 6 5 6 c 6 1 7 3 7 4 6 9 6 3 2 f 6 5 6 c 6 1 7 3 7 4 6 9 6 3 7 3 6 5 6 1 7 2 6 3 6 8 2 d 6 8 6 1 6 4 6 f 6 f 7 0 2 e 7 3 7 6 6 7 3 f 6 2 7 2 6 1 6 e 6 3 6 8 3 d 6 d 6 1 7 3 7 4 6 5 7 2 " a l t = " B u i l d S t a t u s " d a t a - c a n o n i c a l - s r c = " h t t p s : / / t r a v i s - c i . o r g / e l a s t i c / e l a s t i c s e a r c h - h a d o o p . s v g ? b r a n c h = m a s t e r " s t y l e = " m a x - w i d t h : 1 0 0 % ; " > < / a > < / h 1 > < p > E l a s t i c s e a r c h r e a l - t i m e s e a r c h a n d a n a l y t i c s n a t i v e l y i n t e g r a t e d w i t h H a d o o p . S u p p o r t s < a h r e f = " h t t p s : / / g i t h u b . c o m / e l a s t i c / e l a s t i c s e a r c h - h a d o o p # m a p r e d u c e " t a r g e t = " _ b l a n k " > M a p / R e d u c e < / a > , < a h r e f = " h t t p s : / / g i t h u b . c o m / e l a s t i c / e l a s t i c s e a r c h - h a d o o p # c a s c a d i n g " t a r g e t = " _ b l a n k " > C a s c a d i n g < / a > , < a h r e f = " h t t p s : / / g i t h u b . c o m / e l a s t i c / e l a s t i c s e a r c h - h a d o o p # a p a c h e - h i v e " t a r g e t = " _ b l a n k " > A p a c h e H i v e < / a > , < a h r e f = " h t t p s : / / g i t h u b . c o m / e l a s t i c / e l a s t i c s e a r c h - h a d o o p # a p a c h e - p i g " t a r g e t = " _ b l a n k " > A p a c h e P i g < / a > , < a h r e f = " h t t p s : / / g i t h u b . c o m / e l a s t i c / e l a s t i c s e a r c h - h a d o o p # a p a c h e - s p a r k " t a r g e t = " _ b l a n k " > A p a c h e S p a r k < / a > a n d < a h r e f = " h t t p s : / / g i t h u b . c o m / e l a s t i c / e l a s t i c s e a r c h - h a d o o p # a p a c h e - s t o r m " t a r g e t = " _ b l a n k " > A p a c h e S t o r m < / a > . < / p > < p > S e e < a h r e f = " h t t p : / / w w w . e l a s t i c . c o / p r o d u c t s / h a d o o p / " t a r g e t = " _ b l a n k " > p r o j e c t p a g e < / a > a n d < a h r e f = " h t t p : / / w w w . e l a s t i c . c o / g u i d e / e n / e l a s t i c s e a r c h / h a d o o p / c u r r e n t / i n d e x . h t m l " t a r g e t = " _ b l a n k " > d o c u m e n t a t i o n < / a > f o r d e t a i l e d i n f o r m a t i o n . < / p > < h 2 > < a i d = " u s e r - c o n t e n t - r e q u i r e m e n t s " c l a s s = " a n c h o r " h r e f = " h t t p s : / / g i t h u b . c o m / e l a s t i c / e l a s t i c s e a r c h - h a d o o p # r e q u i r e m e n t s " a r i a - h i d d e n = " t r u e " t a r g e t = " _ b l a n k " > < s v g a r i a - h i d d e n = " t r u e " c l a s s = " o c t i c o n o c t i c o n - l i n k " h e i g h t = " 1 6 " v e r s i o n = " 1 . 1 " v i e w b o x = " 0 0 1 6 1 6 " w i d t h = " 1 6 " > < p a t h f i l l - r u l e = " e v e n o d d " d = " M 4 9 h 1 v 1 H 4 c - 1 . 5 0 - 3 - 1 . 6 9 - 3 - 3 . 5 S 2 . 5 5 3 4 3 h 4 c 1 . 4 5 0 3 1 . 6 9 3 3 . 5 0 1 . 4 1 - . 9 1 2 . 7 2 - 2 3 . 2 5 V 8 . 5 9 c . 5 8 - . 4 5 1 - 1 . 2 7 1 - 2 . 0 9 C 1 0 5 . 2 2 8 . 9 8 4 8 4 H 4 c - . 9 8 0 - 2 1 . 2 2 - 2 2 . 5 S 3 9 4 9 z m 9 - 3 h - 1 v 1 h 1 c 1 0 2 1 . 2 2 2 2 . 5 S 1 3 . 9 8 1 2 1 3 1 2 H 9 c - . 9 8 0 - 2 - 1 . 2 2 - 2 - 2 . 5 0 - . 8 3 . 4 2 - 1 . 6 4 1 - 2 . 0 9 V 6 . 2 5 c - 1 . 0 9 . 5 3 - 2 1 . 8 4 - 2 3 . 2 5 C 6 1 1 . 3 1 7 . 5 5 1 3 9 1 3 h 4 c 1 . 4 5 0 3 - 1 . 6 9 3 - 3 . 5 S 1 4 . 5 6 1 3 6 z " > < / p a t h > < / s v g > < / a > R e q u i r e m e n t s < / h 2 > < p > E l a s t i c s e a r c h ( < s t r o n g > 1 . x < / s t r o n g > o r h i g h e r ( 2 . x < e m > h i g h l y < / e m > r e c o m m e n d e d ) ) c l u s t e r a c c e s s i b l e t h r o u g h < a h r e f = " h t t p : / / w w w . e l a s t i c . c o / g u i d e / e n / e l a s t i c s e a r c h / r e f e r e n c e / c u r r e n t / a p i - c o n v e n t i o n s . h t m l " t a r g e t = " _ b l a n k " > R E S T < / a > . T h a t ' s i t ! S i g n i f i c a n t e f f o r t h a s b e e n i n v e s t e d t o c r e a t e a s m a l l , d e p e n d e n c y - f r e e , s e l f - c o n t a i n e d j a r t h a t c a n b e d o w n l o a d e d a n d p u t t o u s e w i t h o u t a n y d e p e n d e n c i e s . S i m p l y m a k e i t a v a i l a b l e t o y o u r j o b c l a s s p a t h a n d y o u ' r e s e t . F o r a c e r t a i n l i b r a r y , s e e t h e d e d i c a t e d < a h r e f = " h t t p : / / w w w . e l a s t i c . c o / g u i d e / e n / e l a s t i c s e a r c h / h a d o o p / c u r r e n t / r e q u i r e m e n t s . h t m l " t a r g e t = " _ b l a n k " > c h a p t e r < / a > . < / p > < p > E S - H a d o o p 6 . x a n d h i g h e r a r e c o m p a t i b l e w i t h E l a s t i c s e a r c h < s t r o n g > 1 . X < / s t r o n g > , < s t r o n g > 2 . X < / s t r o n g > , < s t r o n g > 5 . X < / s t r o n g > , a n d < s t r o n g > 6 . X < / s t r o n g > < / p > < p > E S - H a d o o p 5 . x a n d h i g h e r a r e c o m p a t i b l e w i t h E l a s t i c s e a r c h < s t r o n g > 1 . X < / s t r o n g > , < s t r o n g > 2 . X < / s t r o n g > a n d < s t r o n g > 5 . X < / s t r o n g > < / p > < p > E S - H a d o o p 2 . 2 . x a n d h i g h e r a r e c o m p a t i b l e w i t h E l a s t i c s e a r c h < s t r o n g > 1 . X < / s t r o n g > a n d < s t r o n g > 2 . X < / s t r o n g > < / p > < p > E S - H a d o o p 2 . 0 . x a n d 2 . 1 . x a r e c o m p a t i b l e w i t h E l a s t i c s e a r c h < s t r o n g > 1 . X < / s t r o n g > < e m > o n l y < / e m > < / p > < h 2 > < a i d = " u s e r - c o n t e n t - i n s t a l l a t i o n " c l a s s = " a n c h o r " h r e f = " h t t p s : / / g i t h u b . c o m / e l a s t i c / e l a s t i c s e a r c h - h a d o o p # i n s t a l l a t i o n " a r i a - h i d d e n = " t r u e " t a r g e t = " _ b l a n k " > < s v g a r i a - h i d d e n = " t r u e " c l a s s = " o c t i c o n o c t i c o n - l i n k " h e i g h t = " 1 6 " v e r s i o n = " 1 . 1 " v i e w b o x = " 0 0 1 6 1 6 " w i d t h = " 1 6 " > < p a t h f i l l - r u l e = " e v e n o d d " d = " M 4 9 h 1 v 1 H 4 c - 1 . 5 0 - 3 - 1 . 6 9 - 3 - 3 . 5 S 2 . 5 5 3 4 3 h 4 c 1 . 4 5 0 3 1 . 6 9 3 3 . 5 0 1 . 4 1 - . 9 1 2 . 7 2 - 2 3 . 2 5 V 8 . 5 9 c . 5 8 - . 4 5 1 - 1 . 2 7 1 - 2 . 0 9 C 1 0 5 . 2 2 8 . 9 8 4 8 4 H 4 c - . 9 8 0 - 2 1 . 2 2 - 2 2 . 5 S 3 9 4 9 z m 9 - 3 h - 1 v 1 h 1 c 1 0 2 1 . 2 2 2 2 . 5 S 1 3 . 9 8 1 2 1 3 1 2 H 9 c - . 9 8 0 - 2 - 1 . 2 2 - 2 - 2 . 5 0 - . 8 3 . 4 2 - 1 . 6 4 1 - 2 . 0 9 V 6 . 2 5 c - 1 . 0 9 . 5 3 - 2 1 . 8 4 - 2 3 . 2 5 C 6 1 1 . 3 1 7 . 5 5 1 3 9 1 3 h 4 c 1 . 4 5 0 3 - 1 . 6 9 3 - 3 . 5 S 1 4 . 5 6 1 3 6 z " > < / p a t h > < / s v g > < / a > I n s t a l l a t i o n < / h 2 > < h 3 > < a i d = " u s e r - c o n t e n t - s t a b l e - r e l e a s e - c u r r e n t l y - 6 0 0 - a l p h a - 2 " c l a s s = " a n c h o r " h r e f = " h t t p s : / / g i t h u b . c o m / e l a s t i c / e l a s t i c s e a r c h - h a d o o p # s t a b l e - r e l e a s e - c u r r e n t l y - 6 0 0 - a l p h a - 2 " a r i a - h i d d e n = " t r u e " t a r g e t = " _ b l a n k " > < s v g a r i a - h i d d e n = " t r u e " c l a s s = " o c t i c o n o c t i c o n - l i n k " h e i g h t = " 1 6 " v e r s i o n = " 1 . 1 " v i e w b o x = " 0 0 1 6 1 6 " w i d t h = " 1 6 " > < p a t h f i l l - r u l e = " e v e n o d d " d = " M 4 9 h 1 v 1 H 4 c - 1 . 5 0 - 3 - 1 . 6 9 - 3 - 3 . 5 S 2 . 5 5 3 4 3 h 4 c 1 . 4 5 0 3 1 . 6 9 3 3 . 5 0 1 . 4 1 - . 9 1 2 . 7 2 - 2 3 . 2 5 V 8 . 5 9 c . 5 8 - . 4 5 1 - 1 . 2 7 1 - 2 . 0 9 C 1 0 5 . 2 2 8 . 9 8 4 8 4 H 4 c - . 9 8 0 - 2 1 . 2 2 - 2 2 . 5 S 3 9 4 9 z m 9 - 3 h - 1 v 1 h 1 c 1 0 2 1 . 2 2 2 2 . 5 S 1 3 . 9 8 1 2 1 3 1 2 H 9 c - . 9 8 0 - 2 - 1 . 2 2 - 2 - 2 . 5 0 - . 8 3 . 4 2 - 1 . 6 4 1 - 2 . 0 9 V 6 . 2 5 c - 1 . 0 9 . 5 3 - 2 1 . 8 4 - 2 3 . 2 5 C 6 1 1 . 3 1 7 . 5 5 1 3 9 1 3 h 4 c 1 . 4 5 0 3 - 1 . 6 9 3 - 3 . 5 S 1 4 . 5 6 1 3 6 z " > < / p a t h > < / s v g > < / a > S t a b l e R e l e a s e ( c u r r e n t l y < c o d e > 6 . 0 . 0 - a l p h a - 2 < / c o d e > ) < / h 3 > < p > A v a i l a b l e t h r o u g h a n y M a v e n - c o m p a t i b l e t o o l : < / p > < d i v c l a s s = " h i g h l i g h t h i g h l i g h t - t e x t - x m l " > < p r e > & l t ; < s p a n c l a s s = " p l - e n t " > d e p e n d e n c y < / s p a n > & g t ; & l t ; < s p a n c l a s s = " p l - e n t " > g r o u p I d < / s p a n > & g t ; o r g . e l a s t i c s e a r c h & l t ; / < s p a n c l a s s = " p l - e n t " > g r o u p I d < / s p a n > & g t ; & l t ; < s p a n c l a s s = " p l - e n t " > a r t i f a c t I d < / s p a n > & g t ; e l a s t i c s e a r c h - h a d o o p & l t ; / < s p a n c l a s s = " p l - e n t " > a r t i f a c t I d < / s p a n > & g t ; & l t ; < s p a n c l a s s = " p l - e n t " > v e r s i o n < / s p a n > & g t ; 6 . 0 . 0 - a l p h a - 2 & l t ; / < s p a n c l a s s = " p l - e n t " > v e r s i o n < / s p a n > & g t ; & l t ; / < s p a n c l a s s = " p l - e n t " > d e p e n d e n c y < / s p a n > & g t ; < / p r e > < / d i v > < p > o r a s a s t a n d - a l o n e < a h r e f = " h t t p : / / w w w . e l a s t i c . c o / d o w n l o a d s / h a d o o p " t a r g e t = " _ b l a n k " > Z I P < / a > . < / p > < h 3 > < a i d = " u s e r - c o n t e n t - d e v e l o p m e n t - s n a p s h o t " c l a s s = " a n c h o r " h r e f = " h t t p s : / / g i t h u b . c o m / e l a s t i c / e l a s t i c s e a r c h - h a d o o p # d e v e l o p m e n t - s n a p s h o t " a r i a - h i d d e n = " t r u e " t a r g e t = " _ b l a n k " > < s v g a r i a - h i d d e n = " t r u e " c l a s s = " o c t i c o n o c t i c o n - l i n k " h e i g h t = " 1 6 " v e r s i o n = " 1 . 1 " v i e w b o x = " 0 0 1 6 1 6 " w i d t h = " 1 6 " > < p a t h f i l l - r u l e = " e v e n o d d " d = " M 4 9 h 1 v 1 H 4 c - 1 . 5 0 - 3 - 1 . 6 9 - 3 - 3 . 5 S 2 . 5 5 3 4 3 h 4 c 1 . 4 5 0 3 1 . 6 9 3 3 . 5 0 1 . 4 1 - . 9 1 2 . 7 2 - 2 3 . 2 5 V 8 . 5 9 c . 5 8 - . 4 5 1 - 1 . 2 7 1 - 2 . 0 9 C 1 0 5 . 2 2 8 . 9 8 4 8 4 H 4 c - . 9 8 0 - 2 1 . 2 2 - 2 2 . 5 S 3 9 4 9 z m 9 - 3 h - 1 v 1 h 1 c 1 0 2 1 . 2 2 2 2 . 5 S 1 3 . 9 8 1 2 1 3 1 2 H 9 c - . 9 8 0 - 2 - 1 . 2 2 - 2 - 2 . 5 0 - . 8 3 . 4 2 - 1 . 6 4 1 - 2 . 0 9 V 6 . 2 5 c - 1 . 0 9 . 5 3 - 2 1 . 8 4 - 2 3 . 2 5 C 6 1 1 . 3 1 7 . 5 5 1 3 9 1 3 h 4 c 1 . 4 5 0 3 - 1 . 6 9 3 - 3 . 5 S 1 4 . 5 6 1 3 6 z " > < / p a t h > < / s v g > < / a > D e v e l o p m e n t S n a p s h o t < / h 3 > < p > G r a b t h e l a t e s t n i g h t l y b u i l d f r o m t h e < a h r e f = " h t t p : / / o s s . s o n a t y p e . o r g / c o n t e n t / r e p o s i t o r i e s / s n a p s h o t s / o r g / e l a s t i c s e a r c h / e l a s t i c s e a r c h - h a d o o p / " t a r g e t = " _ b l a n k " > r e p o s i t o r y < / a > a g a i n t h r o u g h M a v e n : < / p > < d i v c l a s s = " h i g h l i g h t h i g h l i g h t - t e x t - x m l " > < p r e > & l t ; < s p a n c l a s s = " p l - e n t " > d e p e n d e n c y < / s p a n > & g t ; & l t ; < s p a n c l a s s = " p l - e n t " > g r o u p I d < / s p a n > & g t ; o r g . e l a s t i c s e a r c h & l t ; / < s p a n c l a s s = " p l - e n t " > g r o u p I d < / s p a n > & g t ; & l t ; < s p a n c l a s s = " p l - e n t " > a r t i f a c t I d < / s p a n > & g t ; e l a s t i c s e a r c h - h a d o o p & l t ; / < s p a n c l a s s = " p l - e n t " > a r t i f a c t I d < / s p a n > & g t ; & l t ; < s p a n c l a s s = " p l - e n t " > v e r s i o n < / s p a n > & g t ; 6 . 0 . 0 . B U I L D - S N A P S H O T & l t ; / < s p a n c l a s s = " p l - e n t " > v e r s i o n < / s p a n > & g t ; & l t ; / < s p a n c l a s s = " p l - e n t " > d e p e n d e n c y < / s p a n > & g t ; < / p r e > < / d i v > < d i v c l a s s = " h i g h l i g h t h i g h l i g h t - t e x t - x m l " > < p r e > & l t ; < s p a n c l a s s = " p l - e n t " > r e p o s i t o r i e s < / s p a n > & g t ; & l t ; < s p a n c l a s s = " p l - e n t " > r e p o s i t o r y < / s p a n > & g t ; & l t ; < s p a n c l a s s = " p l - e n t " > i d < / s p a n > & g t ; s o n a t y p e - o s s & l t ; / < s p a n c l a s s = " p l - e n t " > i d < / s p a n > & g t ; & l t ; < s p a n c l a s s = " p l - e n t " > u r l < / s p a n > & g t ; h t t p : / / o s s . s o n a t y p e . o r g / c o n t e n t / r e p o s i t o r i e s / s n a p s h o t s & l t ; / < s p a n c l a s s = " p l - e n t " > u r l < / s p a n > & g t ; & l t ; < s p a n c l a s s = " p l - e n t " > s n a p s h o t s < / s p a n > & g t ; & l t ; < s p a n c l a s s = " p l - e n t " > e n a b l e d < / s p a n > & g t ; t r u e & l t ; / < s p a n c l a s s = " p l - e n t " > e n a b l e d < / s p a n > & g t ; & l t ; / < s p a n c l a s s = " p l - e n t " > s n a p s h o t s < / s p a n > & g t ; & l t ; / < s p a n c l a s s = " p l - e n t " > r e p o s i t o r y < / s p a n > & g t ; & l t ; / < s p a n c l a s s = " p l - e n t " > r e p o s i t o r i e s < / s p a n > & g t ; < / p r e > < / d i v > < p > o r < a h r e f = " h t t p s : / / g i t h u b . c o m / e l a s t i c / e l a s t i c s e a r c h - h a d o o p # b u i l d i n g - t h e - s o u r c e " t a r g e t = " _ b l a n k " > b u i l d < / a > t h e p r o j e c t y o u r s e l f . < / p > < p > W e d o b u i l d a n d t e s t t h e c o d e o n < e m > e a c h < / e m > c o m m i t . < / p > < h 3 > < a i d = " u s e r - c o n t e n t - h a d o o p - 2 0 y a r n " c l a s s = " a n c h o r " h r e f = " h t t p s : / / g i t h u b . c o m / e l a s t i c / e l a s t i c s e a r c h - h a d o o p # h a d o o p - 2 0 y a r n " a r i a - h i d d e n = " t r u e " t a r g e t = " _ b l a n k " > < s v g a r i a - h i d d e n = " t r u e " c l a s s = " o c t i c o n o c t i c o n - l i n k " h e i g h t = " 1 6 " v e r s i o n = " 1 . 1 " v i e w b o x = " 0 0 1 6 1 6 " w i d t h = " 1 6 " > < p a t h f i l l - r u l e = " e v e n o d d " d = " M 4 9 h 1 v 1 H 4 c - 1 . 5 0 - 3 - 1 . 6 9 - 3 - 3 . 5 S 2 . 5 5 3 4 3 h 4 c 1 . 4 5 0 3 1 . 6 9 3 3 . 5 0 1 . 4 1 - . 9 1 2 . 7 2 - 2 3 . 2 5 V 8 . 5 9 c . 5 8 - . 4 5 1 - 1 . 2 7 1 - 2 . 0 9 C 1 0 5 . 2 2 8 . 9 8 4 8 4 H 4 c - . 9 8 0 - 2 1 . 2 2 - 2 2 . 5 S 3 9 4 9 z m 9 - 3 h - 1 v 1 h 1 c 1 0 2 1 . 2 2 2 2 . 5 S 1 3 . 9 8 1 2 1 3 1 2 H 9 c - . 9 8 0 - 2 - 1 . 2 2 - 2 - 2 . 5 0 - . 8 3 . 4 2 - 1 . 6 4 1 - 2 . 0 9 V 6 . 2 5 c - 1 . 0 9 . 5 3 - 2 1 . 8 4 - 2 3 . 2 5 C 6 1 1 . 3 1 7 . 5 5 1 3 9 1 3 h 4 c 1 . 4 5 0 3 - 1 . 6 9 3 - 3 . 5 S 1 4 . 5 6 1 3 6 z " > < / p a t h > < / s v g > < / a > H a d o o p 2 . 0 / Y A R N < / h 3 > < p > A l r e a d y s u p p o r t e d - i t d o e s n o t m a t t e r i f y o u a r e u s i n g H a d o o p 1 . x o r 2 . x , t h e s a m e j a r w o r k s a c r o s s b o t h H a d o o p e n v i r o n m e n t s . M o r e i n f o r m a t i o n i n t h i s < a h r e f = " h t t p : / / w w w . e l a s t i c . c o / g u i d e / e n / e l a s t i c s e a r c h / h a d o o p / c u r r e n t / i n s t a l l . h t m l " t a r g e t = " _ b l a n k " > s e c t i o n < / a > . < / p > < h 2 > < a i d = " u s e r - c o n t e n t - f e e d b a c k - - q a " c l a s s = " a n c h o r " h r e f = " h t t p s : / / g i t h u b . c o m / e l a s t i c / e l a s t i c s e a r c h - h a d o o p # f e e d b a c k - - q a " a r i a - h i d d e n = " t r u e " t a r g e t = " _ b l a n k " > < s v g a r i a - h i d d e n = " t r u e " c l a s s = " o c t i c o n o c t i c o n - l i n k " h e i g h t = " 1 6 " v e r s i o n = " 1 . 1 " v i e w b o x = " 0 0 1 6 1 6 " w i d t h = " 1 6 " > < p a t h f i l l - r u l e = " e v e n o d d " d = " M 4 9 h 1 v 1 H 4 c - 1 . 5 0 - 3 - 1 . 6 9 - 3 - 3 . 5 S 2 . 5 5 3 4 3 h 4 c 1 . 4 5 0 3 1 . 6 9 3 3 . 5 0 1 . 4 1 - . 9 1 2 . 7 2 - 2 3 . 2 5 V 8 . 5 9 c . 5 8 - . 4 5 1 - 1 . 2 7 1 - 2 . 0 9 C 1 0 5 . 2 2 8 . 9 8 4 8 4 H 4 c - . 9 8 0 - 2 1 . 2 2 - 2 2 . 5 S 3 9 4 9 z m 9 - 3 h - 1 v 1 h 1 c 1 0 2 1 . 2 2 2 2 . 5 S 1 3 . 9 8 1 2 1 3 1 2 H 9 c - . 9 8 0 - 2 - 1 . 2 2 - 2 - 2 . 5 0 - . 8 3 . 4 2 - 1 . 6 4 1 - 2 . 0 9 V 6 . 2 5 c - 1 . 0 9 . 5 3 - 2 1 . 8 4 - 2 3 . 2 5 C 6 1 1 . 3 1 7 . 5 5 1 3 9 1 3 h 4 c 1 . 4 5 0 3 - 1 . 6 9 3 - 3 . 5 S 1 4 . 5 6 1 3 6 z " > < / p a t h > < / s v g > < / a > F e e d b a c k / Q & a m p ; A < / h 2 > < p > W e ' r e i n t e r e s t e d i n y o u r f e e d b a c k ! Y o u c a n f i n d u s o n t h e U s e r < a h r e f = " h t t p s : / / g r o u p s . g o o g l e . c o m / f o r u m / ? f r o m g r o u p s # ! f o r u m / e l a s t i c s e a r c h " t a r g e t = " _ b l a n k " > m a i l i n g l i s t < / a > - p l e a s e a p p e n d < c o d e > [ H a d o o p ] < / c o d e > t o t h e p o s t s u b j e c t t o f i l t e r i t o u t . F o r m o r e d e t a i l s , s e e t h e < a h r e f = " h t t p : / / w w w . e l a s t i c . c o / c o m m u n i t y " t a r g e t = " _ b l a n k " > c o m m u n i t y < / a > p a g e . < / p > < h 2 > < a i d = " u s e r - c o n t e n t - o n l i n e - d o c u m e n t a t i o n " c l a s s = " a n c h o r " h r e f = " h t t p s : / / g i t h u b . c o m / e l a s t i c / e l a s t i c s e a r c h - h a d o o p # o n l i n e - d o c u m e n t a t i o n " a r i a - h i d d e n = " t r u e " t a r g e t = " _ b l a n k " > < s v g a r i a - h i d d e n = " t r u e " c l a s s = " o c t i c o n o c t i c o n - l i n k " h e i g h t = " 1 6 " v e r s i o n = " 1 . 1 " v i e w b o x = " 0 0 1 6 1 6 " w i d t h = " 1 6 " > < p a t h f i l l - r u l e = " e v e n o d d " d = " M 4 9 h 1 v 1 H 4 c - 1 . 5 0 - 3 - 1 . 6 9 - 3 - 3 . 5 S 2 . 5 5 3 4 3 h 4 c 1 . 4 5 0 3 1 . 6 9 3 3 . 5 0 1 . 4 1 - . 9 1 2 . 7 2 - 2 3 . 2 5 V 8 . 5 9 c . 5 8 - . 4 5 1 - 1 . 2 7 1 - 2 . 0 9 C 1 0 5 . 2 2 8 . 9 8 4 8 4 H 4 c - . 9 8 0 - 2 1 . 2 2 - 2 2 . 5 S 3 9 4 9 z m 9 - 3 h - 1 v 1 h 1 c 1 0 2 1 . 2 2 2 2 . 5 S 1 3 . 9 8 1 2 1 3 1 2 H 9 c - . 9 8 0 - 2 - 1 . 2 2 - 2 - 2 . 5 0 - . 8 3 . 4 2 - 1 . 6 4 1 - 2 . 0 9 V 6 . 2 5 c - 1 . 0 9 . 5 3 - 2 1 . 8 4 - 2 3 . 2 5 C 6 1 1 . 3 1 7 . 5 5 1 3 9 1 3 h 4 c 1 . 4 5 0 3 - 1 . 6 9 3 - 3 . 5 S 1 4 . 5 6 1 3 6 z " > < / p a t h > < / s v g > < / a > O n l i n e D o c u m e n t a t i o n < / h 2 > < p > T h e l a t e s t r e f e r e n c e d o c u m e n t a t i o n i s a v a i l a b l e o n l i n e o n t h e p r o j e c t < a h r e f = " h t t p : / / w w w . e l a s t i c . c o / g u i d e / e n / e l a s t i c s e a r c h / h a d o o p / i n d e x . h t m l " t a r g e t = " _ b l a n k " > h o m e p a g e < / a > . B e l o w t h e R E A D M E c o n t a i n s < e m > b a s i c < / e m > u s a g e i n s t r u c t i o n s a t a g l a n c e . < / p > < h 2 > < a i d = " u s e r - c o n t e n t - u s a g e " c l a s s = " a n c h o r " h r e f = " h t t p s : / / g i t h u b . c o m / e l a s t i c / e l a s t i c s e a r c h - h a d o o p # u s a g e " a r i a - h i d d e n = " t r u e " t a r g e t = " _ b l a n k " > < s v g a r i a - h i d d e n = " t r u e " c l a s s = " o c t i c o n o c t i c o n - l i n k " h e i g h t = " 1 6 " v e r s i o n = " 1 . 1 " v i e w b o x = " 0 0 1 6 1 6 " w i d t h = " 1 6 " > < p a t h f i l l - r u l e = " e v e n o d d " d = " M 4 9 h 1 v 1 H 4 c - 1 . 5 0 - 3 - 1 . 6 9 - 3 - 3 . 5 S 2 . 5 5 3 4 3 h 4 c 1 . 4 5 0 3 1 . 6 9 3 3 . 5 0 1 . 4 1 - . 9 1 2 . 7 2 - 2 3 . 2 5 V 8 . 5 9 c . 5 8 - . 4 5 1 - 1 . 2 7 1 - 2 . 0 9 C 1 0 5 . 2 2 8 . 9 8 4 8 4 H 4 c - . 9 8 0 - 2 1 . 2 2 - 2 2 . 5 S 3 9 4 9 z m 9 - 3 h - 1 v 1 h 1 c 1 0 2 1 . 2 2 2 2 . 5 S 1 3 . 9 8 1 2 1 3 1 2 H 9 c - . 9 8 0 - 2 - 1 . 2 2 - 2 - 2 . 5 0 - . 8 3 . 4 2 - 1 . 6 4 1 - 2 . 0 9 V 6 . 2 5 c - 1 . 0 9 . 5 3 - 2 1 . 8 4 - 2 3 . 2 5 C 6 1 1 . 3 1 7 . 5 5 1 3 9 1 3 h 4 c 1 . 4 5 0 3 - 1 . 6 9 3 - 3 . 5 S 1 4 . 5 6 1 3 6 z " > < / p a t h > < / s v g > < / a > U s a g e < / h 2 > < h 3 > < a i d = " u s e r - c o n t e n t - c o n f i g u r a t i o n - p r o p e r t i e s " c l a s s = " a n c h o r " h r e f = " h t t p s : / / g i t h u b . c o m / e l a s t i c / e l a s t i c s e a r c h - h a d o o p # c o n f i g u r a t i o n - p r o p e r t i e s " a r i a - h i d d e n = " t r u e " t a r g e t = " _ b l a n k " > < s v g a r i a - h i d d e n = " t r u e " c l a s s = " o c t i c o n o c t i c o n - l i n k " h e i g h t = " 1 6 " v e r s i o n = " 1 . 1 " v i e w b o x = " 0 0 1 6 1 6 " w i d t h = " 1 6 " > < p a t h f i l l - r u l e = " e v e n o d d " d = " M 4 9 h 1 v 1 H 4 c - 1 . 5 0 - 3 - 1 . 6 9 - 3 - 3 . 5 S 2 . 5 5 3 4 3 h 4 c 1 . 4 5 0 3 1 . 6 9 3 3 . 5 0 1 . 4 1 - . 9 1 2 . 7 2 - 2 3 . 2 5 V 8 . 5 9 c . 5 8 - . 4 5 1 - 1 . 2 7 1 - 2 . 0 9 C 1 0 5 . 2 2 8 . 9 8 4 8 4 H 4 c - . 9 8 0 - 2 1 . 2 2 - 2 2 . 5 S 3 9 4 9 z m 9 - 3 h - 1 v 1 h 1 c 1 0 2 1 . 2 2 2 2 . 5 S 1 3 . 9 8 1 2 1 3 1 2 H 9 c - . 9 8 0 - 2 - 1 . 2 2 - 2 - 2 . 5 0 - . 8 3 . 4 2 - 1 . 6 4 1 - 2 . 0 9 V 6 . 2 5 c - 1 . 0 9 . 5 3 - 2 1 . 8 4 - 2 3 . 2 5 C 6 1 1 . 3 1 7 . 5 5 1 3 9 1 3 h 4 c 1 . 4 5 0 3 - 1 . 6 9 3 - 3 . 5 S 1 4 . 5 6 1 3 6 z " > < / p a t h > < / s v g > < / a > C o n f i g u r a t i o n P r o p e r t i e s < / h 3 > < p > A l l c o n f i g u r a t i o n p r o p e r t i e s s t a r t w i t h < c o d e > e s < / c o d e > p r e f i x . N o t e t h a t t h e < c o d e > e s . i n t e r n a l < / c o d e > n a m e s p a c e i s r e s e r v e d f o r t h e l i b r a r y i n t e r n a l u s e a n d s h o u l d < e m > n o t < / e m > b e u s e d b y t h e u s e r a t a n y p o i n t . T h e p r o p e r t i e s a r e r e a d m a i n l y f r o m t h e H a d o o p c o n f i g u r a t i o n b u t t h e u s e r c a n s p e c i f y ( s o m e o f ) t h e m d i r e c t l y d e p e n d i n g o n t h e l i b r a r y u s e d . < / p > < h 3 > < a i d = " u s e r - c o n t e n t - r e q u i r e d " c l a s s = " a n c h o r " h r e f = " h t t p s : / / g i t h u b . c o m / e l a s t i c / e l a s t i c s e a r c h - h a d o o p # r e q u i r e d " a r i a - h i d d e n = " t r u e " t a r g e t = " _ b l a n k " > < s v g a r i a - h i d d e n = " t r u e " c l a s s = " o c t i c o n o c t i c o n - l i n k " h e i g h t = " 1 6 " v e r s i o n = " 1 . 1 " v i e w b o x = " 0 0 1 6 1 6 " w i d t h = " 1 6 " > < p a t h f i l l - r u l e = " e v e n o d d " d = " M 4 9 h 1 v 1 H 4 c - 1 . 5 0 - 3 - 1 . 6 9 - 3 - 3 . 5 S 2 . 5 5 3 4 3 h 4 c 1 . 4 5 0 3 1 . 6 9 3 3 . 5 0 1 . 4 1 - . 9 1 2 . 7 2 - 2 3 . 2 5 V 8 . 5 9 c . 5 8 - . 4 5 1 - 1 . 2 7 1 - 2 . 0 9 C 1 0 5 . 2 2 8 . 9 8 4 8 4 H 4 c - . 9 8 0 - 2 1 . 2 2 - 2 2 . 5 S 3 9 4 9 z m 9 - 3 h - 1 v 1 h 1 c 1 0 2 1 . 2 2 2 2 . 5 S 1 3 . 9 8 1 2 1 3 1 2 H 9 c - . 9 8 0 - 2 - 1 . 2 2 - 2 - 2 . 5 0 - . 8 3 . 4 2 - 1 . 6 4 1 - 2 . 0 9 V 6 . 2 5 c - 1 . 0 9 . 5 3 - 2 1 . 8 4 - 2 3 . 2 5 C 6 1 1 . 3 1 7 . 5 5 1 3 9 1 3 h 4 c 1 . 4 5 0 3 - 1 . 6 9 3 - 3 . 5 S 1 4 . 5 6 1 3 6 z " > < / p a t h > < / s v g > < / a > R e q u i r e d < / h 3 > < p r e > < c o d e > e s . r e s o u r c e = & l t ; E S r e s o u r c e l o c a t i o n , r e l a t i v e t o t h e h o s t / p o r t s p e c i f i e d a b o v e & g t ; < / c o d e > < / p r e > < h 3 > < a i d = " u s e r - c o n t e n t - e s s e n t i a l " c l a s s = " a n c h o r " h r e f = " h t t p s : / / g i t h u b . c o m / e l a s t i c / e l a s t i c s e a r c h - h a d o o p # e s s e n t i a l " a r i a - h i d d e n = " t r u e " t a r g e t = " _ b l a n k " > < s v g a r i a - h i d d e n = " t r u e " c l a s s = " o c t i c o n o c t i c o n - l i n k " h e i g h t = " 1 6 " v e r s i o n = " 1 . 1 " v i e w b o x = " 0 0 1 6 1 6 " w i d t h = " 1 6 " > < p a t h f i l l - r u l e = " e v e n o d d " d = " M 4 9 h 1 v 1 H 4 c - 1 . 5 0 - 3 - 1 . 6 9 - 3 - 3 . 5 S 2 . 5 5 3 4 3 h 4 c 1 . 4 5 0 3 1 . 6 9 3 3 . 5 0 1 . 4 1 - . 9 1 2 . 7 2 - 2 3 . 2 5 V 8 . 5 9 c . 5 8 - . 4 5 1 - 1 . 2 7 1 - 2 . 0 9 C 1 0 5 . 2 2 8 . 9 8 4 8 4 H 4 c - . 9 8 0 - 2 1 . 2 2 - 2 2 . 5 S 3 9 4 9 z m 9 - 3 h - 1 v 1 h 1 c 1 0 2 1 . 2 2 2 2 . 5 S 1 3 . 9 8 1 2 1 3 1 2 H 9 c - . 9 8 0 - 2 - 1 . 2 2 - 2 - 2 . 5 0 - . 8 3 . 4 2 - 1 . 6 4 1 - 2 . 0 9 V 6 . 2 5 c - 1 . 0 9 . 5 3 - 2 1 . 8 4 - 2 3 . 2 5 C 6 1 1 . 3 1 7 . 5 5 1 3 9 1 3 h 4 c 1 . 4 5 0 3 - 1 . 6 9 3 - 3 . 5 S 1 4 . 5 6 1 3 6 z " > < / p a t h > < / s v g > < / a > E s s e n t i a l < / h 3 > < p r e > < c o d e > e s . q u e r y = & l t ; u r i o r q u e r y d s l q u e r y & g t ; # d e f a u l t s t o { " q u e r y " : { " m a t c h _ a l l " : { } } } e s . n o d e s = & l t ; E S h o s t a d d r e s s & g t ; # d e f a u l t s t o l o c a l h o s t e s . p o r t = & l t ; E S R E S T p o r t & g t ; # d e f a u l t s t o 9 2 0 0 < / c o d e > < / p r e > < p > T h e f u l l l i s t i s a v a i l a b l e < a h r e f = " h t t p : / / w w w . e l a s t i c . c o / g u i d e / e n / e l a s t i c s e a r c h / h a d o o p / c u r r e n t / c o n f i g u r a t i o n . h t m l " t a r g e t = " _ b l a n k " > h e r e < / a > < / p > < h 2 > < a i d = " u s e r - c o n t e n t - m a p r e d u c e " c l a s s = " a n c h o r " h r e f = " h t t p s : / / g i t h u b . c o m / e l a s t i c / e l a s t i c s e a r c h - h a d o o p # m a p r e d u c e " a r i a - h i d d e n = " t r u e " t a r g e t = " _ b l a n k " > < s v g a r i a - h i d d e n = " t r u e " c l a s s = " o c t i c o n o c t i c o n - l i n k " h e i g h t = " 1 6 " v e r s i o n = " 1 . 1 " v i e w b o x = " 0 0 1 6 1 6 " w i d t h = " 1 6 " > < p a t h f i l l - r u l e = " e v e n o d d " d = " M 4 9 h 1 v 1 H 4 c - 1 . 5 0 - 3 - 1 . 6 9 - 3 - 3 . 5 S 2 . 5 5 3 4 3 h 4 c 1 . 4 5 0 3 1 . 6 9 3 3 . 5 0 1 . 4 1 - . 9 1 2 . 7 2 - 2 3 . 2 5 V 8 . 5 9 c . 5 8 - . 4 5 1 - 1 . 2 7 1 - 2 . 0 9 C 1 0 5 . 2 2 8 . 9 8 4 8 4 H 4 c - . 9 8 0 - 2 1 . 2 2 - 2 2 . 5 S 3 9 4 9 z m 9 - 3 h - 1 v 1 h 1 c 1 0 2 1 . 2 2 2 2 . 5 S 1 3 . 9 8 1 2 1 3 1 2 H 9 c - . 9 8 0 - 2 - 1 . 2 2 - 2 - 2 . 5 0 - . 8 3 . 4 2 - 1 . 6 4 1 - 2 . 0 9 V 6 . 2 5 c - 1 . 0 9 . 5 3 - 2 1 . 8 4 - 2 3 . 2 5 C 6 1 1 . 3 1 7 . 5 5 1 3 9 1 3 h 4 c 1 . 4 5 0 3 - 1 . 6 9 3 - 3 . 5 S 1 4 . 5 6 1 3 6 z " > < / p a t h > < / s v g > < / a > < a h r e f = " h t t p : / / h a d o o p . a p a c h e . o r g / d o c s / r 1 . 2 . 1 / m a p r e d _ t u t o r i a l . h t m l " t a r g e t = " _ b l a n k " > M a p / R e d u c e < / a > < / h 2 > < p > F o r b a s i c , l o w - l e v e l o r p e r f o r m a n c e - s e n s i t i v e e n v i r o n m e n t s , E S - H a d o o p p r o v i d e s d e d i c a t e d < c o d e > I n p u t F o r m a t < / c o d e > a n d < c o d e > O u t p u t F o r m a t < / c o d e > t h a t r e a d a n d w r i t e d a t a t o E l a s t i c s e a r c h . T o u s e t h e m , a d d t h e < c o d e > e s - h a d o o p < / c o d e > j a r t o y o u r j o b c l a s s p a t h ( e i t h e r b y b u n d l i n g t h e l i b r a r y a l o n g - i t ' s ~ 3 0 0 k B a n d t h e r e a r e n o - d e p e n d e n c i e s ) , u s i n g t h e < a h r e f = " h t t p : / / h a d o o p . a p a c h e . o r g / d o c s / s t a b l e / a p i / o r g / a p a c h e / h a d o o p / f i l e c a c h e / D i s t r i b u t e d C a c h e . h t m l " t a r g e t = " _ b l a n k " > D i s t r i b u t e d C a c h e < / a > o r b y p r o v i s i o n i n g t h e c l u s t e r m a n u a l l y . S e e t h e < a h r e f = " h t t p : / / w w w . e l a s t i c . c o / g u i d e / e n / e l a s t i c s e a r c h / h a d o o p / c u r r e n t / i n d e x . h t m l " t a r g e t = " _ b l a n k " > d o c u m e n t a t i o n < / a > f o r m o r e i n f o r m a t i o n . < / p > < p > N o t e t h a t e s - h a d o o p s u p p o r t s b o t h t h e s o - c a l l e d ' o l d ' a n d t h e ' n e w ' A P I t h r o u g h i t s < c o d e > E s I n p u t F o r m a t < / c o d e > a n d < c o d e > E s O u t p u t F o r m a t < / c o d e > c l a s s e s . < / p > < h 3 > < a i d = " u s e r - c o n t e n t - o l d - o r g a p a c h e h a d o o p m a p r e d - a p i " c l a s s = " a n c h o r " h r e f = " h t t p s : / / g i t h u b . c o m / e l a s t i c / e l a s t i c s e a r c h - h a d o o p # o l d - o r g a p a c h e h a d o o p m a p r e d - a p i " a r i a - h i d d e n = " t r u e " t a r g e t = " _ b l a n k " > < s v g a r i a - h i d d e n = " t r u e " c l a s s = " o c t i c o n o c t i c o n - l i n k " h e i g h t = " 1 6 " v e r s i o n = " 1 . 1 " v i e w b o x = " 0 0 1 6 1 6 " w i d t h = " 1 6 " > < p a t h f i l l - r u l e = " e v e n o d d " d = " M 4 9 h 1 v 1 H 4 c - 1 . 5 0 - 3 - 1 . 6 9 - 3 - 3 . 5 S 2 . 5 5 3 4 3 h 4 c 1 . 4 5 0 3 1 . 6 9 3 3 . 5 0 1 . 4 1 - . 9 1 2 . 7 2 - 2 3 . 2 5 V 8 . 5 9 c . 5 8 - . 4 5 1 - 1 . 2 7 1 - 2 . 0 9 C 1 0 5 . 2 2 8 . 9 8 4 8 4 H 4 c - . 9 8 0 - 2 1 . 2 2 - 2 2 . 5 S 3 9 4 9 z m 9 - 3 h - 1 v 1 h 1 c 1 0 2 1 . 2 2 2 2 . 5 S 1 3 . 9 8 1 2 1 3 1 2 H 9 c - . 9 8 0 - 2 - 1 . 2 2 - 2 - 2 . 5 0 - . 8 3 . 4 2 - 1 . 6 4 1 - 2 . 0 9 V 6 . 2 5 c - 1 . 0 9 . 5 3 - 2 1 . 8 4 - 2 3 . 2 5 C 6 1 1 . 3 1 7 . 5 5 1 3 9 1 3 h 4 c 1 . 4 5 0 3 - 1 . 6 9 3 - 3 . 5 S 1 4 . 5 6 1 3 6 z " > < / p a t h > < / s v g > < / a > ' O l d ' ( < c o d e > o r g . a p a c h e . h a d o o p . m a p r e d < / c o d e > ) A P I < / h 3 > < h 3 > < a i d = " u s e r - c o n t e n t - r e a d i n g " c l a s s = " a n c h o r " h r e f = " h t t p s : / / g i t h u b . c o m / e l a s t i c / e l a s t i c s e a r c h - h a d o o p # r e a d i n g " a r i a - h i d d e n = " t r u e " t a r g e t = " _ b l a n k " > < s v g a r i a - h i d d e n = " t r u e " c l a s s = " o c t i c o n o c t i c o n - l i n k " h e i g h t = " 1 6 " v e r s i o n = " 1 . 1 " v i e w b o x = " 0 0 1 6 1 6 " w i d t h = " 1 6 " > < p a t h f i l l - r u l e = " e v e n o d d " d = " M 4 9 h 1 v 1 H 4 c - 1 . 5 0 - 3 - 1 . 6 9 - 3 - 3 . 5 S 2 . 5 5 3 4 3 h 4 c 1 . 4 5 0 3 1 . 6 9 3 3 . 5 0 1 . 4 1 - . 9 1 2 . 7 2 - 2 3 . 2 5 V 8 . 5 9 c . 5 8 - . 4 5 1 - 1 . 2 7 1 - 2 . 0 9 C 1 0 5 . 2 2 8 . 9 8 4 8 4 H 4 c - . 9 8 0 - 2 1 . 2 2 - 2 2 . 5 S 3 9 4 9 z m 9 - 3 h - 1 v 1 h 1 c 1 0 2 1 . 2 2 2 2 . 5 S 1 3 . 9 8 1 2 1 3 1 2 H 9 c - . 9 8 0 - 2 - 1 . 2 2 - 2 - 2 . 5 0 - . 8 3 . 4 2 - 1 . 6 4 1 - 2 . 0 9 V 6 . 2 5 c - 1 . 0 9 . 5 3 - 2 1 . 8 4 - 2 3 . 2 5 C 6 1 1 . 3 1 7 . 5 5 1 3 9 1 3 h 4 c 1 . 4 5 0 3 - 1 . 6 9 3 - 3 . 5 S 1 4 . 5 6 1 3 6 z " > < / p a t h > < / s v g > < / a > R e a d i n g < / h 3 > < p > T o r e a d d a t a f r o m E S , c o n f i g u r e t h e < c o d e > E s I n p u t F o r m a t < / c o d e > o n y o u r j o b c o n f i g u r a t i o n a l o n g w i t h t h e r e l e v a n t < a h r e f = " h t t p s : / / g i t h u b . c o m / e l a s t i c / e l a s t i c s e a r c h - h a d o o p # c o n f i g u r a t i o n - p r o p e r t i e s " t a r g e t = " _ b l a n k " > p r o p e r t i e s < / a > : < / p > < d i v c l a s s = " h i g h l i g h t h i g h l i g h t - s o u r c e - j a v a " > < p r e > < s p a n c l a s s = " p l - s m i " > J o b C o n f < / s p a n > c o n f < s p a n c l a s s = " p l - k " > = < / s p a n > < s p a n c l a s s = " p l - k " > n e w < / s p a n > < s p a n c l a s s = " p l - s m i " > J o b C o n f < / s p a n > ( ) ; c o n f < s p a n c l a s s = " p l - k " > . < / s p a n > s e t I n p u t F o r m a t ( < s p a n c l a s s = " p l - s m i " > E s I n p u t F o r m a t < / s p a n > < s p a n c l a s s = " p l - k " > . < / s p a n > c l a s s ) ; c o n f < s p a n c l a s s = " p l - k " > . < / s p a n > s e t ( < s p a n c l a s s = " p l - s " > < s p a n c l a s s = " p l - p d s " > " < / s p a n > e s . r e s o u r c e < s p a n c l a s s = " p l - p d s " > " < / s p a n > < / s p a n > , < s p a n c l a s s = " p l - s " > < s p a n c l a s s = " p l - p d s " > " < / s p a n > r a d i o / a r t i s t s < s p a n c l a s s = " p l - p d s " > " < / s p a n > < / s p a n > ) ; c o n f < s p a n c l a s s = " p l - k " > . < / s p a n > s e t ( < s p a n c l a s s = " p l - s " > < s p a n c l a s s = " p l - p d s " > " < / s p a n > e s . q u e r y < s p a n c l a s s = " p l - p d s " > " < / s p a n > < / s p a n > , < s p a n c l a s s = " p l - s " > < s p a n c l a s s = " p l - p d s " > " < / s p a n > ? q = m e * < s p a n c l a s s = " p l - p d s " > " < / s p a n > < / s p a n > ) ; < s p a n c l a s s = " p l - c " > < s p a n c l a s s = " p l - c " > / / < / s p a n > r e p l a c e t h i s w i t h t h e r e l e v a n t q u e r y < / s p a n > < s p a n c l a s s = " p l - c 1 " > . . . < / s p a n > < s p a n c l a s s = " p l - s m i " > J o b C l i e n t < / s p a n > < s p a n c l a s s = " p l - k " > . < / s p a n > r u n J o b ( c o n f ) ; < / p r e > < / d i v > < h 3 > < a i d = " u s e r - c o n t e n t - w r i t i n g " c l a s s = " a n c h o r " h r e f = " h t t p s : / / g i t h u b . c o m / e l a s t i c / e l a s t i c s e a r c h - h a d o o p # w r i t i n g " a r i a - h i d d e n = " t r u e " t a r g e t = " _ b l a n k " > < s v g a r i a - h i d d e n = " t r u e " c l a s s = " o c t i c o n o c t i c o n - l i n k " h e i g h t = " 1 6 " v e r s i o n = " 1 . 1 " v i e w b o x = " 0 0 1 6 1 6 " w i d t h = " 1 6 " > < p a t h f i l l - r u l e = " e v e n o d d " d = " M 4 9 h 1 v 1 H 4 c - 1 . 5 0 - 3 - 1 . 6 9 - 3 - 3 . 5 S 2 . 5 5 3 4 3 h 4 c 1 . 4 5 0 3 1 . 6 9 3 3 . 5 0 1 . 4 1 - . 9 1 2 . 7 2 - 2 3 . 2 5 V 8 . 5 9 c . 5 8 - . 4 5 1 - 1 . 2 7 1 - 2 . 0 9 C 1 0 5 . 2 2 8 . 9 8 4 8 4 H 4 c - . 9 8 0 - 2 1 . 2 2 - 2 2 . 5 S 3 9 4 9 z m 9 - 3 h - 1 v 1 h 1 c 1 0 2 1 . 2 2 2 2 . 5 S 1 3 . 9 8 1 2 1 3 1 2 H 9 c - . 9 8 0 - 2 - 1 . 2 2 - 2 - 2 . 5 0 - . 8 3 . 4 2 - 1 . 6 4 1 - 2 . 0 9 V 6 . 2 5 c - 1 . 0 9 . 5 3 - 2 1 . 8 4 - 2 3 . 2 5 C 6 1 1 . 3 1 7 . 5 5 1 3 9 1 3 h 4 c 1 . 4 5 0 3 - 1 . 6 9 3 - 3 . 5 S 1 4 . 5 6 1 3 6 z " > < / p a t h > < / s v g > < / a > W r i t i n g < / h 3 > < p > S a m e c o n f i g u r a t i o n t e m p l a t e c a n b e u s e d f o r w r i t i n g b u t u s i n g < c o d e > E s O u p u t F o r m a t < / c o d e > : < / p > < d i v c l a s s = " h i g h l i g h t h i g h l i g h t - s o u r c e - j a v a " > < p r e > < s p a n c l a s s = " p l - s m i " > J o b C o n f < / s p a n > c o n f < s p a n c l a s s = " p l - k " > = < / s p a n > < s p a n c l a s s = " p l - k " > n e w < / s p a n > < s p a n c l a s s = " p l - s m i " > J o b C o n f < / s p a n > ( ) ; c o n f < s p a n c l a s s = " p l - k " > . < / s p a n > s e t O u t p u t F o r m a t ( < s p a n c l a s s = " p l - s m i " > E s O u t p u t F o r m a t < / s p a n > < s p a n c l a s s = " p l - k " > . < / s p a n > c l a s s ) ; c o n f < s p a n c l a s s = " p l - k " > . < / s p a n > s e t ( < s p a n c l a s s = " p l - s " > < s p a n c l a s s = " p l - p d s " > " < / s p a n > e s . r e s o u r c e < s p a n c l a s s = " p l - p d s " > " < / s p a n > < / s p a n > , < s p a n c l a s s = " p l - s " > < s p a n c l a s s = " p l - p d s " > " < / s p a n > r a d i o / a r t i s t s < s p a n c l a s s = " p l - p d s " > " < / s p a n > < / s p a n > ) ; < s p a n c l a s s = " p l - c " > < s p a n c l a s s = " p l - c " > / / < / s p a n > i n d e x o r i n d i c e s u s e d f o r s t o r i n g d a t a < / s p a n > < s p a n c l a s s = " p l - c 1 " > . . . < / s p a n > < s p a n c l a s s = " p l - s m i " > J o b C l i e n t < / s p a n > < s p a n c l a s s = " p l - k " > . < / s p a n > r u n J o b ( c o n f ) ; < / p r e > < / d i v > < h 3 > < a i d = " u s e r - c o n t e n t - n e w - o r g a p a c h e h a d o o p m a p r e d u c e - a p i " c l a s s = " a n c h o r " h r e f = " h t t p s : / / g i t h u b . c o m / e l a s t i c / e l a s t i c s e a r c h - h a d o o p # n e w - o r g a p a c h e h a d o o p m a p r e d u c e - a p i " a r i a - h i d d e n = " t r u e " t a r g e t = " _ b l a n k " > < s v g a r i a - h i d d e n = " t r u e " c l a s s = " o c t i c o n o c t i c o n - l i n k " h e i g h t = " 1 6 " v e r s i o n = " 1 . 1 " v i e w b o x = " 0 0 1 6 1 6 " w i d t h = " 1 6 " > < p a t h f i l l - r u l e = " e v e n o d d " d = " M 4 9 h 1 v 1 H 4 c - 1 . 5 0 - 3 - 1 . 6 9 - 3 - 3 . 5 S 2 . 5 5 3 4 3 h 4 c 1 . 4 5 0 3 1 . 6 9 3 3 . 5 0 1 . 4 1 - . 9 1 2 . 7 2 - 2 3 . 2 5 V 8 . 5 9 c . 5 8 - . 4 5 1 - 1 . 2 7 1 - 2 . 0 9 C 1 0 5 . 2 2 8 . 9 8 4 8 4 H 4 c - . 9 8 0 - 2 1 . 2 2 - 2 2 . 5 S 3 9 4 9 z m 9 - 3 h - 1 v 1 h 1 c 1 0 2 1 . 2 2 2 2 . 5 S 1 3 . 9 8 1 2 1 3 1 2 H 9 c - . 9 8 0 - 2 - 1 . 2 2 - 2 - 2 . 5 0 - . 8 3 . 4 2 - 1 . 6 4 1 - 2 . 0 9 V 6 . 2 5 c - 1 . 0 9 . 5 3 - 2 1 . 8 4 - 2 3 . 2 5 C 6 1 1 . 3 1 7 . 5 5 1 3 9 1 3 h 4 c 1 . 4 5 0 3 - 1 . 6 9 3 - 3 . 5 S 1 4 . 5 6 1 3 6 z " > < / p a t h > < / s v g > < / a > ' N e w ' ( < c o d e > o r g . a p a c h e . h a d o o p . m a p r e d u c e < / c o d e > ) A P I < / h 3 > < h 3 > < a i d = " u s e r - c o n t e n t - r e a d i n g - 1 " c l a s s = " a n c h o r " h r e f = " h t t p s : / / g i t h u b . c o m / e l a s t i c / e l a s t i c s e a r c h - h a d o o p # r e a d i n g - 1 " a r i a - h i d d e n = " t r u e " t a r g e t = " _ b l a n k " > < s v g a r i a - h i d d e n = " t r u e " c l a s s = " o c t i c o n o c t i c o n - l i n k " h e i g h t = " 1 6 " v e r s i o n = " 1 . 1 " v i e w b o x = " 0 0 1 6 1 6 " w i d t h = " 1 6 " > < p a t h f i l l - r u l e = " e v e n o d d " d = " M 4 9 h 1 v 1 H 4 c - 1 . 5 0 - 3 - 1 . 6 9 - 3 - 3 . 5 S 2 . 5 5 3 4 3 h 4 c 1 . 4 5 0 3 1 . 6 9 3 3 . 5 0 1 . 4 1 - . 9 1 2 . 7 2 - 2 3 . 2 5 V 8 . 5 9 c . 5 8 - . 4 5 1 - 1 . 2 7 1 - 2 . 0 9 C 1 0 5 . 2 2 8 . 9 8 4 8 4 H 4 c - . 9 8 0 - 2 1 . 2 2 - 2 2 . 5 S 3 9 4 9 z m 9 - 3 h - 1 v 1 h 1 c 1 0 2 1 . 2 2 2 2 . 5 S 1 3 . 9 8 1 2 1 3 1 2 H 9 c - . 9 8 0 - 2 - 1 . 2 2 - 2 - 2 . 5 0 - . 8 3 . 4 2 - 1 . 6 4 1 - 2 . 0 9 V 6 . 2 5 c - 1 . 0 9 . 5 3 - 2 1 . 8 4 - 2 3 . 2 5 C 6 1 1 . 3 1 7 . 5 5 1 3 9 1 3 h 4 c 1 . 4 5 0 3 - 1 . 6 9 3 - 3 . 5 S 1 4 . 5 6 1 3 6 z " > < / p a t h > < / s v g > < / a > R e a d i n g < / h 3 > < d i v c l a s s = " h i g h l i g h t h i g h l i g h t - s o u r c e - j a v a " > < p r e > < s p a n c l a s s = " p l - s m i " > C o n f i g u r a t i o n < / s p a n > c o n f < s p a n c l a s s = " p l - k " > = < / s p a n > < s p a n c l a s s = " p l - k " > n e w < / s p a n > < s p a n c l a s s = " p l - s m i " > C o n f i g u r a t i o n < / s p a n > ( ) ; c o n f < s p a n c l a s s = " p l - k " > . < / s p a n > s e t ( < s p a n c l a s s = " p l - s " > < s p a n c l a s s = " p l - p d s " > " < / s p a n > e s . r e s o u r c e < s p a n c l a s s = " p l - p d s " > " < / s p a n > < / s p a n > , < s p a n c l a s s = " p l - s " > < s p a n c l a s s = " p l - p d s " > " < / s p a n > r a d i o / a r t i s t s < s p a n c l a s s = " p l - p d s " > " < / s p a n > < / s p a n > ) ; c o n f < s p a n c l a s s = " p l - k " > . < / s p a n > s e t ( < s p a n c l a s s = " p l - s " > < s p a n c l a s s = " p l - p d s " > " < / s p a n > e s . q u e r y < s p a n c l a s s = " p l - p d s " > " < / s p a n > < / s p a n > , < s p a n c l a s s = " p l - s " > < s p a n c l a s s = " p l - p d s " > " < / s p a n > ? q = m e * < s p a n c l a s s = " p l - p d s " > " < / s p a n > < / s p a n > ) ; < s p a n c l a s s = " p l - c " > < s p a n c l a s s = " p l - c " > / / < / s p a n > r e p l a c e t h i s w i t h t h e r e l e v a n t q u e r y < / s p a n > < s p a n c l a s s = " p l - s m i " > J o b < / s p a n > j o b < s p a n c l a s s = " p l - k " > = < / s p a n > < s p a n c l a s s = " p l - k " > n e w < / s p a n > < s p a n c l a s s = " p l - s m i " > J o b < / s p a n > ( c o n f ) j o b < s p a n c l a s s = " p l - k " > . < / s p a n > s e t I n p u t F o r m a t C l a s s ( < s p a n c l a s s = " p l - s m i " > E s I n p u t F o r m a t < / s p a n > < s p a n c l a s s = " p l - k " > . < / s p a n > c l a s s ) ; < s p a n c l a s s = " p l - c 1 " > . . . < / s p a n > j o b < s p a n c l a s s = " p l - k " > . < / s p a n > w a i t F o r C o m p l e t i o n ( < s p a n c l a s s = " p l - c 1 " > t r u e < / s p a n > ) ; < / p r e > < / d i v > < h 3 > < a i d = " u s e r - c o n t e n t - w r i t i n g - 1 " c l a s s = " a n c h o r " h r e f = " h t t p s : / / g i t h u b . c o m / e l a s t i c / e l a s t i c s e a r c h - h a d o o p # w r i t i n g - 1 " a r i a - h i d d e n = " t r u e " t a r g e t = " _ b l a n k " > < s v g a r i a - h i d d e n = " t r u e " c l a s s = " o c t i c o n o c t i c o n - l i n k " h e i g h t = " 1 6 " v e r s i o n = " 1 . 1 " v i e w b o x = " 0 0 1 6 1 6 " w i d t h = " 1 6 " > < p a t h f i l l - r u l e = " e v e n o d d " d = " M 4 9 h 1 v 1 H 4 c - 1 . 5 0 - 3 - 1 . 6 9 - 3 - 3 . 5 S 2 . 5 5 3 4 3 h 4 c 1 . 4 5 0 3 1 . 6 9 3 3 . 5 0 1 . 4 1 - . 9 1 2 . 7 2 - 2 3 . 2 5 V 8 . 5 9 c . 5 8 - . 4 5 1 - 1 . 2 7 1 - 2 . 0 9 C 1 0 5 . 2 2 8 . 9 8 4 8 4 H 4 c - . 9 8 0 - 2 1 . 2 2 - 2 2 . 5 S 3 9 4 9 z m 9 - 3 h - 1 v 1 h 1 c 1 0 2 1 . 2 2 2 2 . 5 S 1 3 . 9 8 1 2 1 3 1 2 H 9 c - . 9 8 0 - 2 - 1 . 2 2 - 2 - 2 . 5 0 - . 8 3 . 4 2 - 1 . 6 4 1 - 2 . 0 9 V 6 . 2 5 c - 1 . 0 9 . 5 3 - 2 1 . 8 4 - 2 3 . 2 5 C 6 1 1 . 3 1 7 . 5 5 1 3 9 1 3 h 4 c 1 . 4 5 0 3 - 1 . 6 9 3 - 3 . 5 S 1 4 . 5 6 1 3 6 z " > < / p a t h > < / s v g > < / a > W r i t i n g < / h 3 > < d i v c l a s s = " h i g h l i g h t h i g h l i g h t - s o u r c e - j a v a " > < p r e > < s p a n c l a s s = " p l - s m i " > C o n f i g u r a t i o n < / s p a n > c o n f < s p a n c l a s s = " p l - k " > = < / s p a n > < s p a n c l a s s = " p l - k " > n e w < / s p a n > < s p a n c l a s s = " p l - s m i " > C o n f i g u r a t i o n < / s p a n > ( ) ; c o n f < s p a n c l a s s = " p l - k " > . < / s p a n > s e t ( < s p a n c l a s s = " p l - s " > < s p a n c l a s s = " p l - p d s " > " < / s p a n > e s . r e s o u r c e < s p a n c l a s s = " p l - p d s " > " < / s p a n > < / s p a n > , < s p a n c l a s s = " p l - s " > < s p a n c l a s s = " p l - p d s " > " < / s p a n > r a d i o / a r t i s t s < s p a n c l a s s = " p l - p d s " > " < / s p a n > < / s p a n > ) ; < s p a n c l a s s = " p l - c " > < s p a n c l a s s = " p l - c " > / / < / s p a n > i n d e x o r i n d i c e s u s e d f o r s t o r i n g d a t a < / s p a n > < s p a n c l a s s = " p l - s m i " > J o b < / s p a n > j o b < s p a n c l a s s = " p l - k " > = < / s p a n > < s p a n c l a s s = " p l - k " > n e w < / s p a n > < s p a n c l a s s = " p l - s m i " > J o b < / s p a n > ( c o n f ) j o b < s p a n c l a s s = " p l - k " > . < / s p a n > s e t O u t p u t F o r m a t C l a s s ( < s p a n c l a s s = " p l - s m i " > E s O u t p u t F o r m a t < / s p a n > < s p a n c l a s s = " p l - k " > . < / s p a n > c l a s s ) ; < s p a n c l a s s = " p l - c 1 " > . . . < / s p a n > j o b < s p a n c l a s s = " p l - k " > . < / s p a n > w a i t F o r C o m p l e t i o n ( < s p a n c l a s s = " p l - c 1 " > t r u e < / s p a n > ) ; < / p r e > < / d i v > < h 2 > < a i d = " u s e r - c o n t e n t - a p a c h e - h i v e " c l a s s = " a n c h o r " h r e f = " h t t p s : / / g i t h u b . c o m / e l a s t i c / e l a s t i c s e a r c h - h a d o o p # a p a c h e - h i v e " a r i a - h i d d e n = " t r u e " t a r g e t = " _ b l a n k " > < s v g a r i a - h i d d e n = " t r u e " c l a s s = " o c t i c o n o c t i c o n - l i n k " h e i g h t = " 1 6 " v e r s i o n = " 1 . 1 " v i e w b o x = " 0 0 1 6 1 6 " w i d t h = " 1 6 " > < p a t h f i l l - r u l e = " e v e n o d d " d = " M 4 9 h 1 v 1 H 4 c - 1 . 5 0 - 3 - 1 . 6 9 - 3 - 3 . 5 S 2 . 5 5 3 4 3 h 4 c 1 . 4 5 0 3 1 . 6 9 3 3 . 5 0 1 . 4 1 - . 9 1 2 . 7 2 - 2 3 . 2 5 V 8 . 5 9 c . 5 8 - . 4 5 1 - 1 . 2 7 1 - 2 . 0 9 C 1 0 5 . 2 2 8 . 9 8 4 8 4 H 4 c - . 9 8 0 - 2 1 . 2 2 - 2 2 . 5 S 3 9 4 9 z m 9 - 3 h - 1 v 1 h 1 c 1 0 2 1 . 2 2 2 2 . 5 S 1 3 . 9 8 1 2 1 3 1 2 H 9 c - . 9 8 0 - 2 - 1 . 2 2 - 2 - 2 . 5 0 - . 8 3 . 4 2 - 1 . 6 4 1 - 2 . 0 9 V 6 . 2 5 c - 1 . 0 9 . 5 3 - 2 1 . 8 4 - 2 3 . 2 5 C 6 1 1 . 3 1 7 . 5 5 1 3 9 1 3 h 4 c 1 . 4 5 0 3 - 1 . 6 9 3 - 3 . 5 S 1 4 . 5 6 1 3 6 z " > < / p a t h > < / s v g > < / a > < a h r e f = " h t t p : / / h i v e . a p a c h e . o r g " t a r g e t = " _ b l a n k " > A p a c h e H i v e < / a > < / h 2 > < p > E S - H a d o o p p r o v i d e s a H i v e s t o r a g e h a n d l e r f o r E l a s t i c s e a r c h , m e a n i n g o n e c a n d e f i n e a n < a h r e f = " h t t p : / / c w i k i . a p a c h e . o r g / H i v e / e x t e r n a l - t a b l e s . h t m l " t a r g e t = " _ b l a n k " > e x t e r n a l t a b l e < / a > o n t o p o f E S . < / p > < p > A d d e s - h a d o o p - . j a r t o < c o d e > h i v e . a u x . j a r s . p a t h < / c o d e > o r r e g i s t e r i t m a n u a l l y i n y o u r H i v e s c r i p t ( r e c o m m e n d e d ) : < / p > < p r e > < c o d e > A D D J A R / p a t h _ t o _ j a r / e s - h a d o o p - & l t ; v e r s i o n & g t ; . j a r ; < / c o d e > < / p r e > < h 3 > < a i d = " u s e r - c o n t e n t - r e a d i n g - 2 " c l a s s = " a n c h o r " h r e f = " h t t p s : / / g i t h u b . c o m / e l a s t i c / e l a s t i c s e a r c h - h a d o o p # r e a d i n g - 2 " a r i a - h i d d e n = " t r u e " t a r g e t = " _ b l a n k " > < s v g a r i a - h i d d e n = " t r u e " c l a s s = " o c t i c o n o c t i c o n - l i n k " h e i g h t = " 1 6 " v e r s i o n = " 1 . 1 " v i e w b o x = " 0 0 1 6 1 6 " w i d t h = " 1 6 " > < p a t h f i l l - r u l e = " e v e n o d d " d = " M 4 9 h 1 v 1 H 4 c - 1 . 5 0 - 3 - 1 . 6 9 - 3 - 3 . 5 S 2 . 5 5 3 4 3 h 4 c 1 . 4 5 0 3 1 . 6 9 3 3 . 5 0 1 . 4 1 - . 9 1 2 . 7 2 - 2 3 . 2 5 V 8 . 5 9 c . 5 8 - . 4 5 1 - 1 . 2 7 1 - 2 . 0 9 C 1 0 5 . 2 2 8 . 9 8 4 8 4 H 4 c - . 9 8 0 - 2 1 . 2 2 - 2 2 . 5 S 3 9 4 9 z m 9 - 3 h - 1 v 1 h 1 c 1 0 2 1 . 2 2 2 2 . 5 S 1 3 . 9 8 1 2 1 3 1 2 H 9 c - . 9 8 0 - 2 - 1 . 2 2 - 2 - 2 . 5 0 - . 8 3 . 4 2 - 1 . 6 4 1 - 2 . 0 9 V 6 . 2 5 c - 1 . 0 9 . 5 3 - 2 1 . 8 4 - 2 3 . 2 5 C 6 1 1 . 3 1 7 . 5 5 1 3 9 1 3 h 4 c 1 . 4 5 0 3 - 1 . 6 9 3 - 3 . 5 S 1 4 . 5 6 1 3 6 z " > < / p a t h > < / s v g > < / a > R e a d i n g < / h 3 > < p > T o r e a d d a t a f r o m E S , d e f i n e a t a b l e b a c k e d b y t h e d e s i r e d i n d e x : < / p > < d i v c l a s s = " h i g h l i g h t h i g h l i g h t - s o u r c e - s q l " > < p r e > C R E A T E E X T E R N A L T A B L E a r t i s t s ( i d < s p a n c l a s s = " p l - k " > B I G I N T < / s p a n > , n a m e S T R I N G , l i n k s S T R U C T < s p a n c l a s s = " p l - k " > & l t ; < / s p a n > u r l : S T R I N G , p i c t u r e : S T R I N G < s p a n c l a s s = " p l - k " > & g t ; < / s p a n > ) S T O R E D B Y < s p a n c l a s s = " p l - s " > < s p a n c l a s s = " p l - p d s " > ' < / s p a n > o r g . e l a s t i c s e a r c h . h a d o o p . h i v e . E s S t o r a g e H a n d l e r < s p a n c l a s s = " p l - p d s " > ' < / s p a n > < / s p a n > T B L P R O P E R T I E S ( < s p a n c l a s s = " p l - s " > < s p a n c l a s s = " p l - p d s " > ' < / s p a n > e s . r e s o u r c e < s p a n c l a s s = " p l - p d s " > ' < / s p a n > < / s p a n > < s p a n c l a s s = " p l - k " > = < / s p a n > < s p a n c l a s s = " p l - s " > < s p a n c l a s s = " p l - p d s " > ' < / s p a n > r a d i o / a r t i s t s < s p a n c l a s s = " p l - p d s " > ' < / s p a n > < / s p a n > , < s p a n c l a s s = " p l - s " > < s p a n c l a s s = " p l - p d s " > ' < / s p a n > e s . q u e r y < s p a n c l a s s = " p l - p d s " > ' < / s p a n > < / s p a n > < s p a n c l a s s = " p l - k " > = < / s p a n > < s p a n c l a s s = " p l - s " > < s p a n c l a s s = " p l - p d s " > ' < / s p a n > ? q = m e * < s p a n c l a s s = " p l - p d s " > ' < / s p a n > < / s p a n > ) ; < / p r e > < / d i v > < p > T h e f i e l d s d e f i n e d i n t h e t a b l e a r e m a p p e d t o t h e J S O N w h e n c o m m u n i c a t i n g w i t h E l a s t i c s e a r c h . N o t i c e t h e u s e o f < c o d e > T B L P R O P E R T I E S < / c o d e > t o d e f i n e t h e l o c a t i o n , t h a t i s t h e q u e r y u s e d f o r r e a d i n g f r o m t h i s t a b l e . < / p > < p > O n c e d e f i n e d , t h e t a b l e c a n b e u s e d j u s t l i k e a n y o t h e r : < / p > < d i v c l a s s = " h i g h l i g h t h i g h l i g h t - s o u r c e - s q l " > < p r e > < s p a n c l a s s = " p l - k " > S E L E C T < / s p a n > < s p a n c l a s s = " p l - k " > * < / s p a n > < s p a n c l a s s = " p l - k " > F R O M < / s p a n > a r t i s t s ; < / p r e > < / d i v > < h 3 > < a i d = " u s e r - c o n t e n t - w r i t i n g - 2 " c l a s s = " a n c h o r " h r e f = " h t t p s : / / g i t h u b . c o m / e l a s t i c / e l a s t i c s e a r c h - h a d o o p # w r i t i n g - 2 " a r i a - h i d d e n = " t r u e " t a r g e t = " _ b l a n k " > < s v g a r i a - h i d d e n = " t r u e " c l a s s = " o c t i c o n o c t i c o n - l i n k " h e i g h t = " 1 6 " v e r s i o n = " 1 . 1 " v i e w b o x = " 0 0 1 6 1 6 " w i d t h = " 1 6 " > < p a t h f i l l - r u l e = " e v e n o d d " d = " M 4 9 h 1 v 1 H 4 c - 1 . 5 0 - 3 - 1 . 6 9 - 3 - 3 . 5 S 2 . 5 5 3 4 3 h 4 c 1 . 4 5 0 3 1 . 6 9 3 3 . 5 0 1 . 4 1 - . 9 1 2 . 7 2 - 2 3 . 2 5 V 8 . 5 9 c . 5 8 - . 4 5 1 - 1 . 2 7 1 - 2 . 0 9 C 1 0 5 . 2 2 8 . 9 8 4 8 4 H 4 c - . 9 8 0 - 2 1 . 2 2 - 2 2 . 5 S 3 9 4 9 z m 9 - 3 h - 1 v 1 h 1 c 1 0 2 1 . 2 2 2 2 . 5 S 1 3 . 9 8 1 2 1 3 1 2 H 9 c - . 9 8 0 - 2 - 1 . 2 2 - 2 - 2 . 5 0 - . 8 3 . 4 2 - 1 . 6 4 1 - 2 . 0 9 V 6 . 2 5 c - 1 . 0 9 . 5 3 - 2 1 . 8 4 - 2 3 . 2 5 C 6 1 1 . 3 1 7 . 5 5 1 3 9 1 3 h 4 c 1 . 4 5 0 3 - 1 . 6 9 3 - 3 . 5 S 1 4 . 5 6 1 3 6 z " > < / p a t h > < / s v g > < / a > W r i t i n g < / h 3 > < p > T o w r i t e d a t a , a s i m i l a r d e f i n i t i o n i s u s e d b u t w i t h a d i f f e r e n t < c o d e > e s . r e s o u r c e < / c o d e > : < / p > < d i v c l a s s = " h i g h l i g h t h i g h l i g h t - s o u r c e - s q l " > < p r e > C R E A T E E X T E R N A L T A B L E a r t i s t s ( i d < s p a n c l a s s = " p l - k " > B I G I N T < / s p a n > , n a m e S T R I N G , l i n k s S T R U C T < s p a n c l a s s = " p l - k " > & l t ; < / s p a n > u r l : S T R I N G , p i c t u r e : S T R I N G < s p a n c l a s s = " p l - k " > & g t ; < / s p a n > ) S T O R E D B Y < s p a n c l a s s = " p l - s " > < s p a n c l a s s = " p l - p d s " > ' < / s p a n > o r g . e l a s t i c s e a r c h . h a d o o p . h i v e . E s S t o r a g e H a n d l e r < s p a n c l a s s = " p l - p d s " > ' < / s p a n > < / s p a n > T B L P R O P E R T I E S ( < s p a n c l a s s = " p l - s " > < s p a n c l a s s = " p l - p d s " > ' < / s p a n > e s . r e s o u r c e < s p a n c l a s s = " p l - p d s " > ' < / s p a n > < / s p a n > < s p a n c l a s s = " p l - k " > = < / s p a n > < s p a n c l a s s = " p l - s " > < s p a n c l a s s = " p l - p d s " > ' < / s p a n > r a d i o / a r t i s t s < s p a n c l a s s = " p l - p d s " > ' < / s p a n > < / s p a n > ) ; < / p r e > < / d i v > < p > A n y d a t a p a s s e d t o t h e t a b l e i s t h e n p a s s e d d o w n t o E l a s t i c s e a r c h ; f o r e x a m p l e c o n s i d e r i n g a t a b l e < c o d e > s < / c o d e > , m a p p e d t o a T S V / C S V f i l e , o n e c a n i n d e x i t t o E l a s t i c s e a r c h l i k e t h i s : < / p > < d i v c l a s s = " h i g h l i g h t h i g h l i g h t - s o u r c e - s q l " > < p r e > I N S E R T O V E R W R I T E T A B L E a r t i s t s < s p a n c l a s s = " p l - k " > S E L E C T < / s p a n > < s p a n c l a s s = " p l - k " > N U L L < / s p a n > , < s p a n c l a s s = " p l - c 1 " > s < / s p a n > . < s p a n c l a s s = " p l - c 1 " > n a m e < / s p a n > , n a m e d _ s t r u c t ( < s p a n c l a s s = " p l - s " > < s p a n c l a s s = " p l - p d s " > ' < / s p a n > u r l < s p a n c l a s s = " p l - p d s " > ' < / s p a n > < / s p a n > , < s p a n c l a s s = " p l - c 1 " > s < / s p a n > . < s p a n c l a s s = " p l - c 1 " > u r l < / s p a n > , < s p a n c l a s s = " p l - s " > < s p a n c l a s s = " p l - p d s " > ' < / s p a n > p i c t u r e < s p a n c l a s s = " p l - p d s " > ' < / s p a n > < / s p a n > , < s p a n c l a s s = " p l - c 1 " > s < / s p a n > . < s p a n c l a s s = " p l - c 1 " > p i c t u r e < / s p a n > ) < s p a n c l a s s = " p l - k " > F R O M < / s p a n > s o u r c e s ; < / p r e > < / d i v > < p > A s o n e c a n n o t e , c u r r e n t l y t h e r e a d i n g a n d w r i t i n g a r e t r e a t e d s e p a r a t e l y b u t w e ' r e w o r k i n g o n u n i f y i n g t h e t w o a n d a u t o m a t i c a l l y t r a n s l a t i n g < a h r e f = " h t t p : / / c w i k i . a p a c h e . o r g / c o n f l u e n c e / d i s p l a y / H i v e / L a n g u a g e M a n u a l " t a r g e t = " _ b l a n k " > H i v e Q L < / a > t o E l a s t i c s e a r c h q u e r i e s . < / p > < h 2 > < a i d = " u s e r - c o n t e n t - a p a c h e - p i g " c l a s s = " a n c h o r " h r e f = " h t t p s : / / g i t h u b . c o m / e l a s t i c / e l a s t i c s e a r c h - h a d o o p # a p a c h e - p i g " a r i a - h i d d e n = " t r u e " t a r g e t = " _ b l a n k " > < s v g a r i a - h i d d e n = " t r u e " c l a s s = " o c t i c o n o c t i c o n - l i n k " h e i g h t = " 1 6 " v e r s i o n = " 1 . 1 " v i e w b o x = " 0 0 1 6 1 6 " w i d t h = " 1 6 " > < p a t h f i l l - r u l e = " e v e n o d d " d = " M 4 9 h 1 v 1 H 4 c - 1 . 5 0 - 3 - 1 . 6 9 - 3 - 3 . 5 S 2 . 5 5 3 4 3 h 4 c 1 . 4 5 0 3 1 . 6 9 3 3 . 5 0 1 . 4 1 - . 9 1 2 . 7 2 - 2 3 . 2 5 V 8 . 5 9 c . 5 8 - . 4 5 1 - 1 . 2 7 1 - 2 . 0 9 C 1 0 5 . 2 2 8 . 9 8 4 8 4 H 4 c - . 9 8 0 - 2 1 . 2 2 - 2 2 . 5 S 3 9 4 9 z m 9 - 3 h - 1 v 1 h 1 c 1 0 2 1 . 2 2 2 2 . 5 S 1 3 . 9 8 1 2 1 3 1 2 H 9 c - . 9 8 0 - 2 - 1 . 2 2 - 2 - 2 . 5 0 - . 8 3 . 4 2 - 1 . 6 4 1 - 2 . 0 9 V 6 . 2 5 c - 1 . 0 9 . 5 3 - 2 1 . 8 4 - 2 3 . 2 5 C 6 1 1 . 3 1 7 . 5 5 1 3 9 1 3 h 4 c 1 . 4 5 0 3 - 1 . 6 9 3 - 3 . 5 S 1 4 . 5 6 1 3 6 z " > < / p a t h > < / s v g > < / a > < a h r e f = " h t t p : / / p i g . a p a c h e . o r g " t a r g e t = " _ b l a n k " > A p a c h e P i g < / a > < / h 2 > < p > E S - H a d o o p p r o v i d e s b o t h r e a d a n d w r i t e f u n c t i o n s f o r P i g s o y o u c a n a c c e s s E l a s t i c s e a r c h f r o m P i g s c r i p t s . < / p > < p > R e g i s t e r E S - H a d o o p j a r i n t o y o u r s c r i p t o r a d d i t t o y o u r P i g c l a s s p a t h : < / p > < p r e > < c o d e > R E G I S T E R / p a t h _ t o _ j a r / e s - h a d o o p - & l t ; v e r s i o n & g t ; . j a r ; < / c o d e > < / p r e > < p > A d d i t i o n a l l y o n e c a n d e f i n e a n a l i a s t o s a v e s o m e c h a r s : < / p > < p r e > < c o d e > % d e f i n e E S S T O R A G E o r g . e l a s t i c s e a r c h . h a d o o p . p i g . E s S t o r a g e ( ) < / c o d e > < / p r e > < p > a n d u s e < c o d e > $ E S S T O R A G E < / c o d e > f o r s t o r a g e d e f i n i t i o n . < / p > < h 3 > < a i d = " u s e r - c o n t e n t - r e a d i n g - 3 " c l a s s = " a n c h o r " h r e f = " h t t p s : / / g i t h u b . c o m / e l a s t i c / e l a s t i c s e a r c h - h a d o o p # r e a d i n g - 3 " a r i a - h i d d e n = " t r u e " t a r g e t = " _ b l a n k " > < s v g a r i a - h i d d e n = " t r u e " c l a s s = " o c t i c o n o c t i c o n - l i n k " h e i g h t = " 1 6 " v e r s i o n = " 1 . 1 " v i e w b o x = " 0 0 1 6 1 6 " w i d t h = " 1 6 " > < p a t h f i l l - r u l e = " e v e n o d d " d = " M 4 9 h 1 v 1 H 4 c - 1 . 5 0 - 3 - 1 . 6 9 - 3 - 3 . 5 S 2 . 5 5 3 4 3 h 4 c 1 . 4 5 0 3 1 . 6 9 3 3 . 5 0 1 . 4 1 - . 9 1 2 . 7 2 - 2 3 . 2 5 V 8 . 5 9 c . 5 8 - . 4 5 1 - 1 . 2 7 1 - 2 . 0 9 C 1 0 5 . 2 2 8 . 9 8 4 8 4 H 4 c - . 9 8 0 - 2 1 . 2 2 - 2 2 . 5 S 3 9 4 9 z m 9 - 3 h - 1 v 1 h 1 c 1 0 2 1 . 2 2 2 2 . 5 S 1 3 . 9 8 1 2 1 3 1 2 H 9 c - . 9 8 0 - 2 - 1 . 2 2 - 2 - 2 . 5 0 - . 8 3 . 4 2 - 1 . 6 4 1 - 2 . 0 9 V 6 . 2 5 c - 1 . 0 9 . 5 3 - 2 1 . 8 4 - 2 3 . 2 5 C 6 1 1 . 3 1 7 . 5 5 1 3 9 1 3 h 4 c 1 . 4 5 0 3 - 1 . 6 9 3 - 3 . 5 S 1 4 . 5 6 1 3 6 z " > < / p a t h > < / s v g > < / a > R e a d i n g < / h 3 > < p > T o r e a d d a t a f r o m E S , u s e < c o d e > E s S t o r a g e < / c o d e > a n d s p e c i f y t h e q u e r y t h r o u g h t h e < c o d e > L O A D < / c o d e > f u n c t i o n : < / p > < d i v c l a s s = " h i g h l i g h t h i g h l i g h t - s o u r c e - s q l " > < p r e > A < s p a n c l a s s = " p l - k " > = < / s p a n > L O A D < s p a n c l a s s = " p l - s " > < s p a n c l a s s = " p l - p d s " > ' < / s p a n > r a d i o / a r t i s t s < s p a n c l a s s = " p l - p d s " > ' < / s p a n > < / s p a n > U S I N G < s p a n c l a s s = " p l - c 1 " > o r g < / s p a n > . < s p a n c l a s s = " p l - c 1 " > e l a s t i c s e a r c h < / s p a n > . < s p a n c l a s s = " p l - c 1 " > h a d o o p < / s p a n > . < s p a n c l a s s = " p l - c 1 " > p i g < / s p a n > . E s S t o r a g e ( < s p a n c l a s s = " p l - s " > < s p a n c l a s s = " p l - p d s " > ' < / s p a n > e s . q u e r y = ? q = m e * < s p a n c l a s s = " p l - p d s " > ' < / s p a n > < / s p a n > ) ; D U M P A ; < / p r e > < / d i v > < h 3 > < a i d = " u s e r - c o n t e n t - w r i t i n g - 3 " c l a s s = " a n c h o r " h r e f = " h t t p s : / / g i t h u b . c o m / e l a s t i c / e l a s t i c s e a r c h - h a d o o p # w r i t i n g - 3 " a r i a - h i d d e n = " t r u e " t a r g e t = " _ b l a n k " > < s v g a r i a - h i d d e n = " t r u e " c l a s s = " o c t i c o n o c t i c o n - l i n k " h e i g h t = " 1 6 " v e r s i o n = " 1 . 1 " v i e w b o x = " 0 0 1 6 1 6 " w i d t h = " 1 6 " > < p a t h f i l l - r u l e = " e v e n o d d " d = " M 4 9 h 1 v 1 H 4 c - 1 . 5 0 - 3 - 1 . 6 9 - 3 - 3 . 5 S 2 . 5 5 3 4 3 h 4 c 1 . 4 5 0 3 1 . 6 9 3 3 . 5 0 1 . 4 1 - . 9 1 2 . 7 2 - 2 3 . 2 5 V 8 . 5 9 c . 5 8 - . 4 5 1 - 1 . 2 7 1 - 2 . 0 9 C 1 0 5 . 2 2 8 . 9 8 4 8 4 H 4 c - . 9 8 0 - 2 1 . 2 2 - 2 2 . 5 S 3 9 4 9 z m 9 - 3 h - 1 v 1 h 1 c 1 0 2 1 . 2 2 2 2 . 5 S 1 3 . 9 8 1 2 1 3 1 2 H 9 c - . 9 8 0 - 2 - 1 . 2 2 - 2 - 2 . 5 0 - . 8 3 . 4 2 - 1 . 6 4 1 - 2 . 0 9 V 6 . 2 5 c - 1 . 0 9 . 5 3 - 2 1 . 8 4 - 2 3 . 2 5 C 6 1 1 . 3 1 7 . 5 5 1 3 9 1 3 h 4 c 1 . 4 5 0 3 - 1 . 6 9 3 - 3 . 5 S 1 4 . 5 6 1 3 6 z " > < / p a t h > < / s v g > < / a > W r i t i n g < / h 3 > < p > U s e t h e s a m e < c o d e > S t o r a g e < / c o d e > t o w r i t e d a t a t o E l a s t i c s e a r c h : < / p > < d i v c l a s s = " h i g h l i g h t h i g h l i g h t - s o u r c e - s q l " > < p r e > A < s p a n c l a s s = " p l - k " > = < / s p a n > L O A D < s p a n c l a s s = " p l - s " > < s p a n c l a s s = " p l - p d s " > ' < / s p a n > s r c / a r t i s t s . d a t < s p a n c l a s s = " p l - p d s " > ' < / s p a n > < / s p a n > U S I N G P i g S t o r a g e ( ) < s p a n c l a s s = " p l - k " > A S < / s p a n > ( i d : l o n g , n a m e , u r l : c h a r a r r a y , p i c t u r e : c h a r a r r a y ) ; B < s p a n c l a s s = " p l - k " > = < / s p a n > F O R E A C H A G E N E R A T E n a m e , T O T U P L E ( u r l , p i c t u r e ) < s p a n c l a s s = " p l - k " > A S < / s p a n > l i n k s ; S T O R E B I N T O < s p a n c l a s s = " p l - s " > < s p a n c l a s s = " p l - p d s " > ' < / s p a n > r a d i o / a r t i s t s < s p a n c l a s s = " p l - p d s " > ' < / s p a n > < / s p a n > U S I N G < s p a n c l a s s = " p l - c 1 " > o r g < / s p a n > . < s p a n c l a s s = " p l - c 1 " > e l a s t i c s e a r c h < / s p a n > . < s p a n c l a s s = " p l - c 1 " > h a d o o p < / s p a n > . < s p a n c l a s s = " p l - c 1 " > p i g < / s p a n > . E s S t o r a g e ( ) ; < / p r e > < / d i v > < h 2 > < a i d = " u s e r - c o n t e n t - a p a c h e - s p a r k " c l a s s = " a n c h o r " h r e f = " h t t p s : / / g i t h u b . c o m / e l a s t i c / e l a s t i c s e a r c h - h a d o o p # a p a c h e - s p a r k " a r i a - h i d d e n = " t r u e " t a r g e t = " _ b l a n k " > < s v g a r i a - h i d d e n = " t r u e " c l a s s = " o c t i c o n o c t i c o n - l i n k " h e i g h t = " 1 6 " v e r s i o n = " 1 . 1 " v i e w b o x = " 0 0 1 6 1 6 " w i d t h = " 1 6 " > < p a t h f i l l - r u l e = " e v e n o d d " d = " M 4 9 h 1 v 1 H 4 c - 1 . 5 0 - 3 - 1 . 6 9 - 3 - 3 . 5 S 2 . 5 5 3 4 3 h 4 c 1 . 4 5 0 3 1 . 6 9 3 3 . 5 0 1 . 4 1 - . 9 1 2 . 7 2 - 2 3 . 2 5 V 8 . 5 9 c . 5 8 - . 4 5 1 - 1 . 2 7 1 - 2 . 0 9 C 1 0 5 . 2 2 8 . 9 8 4 8 4 H 4 c - . 9 8 0 - 2 1 . 2 2 - 2 2 . 5 S 3 9 4 9 z m 9 - 3 h - 1 v 1 h 1 c 1 0 2 1 . 2 2 2 2 . 5 S 1 3 . 9 8 1 2 1 3 1 2 H 9 c - . 9 8 0 - 2 - 1 . 2 2 - 2 - 2 . 5 0 - . 8 3 . 4 2 - 1 . 6 4 1 - 2 . 0 9 V 6 . 2 5 c - 1 . 0 9 . 5 3 - 2 1 . 8 4 - 2 3 . 2 5 C 6 1 1 . 3 1 7 . 5 5 1 3 9 1 3 h 4 c 1 . 4 5 0 3 - 1 . 6 9 3 - 3 . 5 S 1 4 . 5 6 1 3 6 z " > < / p a t h > < / s v g > < / a > < a h r e f = " h t t p : / / s p a r k . a p a c h e . o r g " t a r g e t = " _ b l a n k " > A p a c h e S p a r k < / a > < / h 2 > < p > E S - H a d o o p p r o v i d e s n a t i v e ( J a v a a n d S c a l a ) i n t e g r a t i o n w i t h S p a r k : f o r r e a d i n g a d e d i c a t e d < c o d e > R D D < / c o d e > a n d f o r w r i t i n g , m e t h o d s t h a t w o r k o n a n y < c o d e > R D D < / c o d e > . S p a r k S Q L i s a l s o s u p p o r t e d < / p > < h 3 > < a i d = " u s e r - c o n t e n t - s c a l a " c l a s s = " a n c h o r " h r e f = " h t t p s : / / g i t h u b . c o m / e l a s t i c / e l a s t i c s e a r c h - h a d o o p # s c a l a " a r i a - h i d d e n = " t r u e " t a r g e t = " _ b l a n k " > < s v g a r i a - h i d d e n = " t r u e " c l a s s = " o c t i c o n o c t i c o n - l i n k " h e i g h t = " 1 6 " v e r s i o n = " 1 . 1 " v i e w b o x = " 0 0 1 6 1 6 " w i d t h = " 1 6 " > < p a t h f i l l - r u l e = " e v e n o d d " d = " M 4 9 h 1 v 1 H 4 c - 1 . 5 0 - 3 - 1 . 6 9 - 3 - 3 . 5 S 2 . 5 5 3 4 3 h 4 c 1 . 4 5 0 3 1 . 6 9 3 3 . 5 0 1 . 4 1 - . 9 1 2 . 7 2 - 2 3 . 2 5 V 8 . 5 9 c . 5 8 - . 4 5 1 - 1 . 2 7 1 - 2 . 0 9 C 1 0 5 . 2 2 8 . 9 8 4 8 4 H 4 c - . 9 8 0 - 2 1 . 2 2 - 2 2 . 5 S 3 9 4 9 z m 9 - 3 h - 1 v 1 h 1 c 1 0 2 1 . 2 2 2 2 . 5 S 1 3 . 9 8 1 2 1 3 1 2 H 9 c - . 9 8 0 - 2 - 1 . 2 2 - 2 - 2 . 5 0 - . 8 3 . 4 2 - 1 . 6 4 1 - 2 . 0 9 V 6 . 2 5 c - 1 . 0 9 . 5 3 - 2 1 . 8 4 - 2 3 . 2 5 C 6 1 1 . 3 1 7 . 5 5 1 3 9 1 3 h 4 c 1 . 4 5 0 3 - 1 . 6 9 3 - 3 . 5 S 1 4 . 5 6 1 3 6 z " > < / p a t h > < / s v g > < / a > S c a l a < / h 3 > < h 3 > < a i d = " u s e r - c o n t e n t - r e a d i n g - 4 " c l a s s = " a n c h o r " h r e f = " h t t p s : / / g i t h u b . c o m / e l a s t i c / e l a s t i c s e a r c h - h a d o o p # r e a d i n g - 4 " a r i a - h i d d e n = " t r u e " t a r g e t = " _ b l a n k " > < s v g a r i a - h i d d e n = " t r u e " c l a s s = " o c t i c o n o c t i c o n - l i n k " h e i g h t = " 1 6 " v e r s i o n = " 1 . 1 " v i e w b o x = " 0 0 1 6 1 6 " w i d t h = " 1 6 " > < p a t h f i l l - r u l e = " e v e n o d d " d = " M 4 9 h 1 v 1 H 4 c - 1 . 5 0 - 3 - 1 . 6 9 - 3 - 3 . 5 S 2 . 5 5 3 4 3 h 4 c 1 . 4 5 0 3 1 . 6 9 3 3 . 5 0 1 . 4 1 - . 9 1 2 . 7 2 - 2 3 . 2 5 V 8 . 5 9 c . 5 8 - . 4 5 1 - 1 . 2 7 1 - 2 . 0 9 C 1 0 5 . 2 2 8 . 9 8 4 8 4 H 4 c - . 9 8 0 - 2 1 . 2 2 - 2 2 . 5 S 3 9 4 9 z m 9 - 3 h - 1 v 1 h 1 c 1 0 2 1 . 2 2 2 2 . 5 S 1 3 . 9 8 1 2 1 3 1 2 H 9 c - . 9 8 0 - 2 - 1 . 2 2 - 2 - 2 . 5 0 - . 8 3 . 4 2 - 1 . 6 4 1 - 2 . 0 9 V 6 . 2 5 c - 1 . 0 9 . 5 3 - 2 1 . 8 4 - 2 3 . 2 5 C 6 1 1 . 3 1 7 . 5 5 1 3 9 1 3 h 4 c 1 . 4 5 0 3 - 1 . 6 9 3 - 3 . 5 S 1 4 . 5 6 1 3 6 z " > < / p a t h > < / s v g > < / a > R e a d i n g < / h 3 > < p > T o r e a d d a t a f r o m E S , c r e a t e a d e d i c a t e d < c o d e > R D D < / c o d e > a n d s p e c i f y t h e q u e r y a s a n a r g u m e n t : < / p > < d i v c l a s s = " h i g h l i g h t h i g h l i g h t - s o u r c e - s c a l a " > < p r e > < s p a n c l a s s = " p l - k " > i m p o r t < / s p a n > < s p a n c l a s s = " p l - v " > o r g . e l a s t i c s e a r c h . s p a r k . < / s p a n > < s p a n c l a s s = " p l - v " > _ < / s p a n > . . < s p a n c l a s s = " p l - k " > v a l < / s p a n > < s p a n c l a s s = " p l - e n " > c o n f < / s p a n > < s p a n c l a s s = " p l - k " > = < / s p a n > . . . < s p a n c l a s s = " p l - k " > v a l < / s p a n > < s p a n c l a s s = " p l - e n " > s c < / s p a n > < s p a n c l a s s = " p l - k " > = < / s p a n > < s p a n c l a s s = " p l - k " > n e w < / s p a n > < s p a n c l a s s = " p l - e n " > S p a r k C o n t e x t < / s p a n > ( c o n f ) s c . e s R D D ( < s p a n c l a s s = " p l - s " > < s p a n c l a s s = " p l - p d s " > " < / s p a n > r a d i o / a r t i s t s < s p a n c l a s s = " p l - p d s " > " < / s p a n > < / s p a n > , < s p a n c l a s s = " p l - s " > < s p a n c l a s s = " p l - p d s " > " < / s p a n > ? q = m e * < s p a n c l a s s = " p l - p d s " > " < / s p a n > < / s p a n > ) < / p r e > < / d i v > < h 4 > < a i d = " u s e r - c o n t e n t - s p a r k - s q l " c l a s s = " a n c h o r " h r e f = " h t t p s : / / g i t h u b . c o m / e l a s t i c / e l a s t i c s e a r c h - h a d o o p # s p a r k - s q l " a r i a - h i d d e n = " t r u e " t a r g e t = " _ b l a n k " > < s v g a r i a - h i d d e n = " t r u e " c l a s s = " o c t i c o n o c t i c o n - l i n k " h e i g h t = " 1 6 " v e r s i o n = " 1 . 1 " v i e w b o x = " 0 0 1 6 1 6 " w i d t h = " 1 6 " > < p a t h f i l l - r u l e = " e v e n o d d " d = " M 4 9 h 1 v 1 H 4 c - 1 . 5 0 - 3 - 1 . 6 9 - 3 - 3 . 5 S 2 . 5 5 3 4 3 h 4 c 1 . 4 5 0 3 1 . 6 9 3 3 . 5 0 1 . 4 1 - . 9 1 2 . 7 2 - 2 3 . 2 5 V 8 . 5 9 c . 5 8 - . 4 5 1 - 1 . 2 7 1 - 2 . 0 9 C 1 0 5 . 2 2 8 . 9 8 4 8 4 H 4 c - . 9 8 0 - 2 1 . 2 2 - 2 2 . 5 S 3 9 4 9 z m 9 - 3 h - 1 v 1 h 1 c 1 0 2 1 . 2 2 2 2 . 5 S 1 3 . 9 8 1 2 1 3 1 2 H 9 c - . 9 8 0 - 2 - 1 . 2 2 - 2 - 2 . 5 0 - . 8 3 . 4 2 - 1 . 6 4 1 - 2 . 0 9 V 6 . 2 5 c - 1 . 0 9 . 5 3 - 2 1 . 8 4 - 2 3 . 2 5 C 6 1 1 . 3 1 7 . 5 5 1 3 9 1 3 h 4 c 1 . 4 5 0 3 - 1 . 6 9 3 - 3 . 5 S 1 4 . 5 6 1 3 6 z " > < / p a t h > < / s v g > < / a > S p a r k S Q L < / h 4 > < d i v c l a s s = " h i g h l i g h t h i g h l i g h t - s o u r c e - s c a l a " > < p r e > < s p a n c l a s s = " p l - k " > i m p o r t < / s p a n > < s p a n c l a s s = " p l - v " > o r g . e l a s t i c s e a r c h . s p a r k . s q l . < / s p a n > < s p a n c l a s s = " p l - v " > _ < / s p a n > < s p a n c l a s s = " p l - c " > < s p a n c l a s s = " p l - c " > / / < / s p a n > D a t a F r a m e s c h e m a a u t o m a t i c a l l y i n f e r r e d < / s p a n > < s p a n c l a s s = " p l - k " > v a l < / s p a n > < s p a n c l a s s = " p l - e n " > d f < / s p a n > < s p a n c l a s s = " p l - k " > = < / s p a n > s q l C o n t e x t . r e a d . f o r m a t ( < s p a n c l a s s = " p l - s " > < s p a n c l a s s = " p l - p d s " > " < / s p a n > e s < s p a n c l a s s = " p l - p d s " > " < / s p a n > < / s p a n > ) . l o a d ( < s p a n c l a s s = " p l - s " > < s p a n c l a s s = " p l - p d s " > " < / s p a n > b u c k e t h e a d / a l b u m s < s p a n c l a s s = " p l - p d s " > " < / s p a n > < / s p a n > ) < s p a n c l a s s = " p l - c " > < s p a n c l a s s = " p l - c " > / / < / s p a n > o p e r a t i o n s g e t p u s h e d d o w n a n d t r a n s l a t e d a t r u n t i m e t o E l a s t i c s e a r c h Q u e r y D S L < / s p a n > < s p a n c l a s s = " p l - k " > v a l < / s p a n > < s p a n c l a s s = " p l - e n " > p l a y l i s t < / s p a n > < s p a n c l a s s = " p l - k " > = < / s p a n > d f . f i l t e r ( d f ( < s p a n c l a s s = " p l - s " > < s p a n c l a s s = " p l - p d s " > " < / s p a n > c a t e g o r y < s p a n c l a s s = " p l - p d s " > " < / s p a n > < / s p a n > ) . e q u a l T o ( < s p a n c l a s s = " p l - s " > < s p a n c l a s s = " p l - p d s " > " < / s p a n > p i k e s < s p a n c l a s s = " p l - p d s " > " < / s p a n > < / s p a n > ) . a n d ( d f ( < s p a n c l a s s = " p l - s " > < s p a n c l a s s = " p l - p d s " > " < / s p a n > y e a r < s p a n c l a s s = " p l - p d s " > " < / s p a n > < / s p a n > ) . g e q ( < s p a n c l a s s = " p l - c 1 " > 2 0 1 6 < / s p a n > ) ) ) < / p r e > < / d i v > < h 3 > < a i d = " u s e r - c o n t e n t - w r i t i n g - 4 " c l a s s = " a n c h o r " h r e f = " h t t p s : / / g i t h u b . c o m / e l a s t i c / e l a s t i c s e a r c h - h a d o o p # w r i t i n g - 4 " a r i a - h i d d e n = " t r u e " t a r g e t = " _ b l a n k " > < s v g a r i a - h i d d e n = " t r u e " c l a s s = " o c t i c o n o c t i c o n - l i n k " h e i g h t = " 1 6 " v e r s i o n = " 1 . 1 " v i e w b o x = " 0 0 1 6 1 6 " w i d t h = " 1 6 " > < p a t h f i l l - r u l e = " e v e n o d d " d = " M 4 9 h 1 v 1 H 4 c - 1 . 5 0 - 3 - 1 . 6 9 - 3 - 3 . 5 S 2 . 5 5 3 4 3 h 4 c 1 . 4 5 0 3 1 . 6 9 3 3 . 5 0 1 . 4 1 - . 9 1 2 . 7 2 - 2 3 . 2 5 V 8 . 5 9 c . 5 8 - . 4 5 1 - 1 . 2 7 1 - 2 . 0 9 C 1 0 5 . 2 2 8 . 9 8 4 8 4 H 4 c - . 9 8 0 - 2 1 . 2 2 - 2 2 . 5 S 3 9 4 9 z m 9 - 3 h - 1 v 1 h 1 c 1 0 2 1 . 2 2 2 2 . 5 S 1 3 . 9 8 1 2 1 3 1 2 H 9 c - . 9 8 0 - 2 - 1 . 2 2 - 2 - 2 . 5 0 - . 8 3 . 4 2 - 1 . 6 4 1 - 2 . 0 9 V 6 . 2 5 c - 1 . 0 9 . 5 3 - 2 1 . 8 4 - 2 3 . 2 5 C 6 1 1 . 3 1 7 . 5 5 1 3 9 1 3 h 4 c 1 . 4 5 0 3 - 1 . 6 9 3 - 3 . 5 S 1 4 . 5 6 1 3 6 z " > < / p a t h > < / s v g > < / a > W r i t i n g < / h 3 > < p > I m p o r t t h e < c o d e > o r g . e l a s t i c s e a r c h . s p a r k . _ < / c o d e > p a c k a g e t o g a i n < c o d e > s a v e t o E s < / c o d e > m e t h o d s o n y o u r < c o d e > R D D < / c o d e > s : < / p > < d i v c l a s s = " h i g h l i g h t h i g h l i g h t - s o u r c e - s c a l a " > < p r e > < s p a n c l a s s = " p l - k " > i m p o r t < / s p a n > < s p a n c l a s s = " p l - v " > o r g . e l a s t i c s e a r c h . s p a r k . < / s p a n > < s p a n c l a s s = " p l - v " > _ < / s p a n > < s p a n c l a s s = " p l - k " > v a l < / s p a n > < s p a n c l a s s = " p l - e n " > c o n f < / s p a n > < s p a n c l a s s = " p l - k " > = < / s p a n > . . . < s p a n c l a s s = " p l - k " > v a l < / s p a n > < s p a n c l a s s = " p l - e n " > s c < / s p a n > < s p a n c l a s s = " p l - k " > = < / s p a n > < s p a n c l a s s = " p l - k " > n e w < / s p a n > < s p a n c l a s s = " p l - e n " > S p a r k C o n t e x t < / s p a n > ( c o n f ) < s p a n c l a s s = " p l - k " > v a l < / s p a n > < s p a n c l a s s = " p l - e n " > n u m b e r s < / s p a n > < s p a n c l a s s = " p l - k " > = < / s p a n > < s p a n c l a s s = " p l - e n " > M a p < / s p a n > ( < s p a n c l a s s = " p l - s " > < s p a n c l a s s = " p l - p d s " > " < / s p a n > o n e < s p a n c l a s s = " p l - p d s " > " < / s p a n > < / s p a n > < s p a n c l a s s = " p l - k " > - < / s p a n > < s p a n c l a s s = " p l - k " > & g t ; < / s p a n > < s p a n c l a s s = " p l - c 1 " > 1 < / s p a n > , < s p a n c l a s s = " p l - s " > < s p a n c l a s s = " p l - p d s " > " < / s p a n > t w o < s p a n c l a s s = " p l - p d s " > " < / s p a n > < / s p a n > < s p a n c l a s s = " p l - k " > - < / s p a n > < s p a n c l a s s = " p l - k " > & g t ; < / s p a n > < s p a n c l a s s = " p l - c 1 " > 2 < / s p a n > , < s p a n c l a s s = " p l - s " > < s p a n c l a s s = " p l - p d s " > " < / s p a n > t h r e e < s p a n c l a s s = " p l - p d s " > " < / s p a n > < / s p a n > < s p a n c l a s s = " p l - k " > - < / s p a n > < s p a n c l a s s = " p l - k " > & g t ; < / s p a n > < s p a n c l a s s = " p l - c 1 " > 3 < / s p a n > ) < s p a n c l a s s = " p l - k " > v a l < / s p a n > < s p a n c l a s s = " p l - e n " > a i r p o r t s < / s p a n > < s p a n c l a s s = " p l - k " > = < / s p a n > < s p a n c l a s s = " p l - e n " > M a p < / s p a n > ( < s p a n c l a s s = " p l - s " > < s p a n c l a s s = " p l - p d s " > " < / s p a n > O T P < s p a n c l a s s = " p l - p d s " > " < / s p a n > < / s p a n > < s p a n c l a s s = " p l - k " > - < / s p a n > < s p a n c l a s s = " p l - k " > & g t ; < / s p a n > < s p a n c l a s s = " p l - s " > < s p a n c l a s s = " p l - p d s " > " < / s p a n > O t o p e n i < s p a n c l a s s = " p l - p d s " > " < / s p a n > < / s p a n > , < s p a n c l a s s = " p l - s " > < s p a n c l a s s = " p l - p d s " > " < / s p a n > S F O < s p a n c l a s s = " p l - p d s " > " < / s p a n > < / s p a n > < s p a n c l a s s = " p l - k " > - < / s p a n > < s p a n c l a s s = " p l - k " > & g t ; < / s p a n > < s p a n c l a s s = " p l - s " > < s p a n c l a s s = " p l - p d s " > " < / s p a n > S a n F r a n < s p a n c l a s s = " p l - p d s " > " < / s p a n > < / s p a n > ) s c . m a k e R D D ( < s p a n c l a s s = " p l - e n " > S e q < / s p a n > ( n u m b e r s , a i r p o r t s ) ) . s a v e T o E s ( < s p a n c l a s s = " p l - s " > < s p a n c l a s s = " p l - p d s " > " < / s p a n > s p a r k / d o c s < s p a n c l a s s = " p l - p d s " > " < / s p a n > < / s p a n > ) < / p r e > < / d i v > < h 4 > < a i d = " u s e r - c o n t e n t - s p a r k - s q l - 1 " c l a s s = " a n c h o r " h r e f = " h t t p s : / / g i t h u b . c o m / e l a s t i c / e l a s t i c s e a r c h - h a d o o p # s p a r k - s q l - 1 " a r i a - h i d d e n = " t r u e " t a r g e t = " _ b l a n k " > < s v g a r i a - h i d d e n = " t r u e " c l a s s = " o c t i c o n o c t i c o n - l i n k " h e i g h t = " 1 6 " v e r s i o n = " 1 . 1 " v i e w b o x = " 0 0 1 6 1 6 " w i d t h = " 1 6 " > < p a t h f i l l - r u l e = " e v e n o d d " d = " M 4 9 h 1 v 1 H 4 c - 1 . 5 0 - 3 - 1 . 6 9 - 3 - 3 . 5 S 2 . 5 5 3 4 3 h 4 c 1 . 4 5 0 3 1 . 6 9 3 3 . 5 0 1 . 4 1 - . 9 1 2 . 7 2 - 2 3 . 2 5 V 8 . 5 9 c . 5 8 - . 4 5 1 - 1 . 2 7 1 - 2 . 0 9 C 1 0 5 . 2 2 8 . 9 8 4 8 4 H 4 c - . 9 8 0 - 2 1 . 2 2 - 2 2 . 5 S 3 9 4 9 z m 9 - 3 h - 1 v 1 h 1 c 1 0 2 1 . 2 2 2 2 . 5 S 1 3 . 9 8 1 2 1 3 1 2 H 9 c - . 9 8 0 - 2 - 1 . 2 2 - 2 - 2 . 5 0 - . 8 3 . 4 2 - 1 . 6 4 1 - 2 . 0 9 V 6 . 2 5 c - 1 . 0 9 . 5 3 - 2 1 . 8 4 - 2 3 . 2 5 C 6 1 1 . 3 1 7 . 5 5 1 3 9 1 3 h 4 c 1 . 4 5 0 3 - 1 . 6 9 3 - 3 . 5 S 1 4 . 5 6 1 3 6 z " > < / p a t h > < / s v g > < / a > S p a r k S Q L < / h 4 > < d i v c l a s s = " h i g h l i g h t h i g h l i g h t - s o u r c e - s c a l a " > < p r e > < s p a n c l a s s = " p l - k " > i m p o r t < / s p a n > < s p a n c l a s s = " p l - v " > o r g . e l a s t i c s e a r c h . s p a r k . s q l . < / s p a n > < s p a n c l a s s = " p l - v " > _ < / s p a n > < s p a n c l a s s = " p l - k " > v a l < / s p a n > < s p a n c l a s s = " p l - e n " > d f < / s p a n > < s p a n c l a s s = " p l - k " > = < / s p a n > s q l C o n t e x t . r e a d . j s o n ( < s p a n c l a s s = " p l - s " > < s p a n c l a s s = " p l - p d s " > " < / s p a n > e x a m p l e s / p e o p l e . j s o n < s p a n c l a s s = " p l - p d s " > " < / s p a n > < / s p a n > ) d f . s a v e T o E S ( < s p a n c l a s s = " p l - s " > < s p a n c l a s s = " p l - p d s " > " < / s p a n > s p a r k / p e o p l e < s p a n c l a s s = " p l - p d s " > " < / s p a n > < / s p a n > ) < / p r e > < / d i v > < h 3 > < a i d = " u s e r - c o n t e n t - j a v a " c l a s s = " a n c h o r " h r e f = " h t t p s : / / g i t h u b . c o m / e l a s t i c / e l a s t i c s e a r c h - h a d o o p # j a v a " a r i a - h i d d e n = " t r u e " t a r g e t = " _ b l a n k " > < s v g a r i a - h i d d e n = " t r u e " c l a s s = " o c t i c o n o c t i c o n - l i n k " h e i g h t = " 1 6 " v e r s i o n = " 1 . 1 " v i e w b o x = " 0 0 1 6 1 6 " w i d t h = " 1 6 " > < p a t h f i l l - r u l e = " e v e n o d d " d = " M 4 9 h 1 v 1 H 4 c - 1 . 5 0 - 3 - 1 . 6 9 - 3 - 3 . 5 S 2 . 5 5 3 4 3 h 4 c 1 . 4 5 0 3 1 . 6 9 3 3 . 5 0 1 . 4 1 - . 9 1 2 . 7 2 - 2 3 . 2 5 V 8 . 5 9 c . 5 8 - . 4 5 1 - 1 . 2 7 1 - 2 . 0 9 C 1 0 5 . 2 2 8 . 9 8 4 8 4 H 4 c - . 9 8 0 - 2 1 . 2 2 - 2 2 . 5 S 3 9 4 9 z m 9 - 3 h - 1 v 1 h 1 c 1 0 2 1 . 2 2 2 2 . 5 S 1 3 . 9 8 1 2 1 3 1 2 H 9 c - . 9 8 0 - 2 - 1 . 2 2 - 2 - 2 . 5 0 - . 8 3 . 4 2 - 1 . 6 4 1 - 2 . 0 9 V 6 . 2 5 c - 1 . 0 9 . 5 3 - 2 1 . 8 4 - 2 3 . 2 5 C 6 1 1 . 3 1 7 . 5 5 1 3 9 1 3 h 4 c 1 . 4 5 0 3 - 1 . 6 9 3 - 3 . 5 S 1 4 . 5 6 1 3 6 z " > < / p a t h > < / s v g > < / a > J a v a < / h 3 > < p > I n a J a v a e n v i r o n m e n t , u s e t h e < c o d e > o r g . e l a s t i c s e a r c h . s p a r k . r d d . j a v a . a p i < / c o d e > p a c k a g e , i n p a r t i c u l a r t h e < c o d e > J a v a E s S p a r k < / c o d e > c l a s s . < / p > < h 3 > < a i d = " u s e r - c o n t e n t - r e a d i n g - 5 " c l a s s = " a n c h o r " h r e f = " h t t p s : / / g i t h u b . c o m / e l a s t i c / e l a s t i c s e a r c h - h a d o o p # r e a d i n g - 5 " a r i a - h i d d e n = " t r u e " t a r g e t = " _ b l a n k " > < s v g a r i a - h i d d e n = " t r u e " c l a s s = " o c t i c o n o c t i c o n - l i n k " h e i g h t = " 1 6 " v e r s i o n = " 1 . 1 " v i e w b o x = " 0 0 1 6 1 6 " w i d t h = " 1 6 " > < p a t h f i l l - r u l e = " e v e n o d d " d = " M 4 9 h 1 v 1 H 4 c - 1 . 5 0 - 3 - 1 . 6 9 - 3 - 3 . 5 S 2 . 5 5 3 4 3 h 4 c 1 . 4 5 0 3 1 . 6 9 3 3 . 5 0 1 . 4 1 - . 9 1 2 . 7 2 - 2 3 . 2 5 V 8 . 5 9 c . 5 8 - . 4 5 1 - 1 . 2 7 1 - 2 . 0 9 C 1 0 5 . 2 2 8 . 9 8 4 8 4 H 4 c - . 9 8 0 - 2 1 . 2 2 - 2 2 . 5 S 3 9 4 9 z m 9 - 3 h - 1 v 1 h 1 c 1 0 2 1 . 2 2 2 2 . 5 S 1 3 . 9 8 1 2 1 3 1 2 H 9 c - . 9 8 0 - 2 - 1 . 2 2 - 2 - 2 . 5 0 - . 8 3 . 4 2 - 1 . 6 4 1 - 2 . 0 9 V 6 . 2 5 c - 1 . 0 9 . 5 3 - 2 1 . 8 4 - 2 3 . 2 5 C 6 1 1 . 3 1 7 . 5 5 1 3 9 1 3 h 4 c 1 . 4 5 0 3 - 1 . 6 9 3 - 3 . 5 S 1 4 . 5 6 1 3 6 z " > < / p a t h > < / s v g > < / a > R e a d i n g < / h 3 > < p > T o r e a d d a t a f r o m E S , c r e a t e a d e d i c a t e d < c o d e > R D D < / c o d e > a n d s p e c i f y t h e q u e r y a s a n a r g u m e n t . < / p > < d i v c l a s s = " h i g h l i g h t h i g h l i g h t - s o u r c e - j a v a " > < p r e > < s p a n c l a s s = " p l - k " > i m p o r t < / s p a n > < s p a n c l a s s = " p l - s m i " > o r g . a p a c h e . s p a r k . a p i . j a v a . J a v a S p a r k C o n t e x t < / s p a n > ; < s p a n c l a s s = " p l - k " > i m p o r t < / s p a n > < s p a n c l a s s = " p l - s m i " > o r g . e l a s t i c s e a r c h . s p a r k . r d d . a p i . j a v a . J a v a E s S p a r k < / s p a n > ; < s p a n c l a s s = " p l - s m i " > S p a r k C o n f < / s p a n > c o n f < s p a n c l a s s = " p l - k " > = < / s p a n > < s p a n c l a s s = " p l - c 1 " > . . . < / s p a n > < s p a n c l a s s = " p l - s m i " > J a v a S p a r k C o n t e x t < / s p a n > j s c < s p a n c l a s s = " p l - k " > = < / s p a n > < s p a n c l a s s = " p l - k " > n e w < / s p a n > < s p a n c l a s s = " p l - s m i " > J a v a S p a r k C o n t e x t < / s p a n > ( c o n f ) ; < s p a n c l a s s = " p l - k " > J a v a P a i r R D D & l t ; < s p a n c l a s s = " p l - s m i " > S t r i n g < / s p a n > , < s p a n c l a s s = " p l - k " > M a p & l t ; < s p a n c l a s s = " p l - s m i " > S t r i n g < / s p a n > , < s p a n c l a s s = " p l - s m i " > O b j e c t < / s p a n > & g t ; < / s p a n > & g t ; < / s p a n > e s R D D < s p a n c l a s s = " p l - k " > = < / s p a n > < s p a n c l a s s = " p l - s m i " > J a v a E s S p a r k < / s p a n > < s p a n c l a s s = " p l - k " > . < / s p a n > e s R D D ( j s c , < s p a n c l a s s = " p l - s " > < s p a n c l a s s = " p l - p d s " > " < / s p a n > r a d i o / a r t i s t s < s p a n c l a s s = " p l - p d s " > " < / s p a n > < / s p a n > ) ; < / p r e > < / d i v > < h 4 > < a i d = " u s e r - c o n t e n t - s p a r k - s q l - 2 " c l a s s = " a n c h o r " h r e f = " h t t p s : / / g i t h u b . c o m / e l a s t i c / e l a s t i c s e a r c h - h a d o o p # s p a r k - s q l - 2 " a r i a - h i d d e n = " t r u e " t a r g e t = " _ b l a n k " > < s v g a r i a - h i d d e n = " t r u e " c l a s s = " o c t i c o n o c t i c o n - l i n k " h e i g h t = " 1 6 " v e r s i o n = " 1 . 1 " v i e w b o x = " 0 0 1 6 1 6 " w i d t h = " 1 6 " > < p a t h f i l l - r u l e = " e v e n o d d " d = " M 4 9 h 1 v 1 H 4 c - 1 . 5 0 - 3 - 1 . 6 9 - 3 - 3 . 5 S 2 . 5 5 3 4 3 h 4 c 1 . 4 5 0 3 1 . 6 9 3 3 . 5 0 1 . 4 1 - . 9 1 2 . 7 2 - 2 3 . 2 5 V 8 . 5 9 c . 5 8 - . 4 5 1 - 1 . 2 7 1 - 2 . 0 9 C 1 0 5 . 2 2 8 . 9 8 4 8 4 H 4 c - . 9 8 0 - 2 1 . 2 2 - 2 2 . 5 S 3 9 4 9 z m 9 - 3 h - 1 v 1 h 1 c 1 0 2 1 . 2 2 2 2 . 5 S 1 3 . 9 8 1 2 1 3 1 2 H 9 c - . 9 8 0 - 2 - 1 . 2 2 - 2 - 2 . 5 0 - . 8 3 . 4 2 - 1 . 6 4 1 - 2 . 0 9 V 6 . 2 5 c - 1 . 0 9 . 5 3 - 2 1 . 8 4 - 2 3 . 2 5 C 6 1 1 . 3 1 7 . 5 5 1 3 9 1 3 h 4 c 1 . 4 5 0 3 - 1 . 6 9 3 - 3 . 5 S 1 4 . 5 6 1 3 6 z " > < / p a t h > < / s v g > < / a > S p a r k S Q L < / h 4 > < d i v c l a s s = " h i g h l i g h t h i g h l i g h t - s o u r c e - j a v a " > < p r e > < s p a n c l a s s = " p l - s m i " > S Q L C o n t e x t < / s p a n > s q l < s p a n c l a s s = " p l - k " > = < / s p a n > < s p a n c l a s s = " p l - k " > n e w < / s p a n > < s p a n c l a s s = " p l - s m i " > S Q L C o n t e x t < / s p a n > ( s c ) ; < s p a n c l a s s = " p l - s m i " > D a t a F r a m e < / s p a n > d f < s p a n c l a s s = " p l - k " > = < / s p a n > s q l < s p a n c l a s s = " p l - k " > . < / s p a n > r e a d ( ) < s p a n c l a s s = " p l - k " > . < / s p a n > f o r m a t ( < s p a n c l a s s = " p l - s " > < s p a n c l a s s = " p l - p d s " > " < / s p a n > e s < s p a n c l a s s = " p l - p d s " > " < / s p a n > < / s p a n > ) < s p a n c l a s s = " p l - k " > . < / s p a n > l o a d ( < s p a n c l a s s = " p l - s " > < s p a n c l a s s = " p l - p d s " > " < / s p a n > b u c k e t h e a d / a l b u m s < s p a n c l a s s = " p l - p d s " > " < / s p a n > < / s p a n > ) ; < s p a n c l a s s = " p l - s m i " > D a t a F r a m e < / s p a n > p l a y l i s t < s p a n c l a s s = " p l - k " > = < / s p a n > d f < s p a n c l a s s = " p l - k " > . < / s p a n > f i l t e r ( d f < s p a n c l a s s = " p l - k " > . < / s p a n > c o l ( < s p a n c l a s s = " p l - s " > < s p a n c l a s s = " p l - p d s " > " < / s p a n > c a t e g o r y < s p a n c l a s s = " p l - p d s " > " < / s p a n > < / s p a n > ) < s p a n c l a s s = " p l - k " > . < / s p a n > e q u a l T o ( < s p a n c l a s s = " p l - s " > < s p a n c l a s s = " p l - p d s " > " < / s p a n > p i k e s < s p a n c l a s s = " p l - p d s " > " < / s p a n > < / s p a n > ) < s p a n c l a s s = " p l - k " > . < / s p a n > a n d ( d f < s p a n c l a s s = " p l - k " > . < / s p a n > c o l ( < s p a n c l a s s = " p l - s " > < s p a n c l a s s = " p l - p d s " > " < / s p a n > y e a r < s p a n c l a s s = " p l - p d s " > " < / s p a n > < / s p a n > ) < s p a n c l a s s = " p l - k " > . < / s p a n > g e q ( < s p a n c l a s s = " p l - c 1 " > 2 0 1 6 < / s p a n > ) ) ) < / p r e > < / d i v > < h 3 > < a i d = " u s e r - c o n t e n t - w r i t i n g - 5 " c l a s s = " a n c h o r " h r e f = " h t t p s : / / g i t h u b . c o m / e l a s t i c / e l a s t i c s e a r c h - h a d o o p # w r i t i n g - 5 " a r i a - h i d d e n = " t r u e " t a r g e t = " _ b l a n k " > < s v g a r i a - h i d d e n = " t r u e " c l a s s = " o c t i c o n o c t i c o n - l i n k " h e i g h t = " 1 6 " v e r s i o n = " 1 . 1 " v i e w b o x = " 0 0 1 6 1 6 " w i d t h = " 1 6 " > < p a t h f i l l - r u l e = " e v e n o d d " d = " M 4 9 h 1 v 1 H 4 c - 1 . 5 0 - 3 - 1 . 6 9 - 3 - 3 . 5 S 2 . 5 5 3 4 3 h 4 c 1 . 4 5 0 3 1 . 6 9 3 3 . 5 0 1 . 4 1 - . 9 1 2 . 7 2 - 2 3 . 2 5 V 8 . 5 9 c . 5 8 - . 4 5 1 - 1 . 2 7 1 - 2 . 0 9 C 1 0 5 . 2 2 8 . 9 8 4 8 4 H 4 c - . 9 8 0 - 2 1 . 2 2 - 2 2 . 5 S 3 9 4 9 z m 9 - 3 h - 1 v 1 h 1 c 1 0 2 1 . 2 2 2 2 . 5 S 1 3 . 9 8 1 2 1 3 1 2 H 9 c - . 9 8 0 - 2 - 1 . 2 2 - 2 - 2 . 5 0 - . 8 3 . 4 2 - 1 . 6 4 1 - 2 . 0 9 V 6 . 2 5 c - 1 . 0 9 . 5 3 - 2 1 . 8 4 - 2 3 . 2 5 C 6 1 1 . 3 1 7 . 5 5 1 3 9 1 3 h 4 c 1 . 4 5 0 3 - 1 . 6 9 3 - 3 . 5 S 1 4 . 5 6 1 3 6 z " > < / p a t h > < / s v g > < / a > W r i t i n g < / h 3 > < p > U s e < c o d e > J a v a E s S p a r k < / c o d e > t o i n d e x a n y < c o d e > R D D < / c o d e > t o E l a s t i c s e a r c h : < / p > < d i v c l a s s = " h i g h l i g h t h i g h l i g h t - s o u r c e - j a v a " > < p r e > < s p a n c l a s s = " p l - k " > i m p o r t < / s p a n > < s p a n c l a s s = " p l - s m i " > o r g . e l a s t i c s e a r c h . s p a r k . r d d . a p i . j a v a . J a v a E s S p a r k < / s p a n > ; < s p a n c l a s s = " p l - s m i " > S p a r k C o n f < / s p a n > c o n f < s p a n c l a s s = " p l - k " > = < / s p a n > < s p a n c l a s s = " p l - c 1 " > . . . < / s p a n > < s p a n c l a s s = " p l - s m i " > J a v a S p a r k C o n t e x t < / s p a n > j s c < s p a n c l a s s = " p l - k " > = < / s p a n > < s p a n c l a s s = " p l - k " > n e w < / s p a n > < s p a n c l a s s = " p l - s m i " > J a v a S p a r k C o n t e x t < / s p a n > ( c o n f ) ; < s p a n c l a s s = " p l - k " > M a p & l t ; < s p a n c l a s s = " p l - s m i " > S t r i n g < / s p a n > , ? & g t ; < / s p a n > n u m b e r s < s p a n c l a s s = " p l - k " > = < / s p a n > < s p a n c l a s s = " p l - s m i " > I m m u t a b l e M a p < / s p a n > < s p a n c l a s s = " p l - k " > . < / s p a n > o f ( < s p a n c l a s s = " p l - s " > < s p a n c l a s s = " p l - p d s " > " < / s p a n > o n e < s p a n c l a s s = " p l - p d s " > " < / s p a n > < / s p a n > , < s p a n c l a s s = " p l - c 1 " > 1 < / s p a n > , < s p a n c l a s s = " p l - s " > < s p a n c l a s s = " p l - p d s " > " < / s p a n > t w o < s p a n c l a s s = " p l - p d s " > " < / s p a n > < / s p a n > , < s p a n c l a s s = " p l - c 1 " > 2 < / s p a n > ) ; < s p a n c l a s s = " p l - k " > M a p & l t ; < s p a n c l a s s = " p l - s m i " > S t r i n g < / s p a n > , ? & g t ; < / s p a n > a i r p o r t s < s p a n c l a s s = " p l - k " > = < / s p a n > < s p a n c l a s s = " p l - s m i " > I m m u t a b l e M a p < / s p a n > < s p a n c l a s s = " p l - k " > . < / s p a n > o f ( < s p a n c l a s s = " p l - s " > < s p a n c l a s s = " p l - p d s " > " < / s p a n > O T P < s p a n c l a s s = " p l - p d s " > " < / s p a n > < / s p a n > , < s p a n c l a s s = " p l - s " > < s p a n c l a s s = " p l - p d s " > " < / s p a n > O t o p e n i < s p a n c l a s s = " p l - p d s " > " < / s p a n > < / s p a n > , < s p a n c l a s s = " p l - s " > < s p a n c l a s s = " p l - p d s " > " < / s p a n > S F O < s p a n c l a s s = " p l - p d s " > " < / s p a n > < / s p a n > , < s p a n c l a s s = " p l - s " > < s p a n c l a s s = " p l - p d s " > " < / s p a n > S a n F r a n < s p a n c l a s s = " p l - p d s " > " < / s p a n > < / s p a n > ) ; < s p a n c l a s s = " p l - k " > J a v a R D D & l t ; < s p a n c l a s s = " p l - k " > M a p & l t ; < s p a n c l a s s = " p l - s m i " > S t r i n g < / s p a n > , ? & g t ; < / s p a n > & g t ; < / s p a n > j a v a R D D < s p a n c l a s s = " p l - k " > = < / s p a n > j s c < s p a n c l a s s = " p l - k " > . < / s p a n > p a r a l l e l i z e ( < s p a n c l a s s = " p l - s m i " > I m m u t a b l e L i s t < / s p a n > < s p a n c l a s s = " p l - k " > . < / s p a n > o f ( d o c 1 , d o c 2 ) ) ; < s p a n c l a s s = " p l - s m i " > J a v a E s S p a r k < / s p a n > < s p a n c l a s s = " p l - k " > . < / s p a n > s a v e T o E s ( j a v a R D D , < s p a n c l a s s = " p l - s " > < s p a n c l a s s = " p l - p d s " > " < / s p a n > s p a r k / d o c s < s p a n c l a s s = " p l - p d s " > " < / s p a n > < / s p a n > ) ; < / p r e > < / d i v > < h 4 > < a i d = " u s e r - c o n t e n t - s p a r k - s q l - 3 " c l a s s = " a n c h o r " h r e f = " h t t p s : / / g i t h u b . c o m / e l a s t i c / e l a s t i c s e a r c h - h a d o o p # s p a r k - s q l - 3 " a r i a - h i d d e n = " t r u e " t a r g e t = " _ b l a n k " > < s v g a r i a - h i d d e n = " t r u e " c l a s s = " o c t i c o n o c t i c o n - l i n k " h e i g h t = " 1 6 " v e r s i o n = " 1 . 1 " v i e w b o x = " 0 0 1 6 1 6 " w i d t h = " 1 6 " > < p a t h f i l l - r u l e = " e v e n o d d " d = " M 4 9 h 1 v 1 H 4 c - 1 . 5 0 - 3 - 1 . 6 9 - 3 - 3 . 5 S 2 . 5 5 3 4 3 h 4 c 1 . 4 5 0 3 1 . 6 9 3 3 . 5 0 1 . 4 1 - . 9 1 2 . 7 2 - 2 3 . 2 5 V 8 . 5 9 c . 5 8 - . 4 5 1 - 1 . 2 7 1 - 2 . 0 9 C 1 0 5 . 2 2 8 . 9 8 4 8 4 H 4 c - . 9 8 0 - 2 1 . 2 2 - 2 2 . 5 S 3 9 4 9 z m 9 - 3 h - 1 v 1 h 1 c 1 0 2 1 . 2 2 2 2 . 5 S 1 3 . 9 8 1 2 1 3 1 2 H 9 c - . 9 8 0 - 2 - 1 . 2 2 - 2 - 2 . 5 0 - . 8 3 . 4 2 - 1 . 6 4 1 - 2 . 0 9 V 6 . 2 5 c - 1 . 0 9 . 5 3 - 2 1 . 8 4 - 2 3 . 2 5 C 6 1 1 . 3 1 7 . 5 5 1 3 9 1 3 h 4 c 1 . 4 5 0 3 - 1 . 6 9 3 - 3 . 5 S 1 4 . 5 6 1 3 6 z " > < / p a t h > < / s v g > < / a > S p a r k S Q L < / h 4 > < d i v c l a s s = " h i g h l i g h t h i g h l i g h t - s o u r c e - j a v a " > < p r e > < s p a n c l a s s = " p l - k " > i m p o r t < / s p a n > < s p a n c l a s s = " p l - s m i " > o r g . e l a s t i c s e a r c h . s p a r k . s q l . a p i . j a v a . J a v a E s S p a r k S Q L < / s p a n > ; < s p a n c l a s s = " p l - s m i " > D a t a F r a m e < / s p a n > d f < s p a n c l a s s = " p l - k " > = < / s p a n > s q l C o n t e x t < s p a n c l a s s = " p l - k " > . < / s p a n > r e a d < s p a n c l a s s = " p l - k " > . < / s p a n > j s o n ( < s p a n c l a s s = " p l - s " > < s p a n c l a s s = " p l - p d s " > " < / s p a n > e x a m p l e s / p e o p l e . j s o n < s p a n c l a s s = " p l - p d s " > " < / s p a n > < / s p a n > ) < s p a n c l a s s = " p l - s m i " > J a v a E s S p a r k S Q L < / s p a n > < s p a n c l a s s = " p l - k " > . < / s p a n > s a v e T o E S ( d f , < s p a n c l a s s = " p l - s " > < s p a n c l a s s = " p l - p d s " > " < / s p a n > s p a r k / d o c s < s p a n c l a s s = " p l - p d s " > " < / s p a n > < / s p a n > ) < / p r e > < / d i v > < h 2 > < a i d = " u s e r - c o n t e n t - c a s c a d i n g " c l a s s = " a n c h o r " h r e f = " h t t p s : / / g i t h u b . c o m / e l a s t i c / e l a s t i c s e a r c h - h a d o o p # c a s c a d i n g " a r i a - h i d d e n = " t r u e " t a r g e t = " _ b l a n k " > < s v g a r i a - h i d d e n = " t r u e " c l a s s = " o c t i c o n o c t i c o n - l i n k " h e i g h t = " 1 6 " v e r s i o n = " 1 . 1 " v i e w b o x = " 0 0 1 6 1 6 " w i d t h = " 1 6 " > < p a t h f i l l - r u l e = " e v e n o d d " d = " M 4 9 h 1 v 1 H 4 c - 1 . 5 0 - 3 - 1 . 6 9 - 3 - 3 . 5 S 2 . 5 5 3 4 3 h 4 c 1 . 4 5 0 3 1 . 6 9 3 3 . 5 0 1 . 4 1 - . 9 1 2 . 7 2 - 2 3 . 2 5 V 8 . 5 9 c . 5 8 - . 4 5 1 - 1 . 2 7 1 - 2 . 0 9 C 1 0 5 . 2 2 8 . 9 8 4 8 4 H 4 c - . 9 8 0 - 2 1 . 2 2 - 2 2 . 5 S 3 9 4 9 z m 9 - 3 h - 1 v 1 h 1 c 1 0 2 1 . 2 2 2 2 . 5 S 1 3 . 9 8 1 2 1 3 1 2 H 9 c - . 9 8 0 - 2 - 1 . 2 2 - 2 - 2 . 5 0 - . 8 3 . 4 2 - 1 . 6 4 1 - 2 . 0 9 V 6 . 2 5 c - 1 . 0 9 . 5 3 - 2 1 . 8 4 - 2 3 . 2 5 C 6 1 1 . 3 1 7 . 5 5 1 3 9 1 3 h 4 c 1 . 4 5 0 3 - 1 . 6 9 3 - 3 . 5 S 1 4 . 5 6 1 3 6 z " > < / p a t h > < / s v g > < / a > < a h r e f = " h t t p : / / w w w . c a s c a d i n g . o r g / " t a r g e t = " _ b l a n k " > C a s c a d i n g < / a > < / h 2 > < p > E S - H a d o o p o f f e r s a d e d i c a t e E l a s t i c s e a r c h < a h r e f = " h t t p : / / d o c s . c a s c a d i n g . o r g / c a s c a d i n g / 2 . 1 / u s e r g u i d e / h t m l / c h 0 3 s 0 5 . h t m l " t a r g e t = " _ b l a n k " > T a p < / a > , < c o d e > E s T a p < / c o d e > t h a t c a n b e u s e d b o t h a s a s i n k o r a s o u r c e . N o t e t h a t < c o d e > E s T a p < / c o d e > c a n b e u s e d i n b o t h l o c a l ( < c o d e > L o c a l F l o w C o n n e c t o r < / c o d e > ) a n d H a d o o p ( < c o d e > H a d o o p F l o w C o n n e c t o r < / c o d e > ) f l o w s : < / p > < h 3 > < a i d = " u s e r - c o n t e n t - r e a d i n g - 6 " c l a s s = " a n c h o r " h r e f = " h t t p s : / / g i t h u b . c o m / e l a s t i c / e l a s t i c s e a r c h - h a d o o p # r e a d i n g - 6 " a r i a - h i d d e n = " t r u e " t a r g e t = " _ b l a n k " > < s v g a r i a - h i d d e n = " t r u e " c l a s s = " o c t i c o n o c t i c o n - l i n k " h e i g h t = " 1 6 " v e r s i o n = " 1 . 1 " v i e w b o x = " 0 0 1 6 1 6 " w i d t h = " 1 6 " > < p a t h f i l l - r u l e = " e v e n o d d " d = " M 4 9 h 1 v 1 H 4 c - 1 . 5 0 - 3 - 1 . 6 9 - 3 - 3 . 5 S 2 . 5 5 3 4 3 h 4 c 1 . 4 5 0 3 1 . 6 9 3 3 . 5 0 1 . 4 1 - . 9 1 2 . 7 2 - 2 3 . 2 5 V 8 . 5 9 c . 5 8 - . 4 5 1 - 1 . 2 7 1 - 2 . 0 9 C 1 0 5 . 2 2 8 . 9 8 4 8 4 H 4 c - . 9 8 0 - 2 1 . 2 2 - 2 2 . 5 S 3 9 4 9 z m 9 - 3 h - 1 v 1 h 1 c 1 0 2 1 . 2 2 2 2 . 5 S 1 3 . 9 8 1 2 1 3 1 2 H 9 c - . 9 8 0 - 2 - 1 . 2 2 - 2 - 2 . 5 0 - . 8 3 . 4 2 - 1 . 6 4 1 - 2 . 0 9 V 6 . 2 5 c - 1 . 0 9 . 5 3 - 2 1 . 8 4 - 2 3 . 2 5 C 6 1 1 . 3 1 7 . 5 5 1 3 9 1 3 h 4 c 1 . 4 5 0 3 - 1 . 6 9 3 - 3 . 5 S 1 4 . 5 6 1 3 6 z " > < / p a t h > < / s v g > < / a > R e a d i n g < / h 3 > < d i v c l a s s = " h i g h l i g h t h i g h l i g h t - s o u r c e - j a v a " > < p r e > < s p a n c l a s s = " p l - s m i " > T a p < / s p a n > i n < s p a n c l a s s = " p l - k " > = < / s p a n > < s p a n c l a s s = " p l - k " > n e w < / s p a n > < s p a n c l a s s = " p l - s m i " > E s T a p < / s p a n > ( < s p a n c l a s s = " p l - s " > < s p a n c l a s s = " p l - p d s " > " < / s p a n > r a d i o / a r t i s t s < s p a n c l a s s = " p l - p d s " > " < / s p a n > < / s p a n > , < s p a n c l a s s = " p l - s " > < s p a n c l a s s = " p l - p d s " > " < / s p a n > ? q = m e * < s p a n c l a s s = " p l - p d s " > " < / s p a n > < / s p a n > ) ; < s p a n c l a s s = " p l - s m i " > T a p < / s p a n > o u t < s p a n c l a s s = " p l - k " > = < / s p a n > < s p a n c l a s s = " p l - k " > n e w < / s p a n > < s p a n c l a s s = " p l - s m i " > S t d O u t < / s p a n > ( < s p a n c l a s s = " p l - k " > n e w < / s p a n > < s p a n c l a s s = " p l - s m i " > T e x t L i n e < / s p a n > ( ) ) ; < s p a n c l a s s = " p l - k " > n e w < / s p a n > < s p a n c l a s s = " p l - s m i " > L o c a l F l o w C o n n e c t o r < / s p a n > ( ) < s p a n c l a s s = " p l - k " > . < / s p a n > c o n n e c t ( i n , o u t , < s p a n c l a s s = " p l - k " > n e w < / s p a n > < s p a n c l a s s = " p l - s m i " > P i p e < / s p a n > ( < s p a n c l a s s = " p l - s " > < s p a n c l a s s = " p l - p d s " > " < / s p a n > r e a d - f r o m - E S < s p a n c l a s s = " p l - p d s " > " < / s p a n > < / s p a n > ) ) < s p a n c l a s s = " p l - k " > . < / s p a n > c o m p l e t e ( ) ; < / p r e > < / d i v > < h 3 > < a i d = " u s e r - c o n t e n t - w r i t i n g - 6 " c l a s s = " a n c h o r " h r e f = " h t t p s : / / g i t h u b . c o m / e l a s t i c / e l a s t i c s e a r c h - h a d o o p # w r i t i n g - 6 " a r i a - h i d d e n = " t r u e " t a r g e t = " _ b l a n k " > < s v g a r i a - h i d d e n = " t r u e " c l a s s = " o c t i c o n o c t i c o n - l i n k " h e i g h t = " 1 6 " v e r s i o n = " 1 . 1 " v i e w b o x = " 0 0 1 6 1 6 " w i d t h = " 1 6 " > < p a t h f i l l - r u l e = " e v e n o d d " d = " M 4 9 h 1 v 1 H 4 c - 1 . 5 0 - 3 - 1 . 6 9 - 3 - 3 . 5 S 2 . 5 5 3 4 3 h 4 c 1 . 4 5 0 3 1 . 6 9 3 3 . 5 0 1 . 4 1 - . 9 1 2 . 7 2 - 2 3 . 2 5 V 8 . 5 9 c . 5 8 - . 4 5 1 - 1 . 2 7 1 - 2 . 0 9 C 1 0 5 . 2 2 8 . 9 8 4 8 4 H 4 c - . 9 8 0 - 2 1 . 2 2 - 2 2 . 5 S 3 9 4 9 z m 9 - 3 h - 1 v 1 h 1 c 1 0 2 1 . 2 2 2 2 . 5 S 1 3 . 9 8 1 2 1 3 1 2 H 9 c - . 9 8 0 - 2 - 1 . 2 2 - 2 - 2 . 5 0 - . 8 3 . 4 2 - 1 . 6 4 1 - 2 . 0 9 V 6 . 2 5 c - 1 . 0 9 . 5 3 - 2 1 . 8 4 - 2 3 . 2 5 C 6 1 1 . 3 1 7 . 5 5 1 3 9 1 3 h 4 c 1 . 4 5 0 3 - 1 . 6 9 3 - 3 . 5 S 1 4 . 5 6 1 3 6 z " > < / p a t h > < / s v g > < / a > W r i t i n g < / h 3 > < d i v c l a s s = " h i g h l i g h t h i g h l i g h t - s o u r c e - j a v a " > < p r e > < s p a n c l a s s = " p l - s m i " > T a p < / s p a n > i n < s p a n c l a s s = " p l - k " > = < / s p a n > L f s ( < s p a n c l a s s = " p l - k " > n e w < / s p a n > < s p a n c l a s s = " p l - s m i " > T e x t D e l i m i t e d < / s p a n > ( < s p a n c l a s s = " p l - k " > n e w < / s p a n > < s p a n c l a s s = " p l - s m i " > F i e l d s < / s p a n > ( < s p a n c l a s s = " p l - s " > < s p a n c l a s s = " p l - p d s " > " < / s p a n > i d < s p a n c l a s s = " p l - p d s " > " < / s p a n > < / s p a n > , < s p a n c l a s s = " p l - s " > < s p a n c l a s s = " p l - p d s " > " < / s p a n > n a m e < s p a n c l a s s = " p l - p d s " > " < / s p a n > < / s p a n > , < s p a n c l a s s = " p l - s " > < s p a n c l a s s = " p l - p d s " > " < / s p a n > u r l < s p a n c l a s s = " p l - p d s " > " < / s p a n > < / s p a n > , < s p a n c l a s s = " p l - s " > < s p a n c l a s s = " p l - p d s " > " < / s p a n > p i c t u r e < s p a n c l a s s = " p l - p d s " > " < / s p a n > < / s p a n > ) ) , < s p a n c l a s s = " p l - s " > < s p a n c l a s s = " p l - p d s " > " < / s p a n > s r c / t e s t / r e s o u r c e s / a r t i s t s . d a t < s p a n c l a s s = " p l - p d s " > " < / s p a n > < / s p a n > ) ; < s p a n c l a s s = " p l - s m i " > T a p < / s p a n > o u t < s p a n c l a s s = " p l - k " > = < / s p a n > < s p a n c l a s s = " p l - k " > n e w < / s p a n > < s p a n c l a s s = " p l - s m i " > E s T a p < / s p a n > ( < s p a n c l a s s = " p l - s " > < s p a n c l a s s = " p l - p d s " > " < / s p a n > r a d i o / a r t i s t s < s p a n c l a s s = " p l - p d s " > " < / s p a n > < / s p a n > , < s p a n c l a s s = " p l - k " > n e w < / s p a n > < s p a n c l a s s = " p l - s m i " > F i e l d s < / s p a n > ( < s p a n c l a s s = " p l - s " > < s p a n c l a s s = " p l - p d s " > " < / s p a n > n a m e < s p a n c l a s s = " p l - p d s " > " < / s p a n > < / s p a n > , < s p a n c l a s s = " p l - s " > < s p a n c l a s s = " p l - p d s " > " < / s p a n > u r l < s p a n c l a s s = " p l - p d s " > " < / s p a n > < / s p a n > , < s p a n c l a s s = " p l - s " > < s p a n c l a s s = " p l - p d s " > " < / s p a n > p i c t u r e < s p a n c l a s s = " p l - p d s " > " < / s p a n > < / s p a n > ) ) ; < s p a n c l a s s = " p l - k " > n e w < / s p a n > < s p a n c l a s s = " p l - s m i " > H a d o o p F l o w C o n n e c t o r < / s p a n > ( ) < s p a n c l a s s = " p l - k " > . < / s p a n > c o n n e c t ( i n , o u t , < s p a n c l a s s = " p l - k " > n e w < / s p a n > < s p a n c l a s s = " p l - s m i " > P i p e < / s p a n > ( < s p a n c l a s s = " p l - s " > < s p a n c l a s s = " p l - p d s " > " < / s p a n > w r i t e - t o - E S < s p a n c l a s s = " p l - p d s " > " < / s p a n > < / s p a n > ) ) < s p a n c l a s s = " p l - k " > . < / s p a n > c o m p l e t e ( ) ; < / p r e > < / d i v > < h 2 > < a i d = " u s e r - c o n t e n t - a p a c h e - s t o r m " c l a s s = " a n c h o r " h r e f = " h t t p s : / / g i t h u b . c o m / e l a s t i c / e l a s t i c s e a r c h - h a d o o p # a p a c h e - s t o r m " a r i a - h i d d e n = " t r u e " t a r g e t = " _ b l a n k " > < s v g a r i a - h i d d e n = " t r u e " c l a s s = " o c t i c o n o c t i c o n - l i n k " h e i g h t = " 1 6 " v e r s i o n = " 1 . 1 " v i e w b o x = " 0 0 1 6 1 6 " w i d t h = " 1 6 " > < p a t h f i l l - r u l e = " e v e n o d d " d = " M 4 9 h 1 v 1 H 4 c - 1 . 5 0 - 3 - 1 . 6 9 - 3 - 3 . 5 S 2 . 5 5 3 4 3 h 4 c 1 . 4 5 0 3 1 . 6 9 3 3 . 5 0 1 . 4 1 - . 9 1 2 . 7 2 - 2 3 . 2 5 V 8 . 5 9 c . 5 8 - . 4 5 1 - 1 . 2 7 1 - 2 . 0 9 C 1 0 5 . 2 2 8 . 9 8 4 8 4 H 4 c - . 9 8 0 - 2 1 . 2 2 - 2 2 . 5 S 3 9 4 9 z m 9 - 3 h - 1 v 1 h 1 c 1 0 2 1 . 2 2 2 2 . 5 S 1 3 . 9 8 1 2 1 3 1 2 H 9 c - . 9 8 0 - 2 - 1 . 2 2 - 2 - 2 . 5 0 - . 8 3 . 4 2 - 1 . 6 4 1 - 2 . 0 9 V 6 . 2 5 c - 1 . 0 9 . 5 3 - 2 1 . 8 4 - 2 3 . 2 5 C 6 1 1 . 3 1 7 . 5 5 1 3 9 1 3 h 4 c 1 . 4 5 0 3 - 1 . 6 9 3 - 3 . 5 S 1 4 . 5 6 1 3 6 z " > < / p a t h > < / s v g > < / a > < a h r e f = " h t t p : / / s t o r m . a p a c h e . o r g " t a r g e t = " _ b l a n k " > A p a c h e S t o r m < / a > < / h 2 > < p > E S - H a d o o p p r o v i d e s n a t i v e i n t e g r a t i o n w i t h S t o r m : f o r r e a d i n g a d e d i c a t e d < c o d e > S p o u t < / c o d e > a n d f o r w r i t i n g a s p e c i a l i z e d < c o d e > B o l t < / c o d e > < / p > < h 3 > < a i d = " u s e r - c o n t e n t - r e a d i n g - 7 " c l a s s = " a n c h o r " h r e f = " h t t p s : / / g i t h u b . c o m / e l a s t i c / e l a s t i c s e a r c h - h a d o o p # r e a d i n g - 7 " a r i a - h i d d e n = " t r u e " t a r g e t = " _ b l a n k " > < s v g a r i a - h i d d e n = " t r u e " c l a s s = " o c t i c o n o c t i c o n - l i n k " h e i g h t = " 1 6 " v e r s i o n = " 1 . 1 " v i e w b o x = " 0 0 1 6 1 6 " w i d t h = " 1 6 " > < p a t h f i l l - r u l e = " e v e n o d d " d = " M 4 9 h 1 v 1 H 4 c - 1 . 5 0 - 3 - 1 . 6 9 - 3 - 3 . 5 S 2 . 5 5 3 4 3 h 4 c 1 . 4 5 0 3 1 . 6 9 3 3 . 5 0 1 . 4 1 - . 9 1 2 . 7 2 - 2 3 . 2 5 V 8 . 5 9 c . 5 8 - . 4 5 1 - 1 . 2 7 1 - 2 . 0 9 C 1 0 5 . 2 2 8 . 9 8 4 8 4 H 4 c - . 9 8 0 - 2 1 . 2 2 - 2 2 . 5 S 3 9 4 9 z m 9 - 3 h - 1 v 1 h 1 c 1 0 2 1 . 2 2 2 2 . 5 S 1 3 . 9 8 1 2 1 3 1 2 H 9 c - . 9 8 0 - 2 - 1 . 2 2 - 2 - 2 . 5 0 - . 8 3 . 4 2 - 1 . 6 4 1 - 2 . 0 9 V 6 . 2 5 c - 1 . 0 9 . 5 3 - 2 1 . 8 4 - 2 3 . 2 5 C 6 1 1 . 3 1 7 . 5 5 1 3 9 1 3 h 4 c 1 . 4 5 0 3 - 1 . 6 9 3 - 3 . 5 S 1 4 . 5 6 1 3 6 z " > < / p a t h > < / s v g > < / a > R e a d i n g < / h 3 > < p > T o r e a d d a t a f r o m E S , u s e < c o d e > E s S p o u t < / c o d e > : < / p > < d i v c l a s s = " h i g h l i g h t h i g h l i g h t - s o u r c e - j a v a " > < p r e > < s p a n c l a s s = " p l - k " > i m p o r t < / s p a n > < s p a n c l a s s = " p l - s m i " > o r g . e l a s t i c s e a r c h . s t o r m . E s S p o u t < / s p a n > ; < s p a n c l a s s = " p l - s m i " > T o p o l o g y B u i l d e r < / s p a n > b u i l d e r < s p a n c l a s s = " p l - k " > = < / s p a n > < s p a n c l a s s = " p l - k " > n e w < / s p a n > < s p a n c l a s s = " p l - s m i " > T o p o l o g y B u i l d e r < / s p a n > ( ) ; b u i l d e r < s p a n c l a s s = " p l - k " > . < / s p a n > s e t S p o u t ( < s p a n c l a s s = " p l - s " > < s p a n c l a s s = " p l - p d s " > " < / s p a n > e s - s p o u t < s p a n c l a s s = " p l - p d s " > " < / s p a n > < / s p a n > , < s p a n c l a s s = " p l - k " > n e w < / s p a n > < s p a n c l a s s = " p l - s m i " > E s S p o u t < / s p a n > ( < s p a n c l a s s = " p l - s " > < s p a n c l a s s = " p l - p d s " > " < / s p a n > s t o r m / d o c s < s p a n c l a s s = " p l - p d s " > " < / s p a n > < / s p a n > , < s p a n c l a s s = " p l - s " > < s p a n c l a s s = " p l - p d s " > " < / s p a n > ? q = m e * < s p a n c l a s s = " p l - p d s " > " < / s p a n > < / s p a n > ) , < s p a n c l a s s = " p l - c 1 " > 5 < / s p a n > ) ; b u i l d e r < s p a n c l a s s = " p l - k " > . < / s p a n > s e t B o l t ( < s p a n c l a s s = " p l - s " > < s p a n c l a s s = " p l - p d s " > " < / s p a n > b o l t < s p a n c l a s s = " p l - p d s " > " < / s p a n > < / s p a n > , < s p a n c l a s s = " p l - k " > n e w < / s p a n > < s p a n c l a s s = " p l - s m i " > P r i n t e r B o l t < / s p a n > ( ) ) < s p a n c l a s s = " p l - k " > . < / s p a n > s h u f f l e G r o u p i n g ( < s p a n c l a s s = " p l - s " > < s p a n c l a s s = " p l - p d s " > " < / s p a n > e s - s p o u t < s p a n c l a s s = " p l - p d s " > " < / s p a n > < / s p a n > ) ; < / p r e > < / d i v > < h 3 > < a i d = " u s e r - c o n t e n t - w r i t i n g - 7 " c l a s s = " a n c h o r " h r e f = " h t t p s : / / g i t h u b . c o m / e l a s t i c / e l a s t i c s e a r c h - h a d o o p # w r i t i n g - 7 " a r i a - h i d d e n = " t r u e " t a r g e t = " _ b l a n k " > < s v g a r i a - h i d d e n = " t r u e " c l a s s = " o c t i c o n o c t i c o n - l i n k " h e i g h t = " 1 6 " v e r s i o n = " 1 . 1 " v i e w b o x = " 0 0 1 6 1 6 " w i d t h = " 1 6 " > < p a t h f i l l - r u l e = " e v e n o d d " d = " M 4 9 h 1 v 1 H 4 c - 1 . 5 0 - 3 - 1 . 6 9 - 3 - 3 . 5 S 2 . 5 5 3 4 3 h 4 c 1 . 4 5 0 3 1 . 6 9 3 3 . 5 0 1 . 4 1 - . 9 1 2 . 7 2 - 2 3 . 2 5 V 8 . 5 9 c . 5 8 - . 4 5 1 - 1 . 2 7 1 - 2 . 0 9 C 1 0 5 . 2 2 8 . 9 8 4 8 4 H 4 c - . 9 8 0 - 2 1 . 2 2 - 2 2 . 5 S 3 9 4 9 z m 9 - 3 h - 1 v 1 h 1 c 1 0 2 1 . 2 2 2 2 . 5 S 1 3 . 9 8 1 2 1 3 1 2 H 9 c - . 9 8 0 - 2 - 1 . 2 2 - 2 - 2 . 5 0 - . 8 3 . 4 2 - 1 . 6 4 1 - 2 . 0 9 V 6 . 2 5 c - 1 . 0 9 . 5 3 - 2 1 . 8 4 - 2 3 . 2 5 C 6 1 1 . 3 1 7 . 5 5 1 3 9 1 3 h 4 c 1 . 4 5 0 3 - 1 . 6 9 3 - 3 . 5 S 1 4 . 5 6 1 3 6 z " > < / p a t h > < / s v g > < / a > W r i t i n g < / h 3 > < p > T o i n d e x d a t a t o E S , u s e < c o d e > E s B o l t < / c o d e > : < / p > < d i v c l a s s = " h i g h l i g h t h i g h l i g h t - s o u r c e - j a v a " > < p r e > < s p a n c l a s s = " p l - k " > i m p o r t < / s p a n > < s p a n c l a s s = " p l - s m i " > o r g . e l a s t i c s e a r c h . s t o r m . E s B o l t < / s p a n > ; < s p a n c l a s s = " p l - s m i " > T o p o l o g y B u i l d e r < / s p a n > b u i l d e r < s p a n c l a s s = " p l - k " > = < / s p a n > < s p a n c l a s s = " p l - k " > n e w < / s p a n > < s p a n c l a s s = " p l - s m i " > T o p o l o g y B u i l d e r < / s p a n > ( ) ; b u i l d e r < s p a n c l a s s = " p l - k " > . < / s p a n > s e t S p o u t ( < s p a n c l a s s = " p l - s " > < s p a n c l a s s = " p l - p d s " > " < / s p a n > s p o u t < s p a n c l a s s = " p l - p d s " > " < / s p a n > < / s p a n > , < s p a n c l a s s = " p l - k " > n e w < / s p a n > < s p a n c l a s s = " p l - s m i " > R a n d o m S e n t e n c e S p o u t < / s p a n > ( ) , < s p a n c l a s s = " p l - c 1 " > 1 0 < / s p a n > ) ; b u i l d e r < s p a n c l a s s = " p l - k " > . < / s p a n > s e t B o l t ( < s p a n c l a s s = " p l - s " > < s p a n c l a s s = " p l - p d s " > " < / s p a n > e s - b o l t < s p a n c l a s s = " p l - p d s " > " < / s p a n > < / s p a n > , < s p a n c l a s s = " p l - k " > n e w < / s p a n > < s p a n c l a s s = " p l - s m i " > E s B o l t < / s p a n > ( < s p a n c l a s s = " p l - s " > < s p a n c l a s s = " p l - p d s " > " < / s p a n > s t o r m / d o c s < s p a n c l a s s = " p l - p d s " > " < / s p a n > < / s p a n > ) , < s p a n c l a s s = " p l - c 1 " > 5 < / s p a n > ) < s p a n c l a s s = " p l - k " > . < / s p a n > s h u f f l e G r o u p i n g ( < s p a n c l a s s = " p l - s " > < s p a n c l a s s = " p l - p d s " > " < / s p a n > s p o u t < s p a n c l a s s = " p l - p d s " > " < / s p a n > < / s p a n > ) ; < / p r e > < / d i v > < h 2 > < a i d = " u s e r - c o n t e n t - b u i l d i n g - t h e - s o u r c e " c l a s s = " a n c h o r " h r e f = " h t t p s : / / g i t h u b . c o m / e l a s t i c / e l a s t i c s e a r c h - h a d o o p # b u i l d i n g - t h e - s o u r c e " a r i a - h i d d e n = " t r u e " t a r g e t = " _ b l a n k " > < s v g a r i a - h i d d e n = " t r u e " c l a s s = " o c t i c o n o c t i c o n - l i n k " h e i g h t = " 1 6 " v e r s i o n = " 1 . 1 " v i e w b o x = " 0 0 1 6 1 6 " w i d t h = " 1 6 " > < p a t h f i l l - r u l e = " e v e n o d d " d = " M 4 9 h 1 v 1 H 4 c - 1 . 5 0 - 3 - 1 . 6 9 - 3 - 3 . 5 S 2 . 5 5 3 4 3 h 4 c 1 . 4 5 0 3 1 . 6 9 3 3 . 5 0 1 . 4 1 - . 9 1 2 . 7 2 - 2 3 . 2 5 V 8 . 5 9 c . 5 8 - . 4 5 1 - 1 . 2 7 1 - 2 . 0 9 C 1 0 5 . 2 2 8 . 9 8 4 8 4 H 4 c - . 9 8 0 - 2 1 . 2 2 - 2 2 . 5 S 3 9 4 9 z m 9 - 3 h - 1 v 1 h 1 c 1 0 2 1 . 2 2 2 2 . 5 S 1 3 . 9 8 1 2 1 3 1 2 H 9 c - . 9 8 0 - 2 - 1 . 2 2 - 2 - 2 . 5 0 - . 8 3 . 4 2 - 1 . 6 4 1 - 2 . 0 9 V 6 . 2 5 c - 1 . 0 9 . 5 3 - 2 1 . 8 4 - 2 3 . 2 5 C 6 1 1 . 3 1 7 . 5 5 1 3 9 1 3 h 4 c 1 . 4 5 0 3 - 1 . 6 9 3 - 3 . 5 S 1 4 . 5 6 1 3 6 z " > < / p a t h > < / s v g > < / a > B u i l d i n g t h e s o u r c e < / h 2 > < p > E l a s t i c s e a r c h H a d o o p u s e s < a h r e f = " h t t p : / / w w w . g r a d l e . o r g / " t a r g e t = " _ b l a n k " > G r a d l e < / a > f o r i t s b u i l d s y s t e m a n d i t i s n o t r e q u i r e d t o h a v e i t i n s t a l l e d o n y o u r m a c h i n e . B y d e f a u l t ( < c o d e > g r a d l e w < / c o d e > ) , i t a u t o m a t i c a l l y b u i l d s t h e p a c k a g e a n d r u n s t h e u n i t t e s t s . F o r i n t e g r a t i o n t e s t i n g , u s e t h e < c o d e > i n t e g r a t i o n T e s t s < / c o d e > t a s k . S e e < c o d e > g r a d l e w t a s k s < / c o d e > f o r m o r e i n f o r m a t i o n . < / p > < p > T o c r e a t e a d i s t r i b u t a b l e z i p , r u n < c o d e > g r a d l e w d i s t Z i p < / c o d e > f r o m t h e c o m m a n d l i n e ; o n c e c o m p l e t e d y o u w i l l f i n d t h e j a r i n < c o d e > b u i l d / l i b s < / c o d e > . < / p > < p > T o b u i l d t h e p r o j e c t , J V M 8 ( O r a c l e o n e i s r e c o m m e n d e d ) o r h i g h e r i s r e q u i r e d . < / p > < h 2 > < a i d = " u s e r - c o n t e n t - l i c e n s e " c l a s s = " a n c h o r " h r e f = " h t t p s : / / g i t h u b . c o m / e l a s t i c / e l a s t i c s e a r c h - h a d o o p # l i c e n s e " a r i a - h i d d e n = " t r u e " t a r g e t = " _ b l a n k " > < s v g a r i a - h i d d e n = " t r u e " c l a s s = " o c t i c o n o c t i c o n - l i n k " h e i g h t = " 1 6 " v e r s i o n = " 1 . 1 " v i e w b o x = " 0 0 1 6 1 6 " w i d t h = " 1 6 " > < p a t h f i l l - r u l e = " e v e n o d d " d = " M 4 9 h 1 v 1 H 4 c - 1 . 5 0 - 3 - 1 . 6 9 - 3 - 3 . 5 S 2 . 5 5 3 4 3 h 4 c 1 . 4 5 0 3 1 . 6 9 3 3 . 5 0 1 . 4 1 - . 9 1 2 . 7 2 - 2 3 . 2 5 V 8 . 5 9 c . 5 8 - . 4 5 1 - 1 . 2 7 1 - 2 . 0 9 C 1 0 5 . 2 2 8 . 9 8 4 8 4 H 4 c - . 9 8 0 - 2 1 . 2 2 - 2 2 . 5 S 3 9 4 9 z m 9 - 3 h - 1 v 1 h 1 c 1 0 2 1 . 2 2 2 2 . 5 S 1 3 . 9 8 1 2 1 3 1 2 H 9 c - . 9 8 0 - 2 - 1 . 2 2 - 2 - 2 . 5 0 - . 8 3 . 4 2 - 1 . 6 4 1 - 2 . 0 9 V 6 . 2 5 c - 1 . 0 9 . 5 3 - 2 1 . 8 4 - 2 3 . 2 5 C 6 1 1 . 3 1 7 . 5 5 1 3 9 1 3 h 4 c 1 . 4 5 0 3 - 1 . 6 9 3 - 3 . 5 S 1 4 . 5 6 1 3 6 z " > < / p a t h > < / s v g > < / a > L i c e n s e < / h 2 > < p > T h i s p r o j e c t i s r e l e a s e d u n d e r v e r s i o n 2 . 0 o f t h e < a h r e f = " h t t p : / / w w w . a p a c h e . o r g / l i c e n s e s / L I C E N S E - 2 . 0 " t a r g e t = " _ b l a n k " > A p a c h e L i c e n s e < / a > < / p > < p r e > < c o d e > L i c e n s e d t o E l a s t i c s e a r c h u n d e r o n e o r m o r e c o n t r i b u t o r l i c e n s e a g r e e m e n t s . S e e t h e N O T I C E f i l e d i s t r i b u t e d w i t h t h i s w o r k f o r a d d i t i o n a l i n f o r m a t i o n r e g a r d i n g c o p y r i g h t o w n e r s h i p . E l a s t i c s e a r c h l i c e n s e s t h i s f i l e t o y o u u n d e r t h e A p a c h e L i c e n s e , V e r s i o n 2 . 0 ( t h e " L i c e n s e " ) ; y o u m a y n o t u s e t h i s f i l e e x c e p t i n c o m p l i a n c e w i t h t h e L i c e n s e . Y o u m a y o b t a i n a c o p y o f t h e L i c e n s e a t h t t p : / / w w w . a p a c h e . o r g / l i c e n s e s / L I C E N S E - 2 . 0 U n l e s s r e q u i r e d b y a p p l i c a b l e l a w o r a g r e e d t o i n w r i t i n g , s o f t w a r e d i s t r i b u t e d u n d e r t h e L i c e n s e i s d i s t r i b u t e d o n a n " A S I S " B A S I S , W I T H O U T W A R R A N T I E S O R C O N D I T I O N S O F A N Y K I N D , e i t h e r e x p r e s s o r i m p l i e d . S e e t h e L i c e n s e f o r t h e s p e c i f i c l a n g u a g e g o v e r n i n g p e r m i s s i o n s a n d l i m i t a t i o n s u n d e r t h e L i c e n s e . < / c o d e > < / p r e > < / a r t i c l e > < / d i v >