Advertisement
Guest User

Untitled

a guest
Mar 26th, 2019
102
0
Never
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
text 9.64 KB | None | 0 0
  1. +-----+-----+------------+------------+------------+------------+-------+------+------+------+-------+--------+
  2. | _c0| _c1| _c2| _c3| _c4| _c5| _c6| _c7| _c8| _c9| _c10| _c11|
  3. +-----+-----+------------+------------+------------+------------+-------+------+------+------+-------+--------+
  4. | id_1| id_2|cmp_fname_c1|cmp_fname_c2|cmp_lname_c1|cmp_lname_c2|cmp_sex|cmp_bd|cmp_bm|cmp_by|cmp_plz|is_match|
  5. | 607|53170| 1| ?| 1| ?| 1| 1| 1| 1| 1| TRUE|
  6. |88569|88592| 1| ?| 1| ?| 1| 1| 1| 1| 1| TRUE|
  7. |21282|26255| 1| ?| 1| ?| 1| 1| 1| 1| 1| TRUE|
  8. |20995|42541| 1| ?| 1| ?| 1| 1| 1| 1| 1| TRUE|
  9. |27989|34739| 1| ?| 1| ?| 1| 1| 1| 1| 1| TRUE|
  10. |32442|69159| 1| ?| 1| ?| 1| 1| 1| 1| 1| TRUE|
  11. |24738|29196| 1| 1| 1| ?| 1| 1| 1| 1| 1| TRUE|
  12. | 9904|89061| 1| ?| 1| ?| 1| 1| 1| 1| 1| TRUE|
  13. |29926|36578| 1| ?| 1| ?| 1| 1| 1| 1| 1| TRUE|
  14. |27815|46246| 1| ?| 1| ?| 1| 1| 1| 1| 1| TRUE|
  15. |71026|73461| 1| ?| 1| ?| 1| 1| 1| 1| 1| TRUE|
  16. |18812|54292| 1| 1| 1| ?| 1| 1| 1| 1| 0| TRUE|
  17. |20649|52511| 1| ?| 0.875| ?| 1| 1| 1| 1| 1| TRUE|
  18. |39573|49314| 1| ?| 1| ?| 1| 1| 1| 1| 1| TRUE|
  19. | 4018| 5824| 1| ?| 1| ?| 1| 1| 1| 1| 1| TRUE|
  20. |16333|40015| 1| ?| 1| ?| 1| 1| 1| 1| 1| TRUE|
  21. | 4572| 4636| 1| ?| 1| ?| 1| 1| 1| 1| 1| TRUE|
  22. |16892|39791| 1| ?| 1| ?| 1| 1| 1| 1| 1| TRUE|
  23. |40334|74815| 1| ?| 1| ?| 1| 1| 1| 1| 1| TRUE|
  24. +-----+-----+------------+------------+------------+------------+-------+------+------+------+-------+--------+
  25. only showing top 20 rows
  26.  
  27. root
  28. |-- _c0: string (nullable = true)
  29. |-- _c1: string (nullable = true)
  30. |-- _c2: string (nullable = true)
  31. |-- _c3: string (nullable = true)
  32. |-- _c4: string (nullable = true)
  33. |-- _c5: string (nullable = true)
  34. |-- _c6: string (nullable = true)
  35. |-- _c7: string (nullable = true)
  36. |-- _c8: string (nullable = true)
  37. |-- _c9: string (nullable = true)
  38. |-- _c10: string (nullable = true)
  39. |-- _c11: string (nullable = true)
  40.  
  41. +-----+-----+------------+------------+------------+------------+-------+------+------+------+-------+--------+
  42. | id_1| id_2|cmp_fname_c1|cmp_fname_c2|cmp_lname_c1|cmp_lname_c2|cmp_sex|cmp_bd|cmp_bm|cmp_by|cmp_plz|is_match|
  43. +-----+-----+------------+------------+------------+------------+-------+------+------+------+-------+--------+
  44. | 607|53170| 1.0| null| 1.0| null| 1| 1| 1| 1| 1| true|
  45. |88569|88592| 1.0| null| 1.0| null| 1| 1| 1| 1| 1| true|
  46. |21282|26255| 1.0| null| 1.0| null| 1| 1| 1| 1| 1| true|
  47. |20995|42541| 1.0| null| 1.0| null| 1| 1| 1| 1| 1| true|
  48. |27989|34739| 1.0| null| 1.0| null| 1| 1| 1| 1| 1| true|
  49. |32442|69159| 1.0| null| 1.0| null| 1| 1| 1| 1| 1| true|
  50. |24738|29196| 1.0| 1.0| 1.0| null| 1| 1| 1| 1| 1| true|
  51. | 9904|89061| 1.0| null| 1.0| null| 1| 1| 1| 1| 1| true|
  52. |29926|36578| 1.0| null| 1.0| null| 1| 1| 1| 1| 1| true|
  53. |27815|46246| 1.0| null| 1.0| null| 1| 1| 1| 1| 1| true|
  54. |71026|73461| 1.0| null| 1.0| null| 1| 1| 1| 1| 1| true|
  55. |18812|54292| 1.0| 1.0| 1.0| null| 1| 1| 1| 1| 0| true|
  56. |20649|52511| 1.0| null| 0.875| null| 1| 1| 1| 1| 1| true|
  57. |39573|49314| 1.0| null| 1.0| null| 1| 1| 1| 1| 1| true|
  58. | 4018| 5824| 1.0| null| 1.0| null| 1| 1| 1| 1| 1| true|
  59. |16333|40015| 1.0| null| 1.0| null| 1| 1| 1| 1| 1| true|
  60. | 4572| 4636| 1.0| null| 1.0| null| 1| 1| 1| 1| 1| true|
  61. |16892|39791| 1.0| null| 1.0| null| 1| 1| 1| 1| 1| true|
  62. |40334|74815| 1.0| null| 1.0| null| 1| 1| 1| 1| 1| true|
  63. |39491|41781| 1.0| null| 1.0| null| 1| 1| 1| 1| 1| true|
  64. +-----+-----+------------+------------+------------+------------+-------+------+------+------+-------+--------+
  65. only showing top 20 rows
  66.  
  67. root
  68. |-- id_1: integer (nullable = true)
  69. |-- id_2: integer (nullable = true)
  70. |-- cmp_fname_c1: double (nullable = true)
  71. |-- cmp_fname_c2: double (nullable = true)
  72. |-- cmp_lname_c1: double (nullable = true)
  73. |-- cmp_lname_c2: double (nullable = true)
  74. |-- cmp_sex: integer (nullable = true)
  75. |-- cmp_bd: integer (nullable = true)
  76. |-- cmp_bm: integer (nullable = true)
  77. |-- cmp_by: integer (nullable = true)
  78. |-- cmp_plz: integer (nullable = true)
  79. |-- is_match: boolean (nullable = true)
  80.  
  81. +--------+-------+
  82. |is_match| count|
  83. +--------+-------+
  84. | false|5728201|
  85. | true| 20931|
  86. +--------+-------+
  87.  
  88. +--------+-------+
  89. |is_match| cnt|
  90. +--------+-------+
  91. | false|5728201|
  92. | true| 20931|
  93. +--------+-------+
  94.  
  95. +-------+------------------+-----------------+-------------------+------------------+-------------------+-------------------+-------------------+-------------------+-------------------+------------------+-------------------+
  96. |summary| id_1| id_2| cmp_fname_c1| cmp_fname_c2| cmp_lname_c1| cmp_lname_c2| cmp_sex| cmp_bd| cmp_bm| cmp_by| cmp_plz|
  97. +-------+------------------+-----------------+-------------------+------------------+-------------------+-------------------+-------------------+-------------------+-------------------+------------------+-------------------+
  98. | count| 5749132| 5749132| 5748125| 103698| 5749132| 2464| 5749132| 5748337| 5748337| 5748337| 5736289|
  99. | mean| 33324.48559643438|66587.43558331935| 0.71290247044366|0.9000176718903193|0.31562781930798406|0.31841283153174427| 0.955001381078048|0.22446526708507172|0.48885529849763504|0.2227485966810923|0.00552866147434343|
  100. | stddev|23659.859374488133|23620.48761326975|0.38875835961627936|0.2713176105782334| 0.3342336339615827| 0.3685670662006655|0.20730111116897806|0.41722972238462636| 0.4998758236779028|0.4160909629831758|0.07414914925420049|
  101. | min| 1| 6| 0.0| 0.0| 0.0| 0.0| 0| 0| 0| 0| 0|
  102. | max| 99980| 100000| 1.0| 1.0| 1.0| 1.0| 1| 1| 1| 1| 1|
  103. +-------+------------------+-----------------+-------------------+------------------+-------------------+-------------------+-------------------+-------------------+-------------------+------------------+-------------------+
  104.  
  105. +-------+-------------------+------------------+
  106. |summary| cmp_fname_c1| cmp_fname_c2|
  107. +-------+-------------------+------------------+
  108. | count| 5748125| 103698|
  109. | mean| 0.71290247044366|0.9000176718903193|
  110. | stddev|0.38875835961627936|0.2713176105782334|
  111. | min| 0.0| 0.0|
  112. | max| 1.0| 1.0|
  113. +-------+-------------------+------------------+
  114.  
  115. +------------+---------+--------------------+
  116. | field| total| delta|
  117. +------------+---------+--------------------+
  118. | id_1|5749132.0| 1255.8076310367542|
  119. | cmp_plz|5736289.0| 0.9563812499852176|
  120. |cmp_lname_c2| 2464.0| 0.8064147192926265|
  121. | cmp_by|5748337.0| 0.7762059675300512|
  122. | cmp_bd|5748337.0| 0.775442311783404|
  123. |cmp_lname_c1|5749132.0| 0.6838772482595057|
  124. | cmp_bm|5748337.0| 0.5109496938298685|
  125. |cmp_fname_c1|5748125.0| 0.28545290574606175|
  126. |cmp_fname_c2| 103698.0| 0.0910426806228013|
  127. | cmp_sex|5749132.0|0.032408185250332844|
  128. | id_2|5749132.0| -15383.483201807663|
  129. +------------+---------+--------------------+
  130.  
  131. +-----+-----+-------+
  132. |above| true| false|
  133. +-----+-----+-------+
  134. | true|20871| 637|
  135. |false| 60|5727564|
  136. +-----+-----+-------+
Advertisement
Add Comment
Please, Sign In to add comment
Advertisement